00000001:02000400:1.0F:1788796758.122437:0:2955:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg438-server.virtnet: executing set_hostid 00000001:02000400:1.0:1788796777.944267:0:3177:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg438-server.virtnet: executing load_modules_local 00000001:01000000:2.0F:1788796780.215850:0:3241:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 775 MB/s 00000001:01000000:3.0F:1788796780.465330:0:3241:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 1219 MB/s 00000001:01000000:3.0:1788796780.715082:0:3241:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 6643 MB/s 00000020:02000000:0.0F:1788796781.561703:0:3270:0:(class_obd.c:771:obdclass_init()) Lustre: Build Version: 2.17.58_39_gc924a9e 00000400:02000000:0.0:1788796782.250434:0:3284:0:(api-ni.c:2828:lnet_startup_lndni()) Added LNI 192.168.204.138@tcp [8/256/0/180] 00008000:02000000:2.0:1788796786.228317:0:3433:0:(echo_client.c:2575:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:0.0:1788796842.203965:0:5238:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg438-server.virtnet: executing load_modules_local 00000020:01000004:3.0:1788796852.881937:0:5807:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1788796852.881945:0:5807:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:3.0:1788796852.882214:0:5807:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 00000000d7f29419 00000080:02000400:3.0:1788796852.882227:0:5807:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:3.0:1788796852.889149:0:5807:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200065, mountfl=0 00000020:01000004:3.0:1788796852.889164:0:5807:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1788796852.889647:0:5807:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (0000000062d661be) 00000020:00000080:3.0:1788796852.889670:0:5807:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1788796852.946387:0:5807:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:3.0:1788796852.946803:0:5807:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:1.0:1788796852.983214:0:5807:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:1.0:1788796852.983258:0:5807:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:1.0:1788796852.983279:0:5807:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:1.0:1788796852.983333:0:5807:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:1.0:1788796852.983359:0:5807:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:1.0:1788796852.983922:0:5807:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:1.0:1788796852.983932:0:5807:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:1.0:1788796852.983942:0:5807:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xca7fc0c411f931f9 00000020:01000004:1.0:1788796852.983950:0:5807:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:1.0:1788796852.983955:0:5807:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:1.0:1788796852.983959:0:5807:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000d7f29419 from MGS 00000020:01000004:1.0:1788796852.983964:0:5807:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:1.0:1788796852.983988:0:5807:0:(genops.c:413:class_newdev()) Allocate new device MGS (000000007e2f921d) 00000020:00000080:1.0:1788796852.984005:0:5807:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:1.0:1788796852.984185:0:5807:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000d7f29419 from MGS, refs=2 00080000:01000000:1.0:1788796852.984191:0:5807:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:1.0:1788796852.984197:0:5807:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xca7fc0c411f93207 00000100:00100000:1.0:1788796852.984296:0:5807:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:1.0:1788796852.984429:0:5807:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:1.0:1788796852.984435:0:5807:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:2.0:1788796852.986528:0:5807:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:2.0:1788796852.986538:0:5807:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:1.0:1788796852.987693:0:5807:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788796852.988437:0:5807:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:1.0:1788796852.988446:0:5807:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:1.0:1788796852.993444:0:5807:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:1.0:1788796852.993465:0:5807:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:2.0:1788796852.994135:0:5807:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:2.0:1788796852.994145:0:5807:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:3.0:1788796852.994995:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788796852.995000:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788796852.995001:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788796852.996066:0:5815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788796852.996070:0:5815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788796852.996072:0:5815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788796852.996809:0:5807:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:0.0:1788796853.007513:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:3.0:1788796853.246204:0:5807:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 3855 MB/s 00000001:01000000:3.0:1788796853.496160:0:5807:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 4423 MB/s 00000001:01000000:2.0:1788796853.746621:0:5807:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 695 MB/s 00000001:01000000:2.0:1788796853.996369:0:5807:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 731 MB/s 00080000:10000000:3.0:1788796854.002012:0:5807:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000040:01000000:3.0:1788796854.014898:0:5807:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:3.0:1788796854.014916:0:5807:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1788796854.014918:0:5807:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:3.0:1788796854.015579:0:5817:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:2.0:1788796854.015648:0:5807:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:2.0:1788796854.015740:0:5807:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:2.0:1788796854.015932:0:5807:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:2.0:1788796854.015958:0:5807:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1788796854.016584:0:5807:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788796854.016742:0:5807:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1788796854.016748:0:5807:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:1.0:1788796854.020453:0:5807:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:1.0:1788796854.020472:0:5807:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:1.0:1788796854.020832:0:5807:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:1.0:1788796854.020838:0:5807:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:2.0:1788796854.022496:0:5807:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:2.0:1788796854.022519:0:5807:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.204.138@tcp' 00000020:01000004:2.0:1788796854.022521:0:5807:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:2.0:1788796854.022581:0:5807:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.204.138@tcp (typ=mgc) 00000020:00000080:2.0:1788796854.022602:0:5807:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.204.138@tcp (000000002297ee2d) 00000020:00000080:2.0:1788796854.022620:0:5807:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:2.0:1788796854.022775:0:5807:0:(ldlm_lib.c:102:import_set_conn()) imp 0000000032711545@MGC192.168.204.138@tcp: add connection 192.168.204.138@tcp at head 00010000:00010000:2.0:1788796854.022918:0:5807:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.204.138@tcp-0 is initialized 00000040:01000000:2.0:1788796854.022924:0:5807:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.138@tcp ctxt 1 is initialized 00000100:00080000:1.0:1788796854.023244:0:5821:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:1.0:1788796854.024317:0:5822:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:2.0:1788796854.024953:0:5807:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.204.138@tcp (uuid e4fd12db-0bbb-441b-b6f0-f6d480305cb0) 00000020:00000080:2.0:1788796854.024976:0:5807:0:(genops.c:1384:class_connect()) connect: client e4fd12db-0bbb-441b-b6f0-f6d480305cb0, cookie 0xca7fc0c411f93215 00000100:00080000:2.0:1788796854.024988:0:5807:0:(import.c:545:import_select_connection()) MGC192.168.204.138@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788796854.024996:0:5807:0:(import.c:666:import_select_connection()) MGC192.168.204.138@tcp: import 0000000032711545 using connection 192.168.204.138@tcp/0@lo 00000100:00100000:2.0:1788796854.025067:0:5807:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000cc70fa19 x1875689374482560/t0(0) o250->MGC192.168.204.138@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788796854.025088:0:5807:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import e4fd12db-0bbb-441b-b6f0-f6d480305cb0->MGS 00000020:01000004:2.0:1788796854.025107:0:5807:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:2.0:1788796854.025133:0:5807:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:2.0:1788796854.025146:0:5807:0:(genops.c:413:class_newdev()) Allocate new device MDS (000000003e5ecdac) 00000020:00000080:2.0:1788796854.025158:0:5807:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:0.0:1788796854.030703:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000cc70fa19 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:3299:1875689374482560:0@lo:250: 00000100:00100000:0.0:1788796854.030781:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788796854.036385:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374482560 00000100:00100000:0.0:1788796854.036403:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374482560 00000100:00100000:0.0:1788796854.036507:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788796854.036514:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000596a842f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3299:x1875689374482560:12345-0@lo:250: 00010000:00080000:0.0:1788796854.036544:0:5818:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from e4fd12db-0bbb-441b-b6f0-f6d480305cb0@0@lo t0 exp 0000000000000000 cur 143 last 0 00000020:00000080:0.0:1788796854.036576:0:5818:0:(genops.c:1384:class_connect()) connect: client e4fd12db-0bbb-441b-b6f0-f6d480305cb0, cookie 0xca7fc0c411f93223 00000100:00080000:0.0:1788796854.036720:0:5818:0:(import.c:65:import_set_state_nolock()) 0000000000ecdb62 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788796854.042680:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000596a842f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+5:3299:x1875689374482560:12345-0@lo:250: Request processed in 6155us (11889us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796854.042698:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788796854.042898:0:3299:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.204.138@tcp: committing for last_committed 0 gen 1 00000100:00080000:1.0:1788796854.042912:0:3299:0:(import.c:1177:ptlrpc_connect_interpret()) MGC192.168.204.138@tcp: connect to target with instance 0 00000100:00080000:1.0:1788796854.042922:0:3299:0:(import.c:1001:ptlrpc_connect_set_flags()) MGC192.168.204.138@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:1.0:1788796854.042928:0:3299:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:1.0:1788796854.042933:0:3299:0:(import.c:65:import_set_state_nolock()) 0000000032711545 MGS: changing import state from CONNECTING to FULL 10000000:01000000:1.0:1788796854.042936:0:3299:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:1.0:1788796854.042946:0:3299:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:1.0:1788796854.042953:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000cc70fa19 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:3299:1875689374482560:0@lo:250: 00010000:00010000:1.0:1788796854.066223:0:5815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788796854.071113:0:5807:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788796854.071318:0:5807:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:2.0:1788796854.071326:0:5807:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:1.0:1788796854.073823:0:5807:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:1.0:1788796854.073838:0:5807:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:1.0:1788796854.074404:0:5807:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:1.0:1788796854.074412:0:5807:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:1.0:1788796854.075522:0:5807:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788796854.075733:0:5807:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:1.0:1788796854.075747:0:5807:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:2.0:1788796854.076276:0:5807:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:2.0:1788796854.076284:0:5807:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:3.0:1788796854.110145:0:5807:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788796854.110326:0:5807:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:3.0:1788796854.110332:0:5807:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:3.0:1788796854.111471:0:5807:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:3.0:1788796854.111480:0:5807:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:1.0:1788796854.112023:0:5807:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788796854.112206:0:5807:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:1.0:1788796854.112210:0:5807:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:1.0:1788796854.112933:0:5807:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:1.0:1788796854.112943:0:5807:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:1.0:1788796854.113630:0:5807:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788796854.113799:0:5807:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:1.0:1788796854.113805:0:5807:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:1.0:1788796854.114464:0:5807:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:1.0:1788796854.114472:0:5807:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:1.0:1788796854.115117:0:5807:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788796854.115298:0:5807:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:1.0:1788796854.115308:0:5807:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:3.0:1788796854.115880:0:5807:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:3.0:1788796854.115888:0:5807:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:2.0:1788796854.135625:0:5807:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788796854.135913:0:5807:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1788796854.135921:0:5807:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:2.0:1788796854.138250:0:5807:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1788796854.138266:0:5807:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:3.0:1788796854.139709:0:5807:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1788796854.139742:0:5807:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:3.0:1788796854.140606:0:5807:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:3.0:1788796854.140630:0:5807:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:3.0:1788796854.140636:0:5807:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.138@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:3.0:1788796854.140848:0:5807:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.138@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788796854.140881:0:5807:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.204.138@tcp, index=0000, flags=0x20065 00000020:01000004:3.0:1788796854.140886:0:5807:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788796854.140887:0:5807:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788796854.140889:0:5807:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788796854.140890:0:5807:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788796854.140891:0:5807:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788796854.140893:0:5807:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788796854.140894:0:5807:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788796854.140896:0:5807:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788796854.140897:0:5807:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788796854.140898:0:5807:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788796854.140899:0:5807:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788796854.140901:0:5807:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788796854.140903:0:5807:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:3.0:1788796854.140905:0:5807:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788796854.140907:0:5807:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788796854.140908:0:5807:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788796854.140909:0:5807:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788796854.140910:0:5807:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788796854.140911:0:5807:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788796854.140912:0:5807:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788796854.140913:0:5807:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788796854.140914:0:5807:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788796854.140915:0:5807:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788796854.140916:0:5807:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788796854.140917:0:5807:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788796854.140960:0:5807:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1788796854.140978:0:5807:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b5c04025 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:5807:1875689374482688:0@lo:253: 00000100:00100000:3.0:1788796854.141222:0:5807:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796854.141323:0:5807:0:(client.c:2716:ptlrpc_set_wait()) set 000000004109124f going to sleep for 11 seconds 00000100:00100000:0.0:1788796854.142198:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374482688 00000100:00100000:0.0:1788796854.142208:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374482688 00000100:00100000:0.0:1788796854.142312:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788796854.142321:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000d1d065d1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+5:5807:x1875689374482688:12345-0@lo:253: 20000000:01000000:0.0:1788796854.142379:0:5820:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1788796854.142382:0:5820:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:3.0:1788796854.144187:0:5841:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:0.0:1788796854.144347:0:5820:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:0.0:1788796854.144818:0:5820:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788796854.145912:0:5842:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:0.0:1788796854.149728:0:5820:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1788796854.149736:0:5820:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:0.0:1788796854.149743:0:5820:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:0.0:1788796854.149746:0:5820:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:0.0:1788796854.149764:0:5820:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:0.0:1788796854.150076:0:5820:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788796854.150317:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:0.0:1788796854.150331:0:5820:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1788796854.150379:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:0.0:1788796854.150439:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:0.0:1788796854.150479:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:0.0:1788796854.150566:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:0.0:1788796854.150574:0:5820:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:0.0:1788796854.150613:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:0.0:1788796854.150621:0:5820:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:0.0:1788796854.150667:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:0.0:1788796854.150675:0:5820:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:0.0:1788796854.150708:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:0.0:1788796854.150753:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:0.0:1788796854.150782:0:5820:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:0.0:1788796854.150787:0:5820:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:0.0:1788796854.150800:0:5820:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788796854.150995:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:0.0:1788796854.151005:0:5820:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1788796854.151072:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:0.0:1788796854.151109:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:0.0:1788796854.151157:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:0.0:1788796854.151168:0:5820:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:0.0:1788796854.151237:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:0.0:1788796854.151245:0:5820:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:0.0:1788796854.151307:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:0.0:1788796854.151344:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:0.0:1788796854.151379:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:0.0:1788796854.151390:0:5820:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:0.0:1788796854.151473:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:0.0:1788796854.151482:0:5820:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:0.0:1788796854.151517:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:0.0:1788796854.151554:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:0.0:1788796854.151754:0:5820:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:0.0:1788796854.151807:0:5820:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:0.0:1788796854.151815:0:5820:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:0.0:1788796854.152871:0:5843:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:1.0:1788796854.153296:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:1.0:1788796854.153324:0:5820:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.204.138@tcp for mdt 20000000:01000000:1.0:1788796854.153327:0:5820:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.138@tcp (null) (null) (null) 00000040:00080000:1.0:1788796854.153363:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:1.0:1788796854.153370:0:5820:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:1.0:1788796854.153400:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:1.0:1788796854.153407:0:5820:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.204.138@tcp (null) (null) 00000040:00080000:1.0:1788796854.153454:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:1.0:1788796854.153464:0:5820:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:1.0:1788796854.153499:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:1.0:1788796854.153534:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:1.0:1788796854.153593:0:5820:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:1.0:1788796854.153596:0:5820:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1788796854.153600:0:5820:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1788796854.153613:0:5820:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1788796854.153615:0:5820:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:1.0:1788796854.153643:0:5820:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1788796854.153645:0:5820:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:3.0:1788796854.154132:0:5844:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 00000040:00080000:1.0:1788796854.154403:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:1.0:1788796854.154444:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 80 off10096 00000040:00080000:1.0:1788796854.154509:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10320 20000000:01000000:1.0:1788796854.154522:0:5820:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1788796854.154524:0:5820:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:1.0:1788796854.155379:0:5845:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:0.0:1788796854.155668:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:0.0:1788796854.155719:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:0.0:1788796854.155753:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 00000020:00000080:0.0:1788796854.155768:0:5820:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788796854.155771:0:5820:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 100 to 20 20000000:01000000:0.0:1788796854.155775:0:5820:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:0.0:1788796854.155777:0:5820:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:0.0:1788796854.155784:0:5820:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:0.0:1788796854.155791:0:5820:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:0.0:1788796854.156240:0:5846:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 20000000:02000000:1.0:1788796854.156335:0:5820:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:1.0:1788796854.164680:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10544 00000040:00080000:1.0:1788796854.164747:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 160 off10704 00000040:00080000:1.0:1788796854.164858:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 10000000:01000000:1.0:1788796854.164883:0:5820:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1788796854.164906:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000087bbbdb4/0xca7fc0c411f9322a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796854.164946:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000087bbbdb4/0xca7fc0c411f9322a lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796854.164958:0:5820:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000087bbbdb4/0xca7fc0c411f9322a lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796854.164965:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000087bbbdb4/0xca7fc0c411f9322a lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796854.164972:0:5820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000087bbbdb4/0xca7fc0c411f9322a lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796854.164980:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000087bbbdb4/0xca7fc0c411f9322a lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796854.164986:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000087bbbdb4 already unused, calling callback (00000000bf1800db) 00010000:00010000:1.0:1788796854.164989:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000087bbbdb4/0xca7fc0c411f9322a lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796854.164998:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000087bbbdb4/0xca7fc0c411f9322a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796854.165014:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000087bbbdb4/0xca7fc0c411f9322a lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796854.165021:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000087bbbdb4/0xca7fc0c411f9322a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796854.165070:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000087bbbdb4/0xca7fc0c411f9322a lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788796854.165100:0:5820:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:1.0:1788796854.424575:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000d1d065d1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+5:5807:x1875689374482688:12345-0@lo:253: Request processed in 282246us (283344us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796854.424689:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788796854.424846:0:5807:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b5c04025 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:5807:1875689374482688:0@lo:253: 10000000:01000000:3.0:1788796854.424869:0:5807:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1788796854.425128:0:5807:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788796854.425131:0:5807:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788796854.425132:0:5807:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788796854.425133:0:5807:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:3.0:1788796854.425134:0:5807:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788796854.425136:0:5807:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788796854.425137:0:5807:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788796854.425139:0:5807:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788796854.425140:0:5807:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1788796854.425142:0:5807:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788796854.425143:0:5807:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788796854.425249:0:5807:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000d7f29419 from lustre-MDT0000 10000000:01000000:2.0:1788796854.425279:0:5807:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:2.0:1788796854.425282:0:5807:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1788796854.425286:0:5807:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff8cb0494f0000 10000000:01000000:2.0:1788796854.425290:0:5807:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788796854.425299:0:5807:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8cb0494f0000 from 1 10000000:01000000:2.0:1788796854.425303:0:5807:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788796854.425340:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.138@tcp lock: 0000000021ce8fa1/0xca7fc0c411f93231 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796854.425351:0:5807:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.138@tcp lock: 0000000021ce8fa1/0xca7fc0c411f93231 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796854.425360:0:5807:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.138@tcp lock: 0000000021ce8fa1/0xca7fc0c411f93231 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788796854.425378:0:5807:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005d5e2e79 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:5807:1875689374482816:0@lo:101: 00000100:00100000:2.0:1788796854.425465:0:5807:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788796854.425567:0:5807:0:(client.c:2716:ptlrpc_set_wait()) set 000000005b2c69e0 going to sleep for 11 seconds 00000100:00100000:0.0:1788796854.425742:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374482816 00000100:00100000:0.0:1788796854.425749:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374482816 00000100:00100000:0.0:1788796854.425825:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788796854.425833:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000007773b2ce pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+5:5807:x1875689374482816:12345-0@lo:101: 00010000:00010000:0.0:1788796854.425845:0:5818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788796854.425858:0:5818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000039ca93bf/0xca7fc0c411f93238 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xca7fc0c411f93231 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796854.425892:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000039ca93bf/0xca7fc0c411f93238 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xca7fc0c411f93231 expref: 6 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796854.425904:0:5818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000039ca93bf/0xca7fc0c411f93238 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xca7fc0c411f93231 expref: 6 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796854.425920:0:5818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000039ca93bf, rc 0) 00000100:00100000:0.0:1788796854.425978:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000007773b2ce pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+6:5807:x1875689374482816:12345-0@lo:101: Request processed in 145us (512us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796854.425985:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788796854.426076:0:5807:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005d5e2e79 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:5807:1875689374482816:0@lo:101: 00010000:00010000:2.0:1788796854.426089:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.138@tcp lock: 0000000021ce8fa1/0xca7fc0c411f93231 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xca7fc0c411f93238 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796854.426104:0:5807:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.138@tcp lock: 0000000021ce8fa1/0xca7fc0c411f93231 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xca7fc0c411f93238 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788796854.426152:0:5807:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005d5e2e79 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:5807:1875689374482944:0@lo:501: 00000100:00100000:2.0:1788796854.426178:0:5807:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788796854.426560:0:5807:0:(client.c:2716:ptlrpc_set_wait()) set 000000005b2c69e0 going to sleep for 11 seconds 00000100:00100000:1.0:1788796854.426719:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374482944 00000100:00100000:1.0:1788796854.426725:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374482944 00000100:00100000:1.0:1788796854.426749:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788796854.426755:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000a590e233 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+6:5807:x1875689374482944:12345-0@lo:501: 00000100:00100000:1.0:1788796854.427371:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000a590e233 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+6:5807:x1875689374482944:12345-0@lo:501: Request processed in 614us (1190us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788796854.427380:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788796854.427489:0:5807:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005d5e2e79 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:5807:1875689374482944:0@lo:501: 10000000:01000000:2.0:1788796854.427523:0:5807:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.138@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1788796854.427544:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.138@tcp lock: 0000000021ce8fa1/0xca7fc0c411f93231 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xca7fc0c411f93238 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796854.427554:0:5807:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.138@tcp lock: 0000000021ce8fa1/0xca7fc0c411f93231 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xca7fc0c411f93238 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788796854.427563:0:5807:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8cb042f0b000 10000000:01000000:2.0:1788796854.427568:0:5807:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1788796854.427572:0:5807:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8cb042f0b000 10000000:01000000:2.0:1788796854.427575:0:5807:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1788796854.427577:0:5807:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8cb042f0b000 from 1 10000000:01000000:2.0:1788796854.427580:0:5807:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1788796854.427619:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.138@tcp lock: 0000000067b3dde1/0xca7fc0c411f9323f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796854.427627:0:5807:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.138@tcp lock: 0000000067b3dde1/0xca7fc0c411f9323f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796854.427636:0:5807:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.138@tcp lock: 0000000067b3dde1/0xca7fc0c411f9323f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788796854.427673:0:5807:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005d5e2e79 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:5807:1875689374483072:0@lo:101: 00000100:00100000:2.0:1788796854.427702:0:5807:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788796854.427730:0:5807:0:(client.c:2716:ptlrpc_set_wait()) set 000000005b2c69e0 going to sleep for 11 seconds 00000100:00100000:1.0:1788796854.427859:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374483072 00000100:00100000:1.0:1788796854.427867:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374483072 00000100:00100000:1.0:1788796854.427907:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788796854.428237:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000b248417c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+6:5807:x1875689374483072:12345-0@lo:101: 00010000:00010000:1.0:1788796854.428251:0:5819:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788796854.428268:0:5819:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000087bbbdb4/0xca7fc0c411f93246 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xca7fc0c411f9323f expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796854.428288:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000087bbbdb4/0xca7fc0c411f93246 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xca7fc0c411f9323f expref: 7 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796854.428298:0:5819:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000087bbbdb4/0xca7fc0c411f93246 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xca7fc0c411f9323f expref: 7 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796854.428307:0:5819:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000087bbbdb4, rc 0) 00000100:00100000:1.0:1788796854.428353:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000b248417c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+7:5807:x1875689374483072:12345-0@lo:101: Request processed in 439us (651us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796854.428370:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788796854.428460:0:5807:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005d5e2e79 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:5807:1875689374483072:0@lo:101: 00010000:00010000:2.0:1788796854.428473:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.138@tcp lock: 0000000067b3dde1/0xca7fc0c411f9323f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xca7fc0c411f93246 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796854.428481:0:5807:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.138@tcp lock: 0000000067b3dde1/0xca7fc0c411f9323f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xca7fc0c411f93246 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788796854.428497:0:5807:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.138@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1788796854.428513:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.138@tcp lock: 0000000067b3dde1/0xca7fc0c411f9323f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xca7fc0c411f93246 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796854.428520:0:5807:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.138@tcp lock: 0000000067b3dde1/0xca7fc0c411f9323f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xca7fc0c411f93246 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788796854.428526:0:5807:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1788796854.428531:0:5807:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788796854.428536:0:5807:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8cb042f0b000 10000000:01000000:2.0:1788796854.428538:0:5807:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1788796854.428541:0:5807:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:2.0:1788796854.428543:0:5807:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1788796854.428559:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.138@tcp lock: 00000000d928ec69/0xca7fc0c411f9324d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796854.428565:0:5807:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.138@tcp lock: 00000000d928ec69/0xca7fc0c411f9324d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796854.428582:0:5807:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.138@tcp lock: 00000000d928ec69/0xca7fc0c411f9324d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788796854.428610:0:5807:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005d5e2e79 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:5807:1875689374483200:0@lo:101: 00000100:00100000:2.0:1788796854.428643:0:5807:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788796854.428680:0:5807:0:(client.c:2716:ptlrpc_set_wait()) set 000000005b2c69e0 going to sleep for 11 seconds 00000100:00100000:1.0:1788796854.428750:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374483200 00000100:00100000:1.0:1788796854.428755:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374483200 00000100:00100000:1.0:1788796854.428775:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788796854.428780:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000eace5d82 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+7:5807:x1875689374483200:12345-0@lo:101: 00010000:00010000:1.0:1788796854.428787:0:5819:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788796854.428794:0:5819:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000097094ba6/0xca7fc0c411f93254 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xca7fc0c411f9324d expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796854.428811:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000097094ba6/0xca7fc0c411f93254 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xca7fc0c411f9324d expref: 8 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796854.428818:0:5819:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000097094ba6/0xca7fc0c411f93254 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xca7fc0c411f9324d expref: 8 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796854.428823:0:5819:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000097094ba6, rc 0) 00000100:00100000:1.0:1788796854.428854:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000eace5d82 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+8:5807:x1875689374483200:12345-0@lo:101: Request processed in 74us (212us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796854.428860:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788796854.428873:0:5807:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005d5e2e79 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:5807:1875689374483200:0@lo:101: 00010000:00010000:2.0:1788796854.428883:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.138@tcp lock: 00000000d928ec69/0xca7fc0c411f9324d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xca7fc0c411f93254 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796854.428890:0:5807:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.138@tcp lock: 00000000d928ec69/0xca7fc0c411f9324d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xca7fc0c411f93254 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788796854.428942:0:5807:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005d5e2e79 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:5807:1875689374483328:0@lo:501: 00000100:00100000:2.0:1788796854.428966:0:5807:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788796854.428986:0:5807:0:(client.c:2716:ptlrpc_set_wait()) set 000000005b2c69e0 going to sleep for 11 seconds 00000100:00100000:3.0:1788796854.429321:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374483328 00000100:00100000:3.0:1788796854.429329:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374483328 00000100:00100000:2.0:1788796854.430101:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788796854.430112:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000066e7052b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+8:5807:x1875689374483328:12345-0@lo:501: 00000100:00100000:2.0:1788796854.430524:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000066e7052b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+9:5807:x1875689374483328:12345-0@lo:501: Request processed in 413us (1556us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796854.430531:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788796854.430770:0:5807:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005d5e2e79 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:5807:1875689374483328:0@lo:501: 00000100:00100000:3.0:1788796854.430827:0:5807:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b5c04025 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:5807:1875689374483456:0@lo:503: 00000100:00100000:3.0:1788796854.430878:0:5807:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796854.431055:0:5807:0:(client.c:2716:ptlrpc_set_wait()) set 000000004109124f going to sleep for 11 seconds 00000100:00100000:1.0:1788796854.431124:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374483456 00000100:00100000:1.0:1788796854.431141:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374483456 00000100:00100000:1.0:1788796854.431172:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788796854.431178:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000f1e1c33b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+9:5807:x1875689374483456:12345-0@lo:503: 00000100:00100000:1.0:1788796854.431478:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000f1e1c33b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+9:5807:x1875689374483456:12345-0@lo:503: Request processed in 299us (599us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796854.431486:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788796854.431845:0:5807:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b5c04025 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:5807:1875689374483456:0@lo:503: 00000100:00100000:0.0:1788796854.432536:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e9166526 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:5849:1875689374483584:0@lo:502: 00000100:00100000:0.0:1788796854.432677:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788796854.432754:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set 000000004506c2ce going to sleep for 11 seconds 00000100:00100000:1.0:1788796854.432794:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374483584 00000100:00100000:1.0:1788796854.432800:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374483584 00000100:00100000:1.0:1788796854.432893:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788796854.432905:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000001f19df69 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+9:5849:x1875689374483584:12345-0@lo:502: 00000100:00100000:0.0:1788796854.433564:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000001f19df69 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+9:5849:x1875689374483584:12345-0@lo:502: Request processed in 662us (886us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796854.433620:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788796854.433759:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e9166526 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:5849:1875689374483584:0@lo:502: 00000020:01000000:3.0:1788796854.433788:0:5849:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788796854.433799:0:5849:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788796854.433801:0:5849:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1788796854.433806:0:5849:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:3.0:1788796854.433809:0:5849:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788796854.433823:0:5849:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (000000003c035e25) 00000020:00000080:3.0:1788796854.433840:0:5849:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:3.0:1788796854.433844:0:5849:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1788796854.433939:0:5849:0:(osd_handler.c:1574:osd_obd_connect()) connect #2 00000020:00000080:3.0:1788796854.433954:0:5849:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xca7fc0c411f93262 00000020:00000080:3.0:1788796854.434275:0:5849:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1788796854.434281:0:5849:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788796854.434284:0:5849:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788796854.434285:0:5849:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1788796854.434287:0:5849:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788796854.434290:0:5849:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788796854.434291:0:5849:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:3.0:1788796854.434295:0:5849:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788796854.434303:0:5849:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (00000000f44ef65d) 00000020:00000080:3.0:1788796854.434313:0:5849:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:3.0:1788796854.434316:0:5849:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1788796854.434318:0:5849:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:3.0:1788796854.434321:0:5849:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:3.0:1788796854.434327:0:5849:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788796854.434371:0:5849:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000d7f29419 from lustre-MDT0000, refs=3 00000020:00000080:3.0:1788796854.434384:0:5849:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (0000000074b08986) 00000020:00000080:3.0:1788796854.434482:0:5849:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:3.0:1788796854.434535:0:5849:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1788796854.434540:0:5849:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xca7fc0c411f93277 00000020:00000080:3.0:1788796854.434707:0:5849:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:3.0:1788796854.434714:0:5849:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1788796854.434718:0:5849:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xca7fc0c411f9327e 00080000:01000000:3.0:1788796854.434723:0:5849:0:(osd_handler.c:1574:osd_obd_connect()) connect #3 00000020:00000080:3.0:1788796854.434726:0:5849:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xca7fc0c411f93285 00080000:10000000:2.0:1788796854.435441:0:5849:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 40000000:02000000:2.0:1788796854.435820:0:5849:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:2.0:1788796854.441834:0:5849:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:0.0:1788796854.604817:0:5849:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:0.0:1788796854.605534:0:5849:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:0.0:1788796854.609308:0:5849:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:0.0:1788796854.609803:0:5849:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:0.0:1788796854.688848:0:5849:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (00000000f3eff6e3) 00000020:00000080:0.0:1788796854.688871:0:5849:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:0.0:1788796854.688979:0:5849:0:(osd_handler.c:1574:osd_obd_connect()) connect #4 00000020:00000080:0.0:1788796854.688987:0:5849:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xca7fc0c411f93293 00000020:00000080:0.0:1788796854.690804:0:5849:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:2.0:1788796854.721724:0:5849:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/8/4) registered 00080000:10000000:2.0:1788796854.785361:0:5849:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/8/4) registered 00080000:10000000:2.0:1788796854.846946:0:5849:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/8/4) registered 00080000:10000000:2.0:1788796854.905127:0:5849:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/8/4) registered 00080000:10000000:2.0:1788796855.000674:0:5849:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/8/4) registered 00080000:10000000:0.0:1788796855.053947:0:5849:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/8/4) registered 00010000:00010000:2.0:1788796855.090842:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788796855.124130:0:5849:0:(genops.c:1384:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xca7fc0c411f9329a 00000020:00000080:0.0:1788796855.124665:0:5849:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:0.0:1788796855.124677:0:5849:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788796855.124683:0:5849:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788796855.124685:0:5849:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:0.0:1788796855.124687:0:5849:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788796855.124691:0:5849:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788796855.124692:0:5849:0:(obd_config.c:1563:class_process_config()) marker 8 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788796855.124695:0:5849:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788796855.124697:0:5849:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1788796855.124699:0:5849:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788796855.124707:0:5849:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788796855.124708:0:5849:0:(obd_config.c:1563:class_process_config()) marker 8 (0x2) lustre sys.timeout 00000020:01000000:0.0:1788796855.124711:0:5849:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788796855.124715:0:5849:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788796855.124716:0:5849:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:0.0:1788796855.124720:0:5849:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1788796855.124760:0:5849:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000100:00100000:0.0:1788796855.124811:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000028211ce9 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:5849:1875689374483712:0@lo:502: 00000100:00100000:0.0:1788796855.124899:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788796855.125108:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e06ce095 going to sleep for 11 seconds 00000100:00100000:3.0:1788796855.125377:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374483712 00000100:00100000:3.0:1788796855.125386:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374483712 00000100:00100000:3.0:1788796855.125441:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788796855.125450:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000206a3655 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+9:5849:x1875689374483712:12345-0@lo:502: 00000100:00100000:3.0:1788796855.125803:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000206a3655 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+9:5849:x1875689374483712:12345-0@lo:502: Request processed in 354us (905us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796855.125812:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788796855.126217:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000028211ce9 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:5849:1875689374483712:0@lo:502: 00000020:01000000:0.0:1788796855.126337:0:5849:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788796855.126347:0:5849:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788796855.126349:0:5849:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000040:00080000:0.0:1788796855.126354:0:5849:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:3.0:1788796855.126703:0:5807:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:3.0:1788796855.126724:0:5807:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.138@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1788796855.126745:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.138@tcp lock: 00000000d928ec69/0xca7fc0c411f9324d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xca7fc0c411f93254 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796855.126758:0:5807:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.138@tcp lock: 00000000d928ec69/0xca7fc0c411f9324d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xca7fc0c411f93254 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788796855.126767:0:5807:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8cb042f0b000 from 1 10000000:01000000:3.0:1788796855.126770:0:5807:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788796855.126804:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.138@tcp lock: 00000000be7b1247/0xca7fc0c411f932a1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796855.126812:0:5807:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.138@tcp lock: 00000000be7b1247/0xca7fc0c411f932a1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796855.126821:0:5807:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.138@tcp lock: 00000000be7b1247/0xca7fc0c411f932a1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788796855.126838:0:5807:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b5c04025 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:5807:1875689374483840:0@lo:101: 00000100:00100000:3.0:1788796855.126884:0:5807:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796855.126925:0:5807:0:(client.c:2716:ptlrpc_set_wait()) set 000000004109124f going to sleep for 11 seconds 00000100:00100000:0.0:1788796855.127170:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374483840 00000100:00100000:0.0:1788796855.127177:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374483840 00000100:00100000:0.0:1788796855.127214:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788796855.127222:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000009820e194 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+9:5807:x1875689374483840:12345-0@lo:101: 00010000:00010000:0.0:1788796855.127234:0:5819:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788796855.127254:0:5819:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000d500f348/0xca7fc0c411f932a8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xca7fc0c411f932a1 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796855.127476:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000d500f348/0xca7fc0c411f932a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xca7fc0c411f932a1 expref: 10 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796855.127490:0:5819:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000d500f348/0xca7fc0c411f932a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xca7fc0c411f932a1 expref: 10 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796855.127570:0:5819:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000d500f348, rc 0) 00000100:00100000:0.0:1788796855.127707:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000009820e194 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+10:5807:x1875689374483840:12345-0@lo:101: Request processed in 484us (822us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796855.127714:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788796855.127788:0:5807:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b5c04025 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:5807:1875689374483840:0@lo:101: 00010000:00010000:3.0:1788796855.127800:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.138@tcp lock: 00000000be7b1247/0xca7fc0c411f932a1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xca7fc0c411f932a8 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796855.127809:0:5807:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.138@tcp lock: 00000000be7b1247/0xca7fc0c411f932a1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xca7fc0c411f932a8 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788796855.128722:0:5807:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b5c04025 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:5807:1875689374483968:0@lo:256: 00000100:00100000:3.0:1788796855.128789:0:5807:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796855.128825:0:5807:0:(client.c:2716:ptlrpc_set_wait()) set 000000004109124f going to sleep for 11 seconds 00000100:00100000:0.0:1788796855.129115:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374483968 00000100:00100000:0.0:1788796855.129123:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374483968 00000100:00100000:0.0:1788796855.129168:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788796855.129175:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000006a40230b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+10:5807:x1875689374483968:12345-0@lo:256: 20000000:01000000:0.0:1788796855.129195:0:5820:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1788796855.129201:0:5820:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:0.0:1788796855.129633:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000006a40230b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+10:5807:x1875689374483968:12345-0@lo:256: Request processed in 457us (843us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796855.129651:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788796855.129818:0:5807:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b5c04025 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:5807:1875689374483968:0@lo:256: 10000000:01000000:1.0:1788796855.131682:0:5807:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.138@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788796855.131743:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.138@tcp lock: 00000000be7b1247/0xca7fc0c411f932a1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xca7fc0c411f932a8 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796855.131757:0:5807:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.138@tcp lock: 00000000be7b1247/0xca7fc0c411f932a1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xca7fc0c411f932a8 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788796855.131832:0:5807:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8cb042f0b000 from 1 10000000:01000000:0.0:1788796855.131837:0:5807:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788796855.131880:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.138@tcp lock: 0000000042895792/0xca7fc0c411f932af lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796855.131888:0:5807:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.138@tcp lock: 0000000042895792/0xca7fc0c411f932af lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796855.131898:0:5807:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.138@tcp lock: 0000000042895792/0xca7fc0c411f932af lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788796855.131918:0:5807:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000028211ce9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:5807:1875689374484096:0@lo:101: 00000100:00100000:0.0:1788796855.132103:0:5807:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788796855.132151:0:5807:0:(client.c:2716:ptlrpc_set_wait()) set 00000000420e5f2c going to sleep for 11 seconds 00000100:00100000:3.0:1788796855.132265:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374484096 00000100:00100000:3.0:1788796855.132281:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374484096 00000100:00100000:3.0:1788796855.132338:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788796855.132346:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000003d1cca8a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+10:5807:x1875689374484096:12345-0@lo:101: 00010000:00010000:3.0:1788796855.132359:0:5819:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788796855.132373:0:5819:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000577ee06b/0xca7fc0c411f932b6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xca7fc0c411f932af expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796855.132394:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000577ee06b/0xca7fc0c411f932b6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xca7fc0c411f932af expref: 11 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796855.132405:0:5819:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000577ee06b/0xca7fc0c411f932b6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xca7fc0c411f932af expref: 11 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796855.132413:0:5819:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000577ee06b, rc 0) 00000100:00100000:3.0:1788796855.132448:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000003d1cca8a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+11:5807:x1875689374484096:12345-0@lo:101: Request processed in 103us (346us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796855.132454:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788796855.132662:0:5807:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000028211ce9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:5807:1875689374484096:0@lo:101: 00010000:00010000:0.0:1788796855.132675:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.138@tcp lock: 0000000042895792/0xca7fc0c411f932af lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xca7fc0c411f932b6 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796855.132701:0:5807:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.138@tcp lock: 0000000042895792/0xca7fc0c411f932af lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xca7fc0c411f932b6 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788796855.132758:0:5807:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000028211ce9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:5807:1875689374484224:0@lo:501: 00000100:00100000:0.0:1788796855.132783:0:5807:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788796855.132799:0:5807:0:(client.c:2716:ptlrpc_set_wait()) set 00000000420e5f2c going to sleep for 11 seconds 00000100:00100000:3.0:1788796855.132905:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374484224 00000100:00100000:3.0:1788796855.132909:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374484224 00000100:00100000:3.0:1788796855.132938:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788796855.132944:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000009faafe5c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+11:5807:x1875689374484224:12345-0@lo:501: 00000100:00100000:3.0:1788796855.133873:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000009faafe5c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+11:5807:x1875689374484224:12345-0@lo:501: Request processed in 926us (1086us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796855.133885:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788796855.134181:0:5807:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000028211ce9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:5807:1875689374484224:0@lo:501: 00000100:00100000:0.0:1788796855.134225:0:5807:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000028211ce9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:5807:1875689374484352:0@lo:503: 00000100:00100000:0.0:1788796855.134376:0:5807:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788796855.134428:0:5807:0:(client.c:2716:ptlrpc_set_wait()) set 00000000420e5f2c going to sleep for 11 seconds 00000100:00100000:2.0:1788796855.134865:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374484352 00000100:00100000:2.0:1788796855.134873:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374484352 00000100:00100000:2.0:1788796855.134917:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788796855.134924:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000f731f44d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+11:5807:x1875689374484352:12345-0@lo:503: 00000040:00080000:2.0:1788796855.135067:0:5818:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788796855.135118:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000f731f44d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+11:5807:x1875689374484352:12345-0@lo:503: Request processed in 194us (742us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796855.135126:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788796855.135783:0:5807:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000028211ce9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:5807:1875689374484352:0@lo:503: 00000040:00080000:2.0:1788796855.138790:0:5853:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:3.0:1788796855.138956:0:5807:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:3.0:1788796855.139078:0:5807:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.138@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788796855.139097:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.138@tcp lock: 0000000042895792/0xca7fc0c411f932af lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xca7fc0c411f932b6 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796855.139110:0:5807:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.138@tcp lock: 0000000042895792/0xca7fc0c411f932af lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xca7fc0c411f932b6 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788796855.139160:0:5807:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1788796855.139163:0:5807:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8cb042f0b000 10000000:01000000:3.0:1788796855.139167:0:5807:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8cb042f0b000 10000000:01000000:3.0:1788796855.139173:0:5807:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788796855.139180:0:5807:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8cb042f0b000 from 1 10000000:01000000:3.0:1788796855.139183:0:5807:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788796855.139228:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.138@tcp lock: 00000000301718fa/0xca7fc0c411f932bd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796855.139236:0:5807:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.138@tcp lock: 00000000301718fa/0xca7fc0c411f932bd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796855.139258:0:5807:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.138@tcp lock: 00000000301718fa/0xca7fc0c411f932bd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788796855.139411:0:5807:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000009c1891d pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:5807:1875689374484480:0@lo:101: 00000100:00100000:3.0:1788796855.139489:0:5807:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788796855.139705:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374484480 00000100:00100000:2.0:1788796855.139715:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374484480 00000100:00100000:2.0:1788796855.139767:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788796855.139775:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000041b071e0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+11:5807:x1875689374484480:12345-0@lo:101: 00010000:00010000:2.0:1788796855.139791:0:5820:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788796855.139808:0:5820:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000ae867b02/0xca7fc0c411f932c4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xca7fc0c411f932bd expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796855.139833:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000ae867b02/0xca7fc0c411f932c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xca7fc0c411f932bd expref: 12 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796855.139843:0:5820:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000ae867b02/0xca7fc0c411f932c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xca7fc0c411f932bd expref: 12 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796855.139851:0:5820:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000ae867b02, rc 0) 00000100:00100000:2.0:1788796855.139888:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000041b071e0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+12:5807:x1875689374484480:12345-0@lo:101: Request processed in 113us (399us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796855.139902:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788796855.140096:0:5807:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e1ace98d going to sleep for 11 seconds 00000100:00100000:3.0:1788796855.140123:0:5807:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000009c1891d pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:5807:1875689374484480:0@lo:101: 00010000:00010000:3.0:1788796855.140139:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.138@tcp lock: 00000000301718fa/0xca7fc0c411f932bd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xca7fc0c411f932c4 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796855.140149:0:5807:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.138@tcp lock: 00000000301718fa/0xca7fc0c411f932bd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xca7fc0c411f932c4 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788796855.140216:0:5807:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000009c1891d pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:5807:1875689374484608:0@lo:501: 00000100:00100000:3.0:1788796855.140245:0:5807:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796855.140258:0:5807:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e1ace98d going to sleep for 11 seconds 00000100:00100000:1.0:1788796855.140597:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374484608 00000100:00100000:1.0:1788796855.140603:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374484608 00000100:00100000:1.0:1788796855.140663:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788796855.140670:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000e490b218 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+12:5807:x1875689374484608:12345-0@lo:501: 00000100:00100000:1.0:1788796855.140918:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000e490b218 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+12:5807:x1875689374484608:12345-0@lo:501: Request processed in 249us (674us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796855.140926:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788796855.141210:0:5807:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000009c1891d pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:5807:1875689374484608:0@lo:501: 00000100:00100000:3.0:1788796855.141247:0:5807:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000009c1891d pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:5807:1875689374484736:0@lo:503: 00000100:00100000:3.0:1788796855.141484:0:5807:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796855.141719:0:5807:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e1ace98d going to sleep for 11 seconds 00000100:00100000:1.0:1788796855.141776:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374484736 00000100:00100000:1.0:1788796855.141782:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374484736 00000100:00100000:1.0:1788796855.141817:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788796855.141824:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000ca28a681 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+12:5807:x1875689374484736:12345-0@lo:503: 00000100:00100000:1.0:1788796855.142783:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000ca28a681 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+12:5807:x1875689374484736:12345-0@lo:503: Request processed in 957us (1297us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796855.142795:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788796855.143049:0:5807:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000009c1891d pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:5807:1875689374484736:0@lo:503: 00000100:00100000:3.0:1788796855.144215:0:5854:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000009c1891d pname:cluuid:pid:xid:nid:opc:job llog_process_th:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:5854:1875689374484864:0@lo:502: 00000100:00100000:3.0:1788796855.144487:0:5854:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796855.144710:0:5854:0:(client.c:2716:ptlrpc_set_wait()) set 000000004d7d44b5 going to sleep for 11 seconds 00000100:00100000:2.0:1788796855.144749:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374484864 00000100:00100000:2.0:1788796855.144756:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374484864 00000100:00100000:2.0:1788796855.144850:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788796855.144860:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000002ee42d92 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+12:5854:x1875689374484864:12345-0@lo:502: 00000100:00100000:2.0:1788796855.145623:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000002ee42d92 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+12:5854:x1875689374484864:12345-0@lo:502: Request processed in 753us (1125us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796855.145633:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788796855.145930:0:5854:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000009c1891d pname:cluuid:pid:xid:nid:opc:job llog_process_th:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:5854:1875689374484864:0@lo:502: 00000020:01000004:3.0:1788796855.146165:0:5854:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:3.0:1788796855.146195:0:5854:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (000000006948058a) 00000020:00000080:3.0:1788796855.146217:0:5854:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:3.0:1788796855.146725:0:5854:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000d7f29419 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1788796855.146731:0:5854:0:(tgt_mount.c:187:server_put_mount()) put mount 00000000d7f29419 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1788796855.146733:0:5854:0:(obd_mount.c:710:lustre_put_lsi()) put 00000000d7f29419 4 00010000:00080000:3.0:1788796855.146767:0:5854:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000bae0cc53@lustre-MDT0000-lwp-MDT0000: add connection 192.168.204.138@tcp at head 00010000:00010000:3.0:1788796855.151879:0:5854:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:3.0:1788796855.152872:0:5854:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:3.0:1788796855.152919:0:5854:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788796855.152933:0:5854:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xca7fc0c411f932d2 00000100:00080000:3.0:1788796855.152957:0:5854:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788796855.152976:0:5854:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000bae0cc53 using connection 192.168.204.138@tcp/0@lo 00000100:00100000:3.0:1788796855.153024:0:5854:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000009c1891d x1875689374484992/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788796855.153081:0:5854:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1788796855.153243:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000009c1891d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3299:1875689374484992:0@lo:38: 00000100:00100000:0.0:1788796855.153343:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796855.153848:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374484992 00000100:00100000:3.0:1788796855.153856:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374484992 00000100:00100000:3.0:1788796855.153899:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788796855.153906:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000028211ce9 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3299:x1875689374484992:12345-0@lo:38: 00000100:00100000:3.0:1788796855.153992:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000028211ce9 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3299:x1875689374484992:12345-0@lo:38: Request processed in 85us (648us total) trans 0 rc -11/-11 00000100:00100000:3.0:1788796855.153999:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788796855.154132:0:3299:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788796855.154140:0:3299:0:(import.c:65:import_set_state_nolock()) 00000000bae0cc53 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788796855.154143:0:3299:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1788796855.154146:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000009c1891d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3299:1875689374484992:0@lo:38: 00000100:00100000:1.0:1788796855.156202:0:5854:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000922a04b6 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:5854:1875689374485120:0@lo:502: 00000100:00100000:1.0:1788796855.156292:0:5854:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788796855.156751:0:5854:0:(client.c:2716:ptlrpc_set_wait()) set 000000000bc2885d going to sleep for 11 seconds 00000100:00100000:3.0:1788796855.159859:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374485120 00000100:00100000:3.0:1788796855.159882:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374485120 00000100:00100000:2.0:1788796855.160095:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788796855.160107:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000008717c38e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+12:5854:x1875689374485120:12345-0@lo:502: 00000100:00100000:2.0:1788796855.160430:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000008717c38e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+12:5854:x1875689374485120:12345-0@lo:502: Request processed in 325us (4137us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796855.160438:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788796855.160824:0:5854:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000922a04b6 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:5854:1875689374485120:0@lo:502: 00000040:00080000:0.0:1788796855.160864:0:5854:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:2.0:1788796855.161188:0:5807:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:2.0:1788796855.161210:0:5807:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.138@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788796855.161228:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.138@tcp lock: 00000000301718fa/0xca7fc0c411f932bd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xca7fc0c411f932c4 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796855.161251:0:5807:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.138@tcp lock: 00000000301718fa/0xca7fc0c411f932bd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xca7fc0c411f932c4 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788796855.161313:0:5807:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788796855.161316:0:5807:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788796855.161317:0:5807:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788796855.161318:0:5807:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788796855.161319:0:5807:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788796855.161321:0:5807:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788796855.161322:0:5807:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788796855.161324:0:5807:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788796855.161331:0:5807:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788796855.161332:0:5807:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788796855.161333:0:5807:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788796855.161335:0:5807:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788796855.161339:0:5807:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:2.0:1788796855.161341:0:5807:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788796855.161343:0:5807:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788796855.161344:0:5807:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788796855.161344:0:5807:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788796855.161345:0:5807:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788796855.161346:0:5807:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788796855.161347:0:5807:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788796855.161348:0:5807:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788796855.161349:0:5807:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788796855.161350:0:5807:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788796855.161351:0:5807:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788796855.161351:0:5807:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788796855.161375:0:5807:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1788796855.161390:0:5807:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f1cb4443 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:5807:1875689374485248:0@lo:253: 00000100:00100000:2.0:1788796855.161438:0:5807:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788796855.161471:0:5807:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a75193fd going to sleep for 11 seconds 00000100:00100000:2.0:1788796855.161505:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374485248 00000100:00100000:2.0:1788796855.161511:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374485248 00000100:00100000:2.0:1788796855.161544:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788796855.161551:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000a06c3b54 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+12:5807:x1875689374485248:12345-0@lo:253: 20000000:01000000:2.0:1788796855.161588:0:5820:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1788796855.161601:0:5820:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1788796855.228627:0:5820:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788796855.228658:0:5820:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:3.0:1788796855.229348:0:5841:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788796855.229356:0:5841:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788796855.229379:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000e7cc11f5/0xca7fc0c411f932d9 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796855.229400:0:5841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000d500f348/0xca7fc0c411f932a8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xca7fc0c411f932a1 expref: 12 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796855.229408:0:5841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000e7cc11f5/0xca7fc0c411f932d9 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796855.229451:0:5841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000d500f348/0xca7fc0c411f932a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xca7fc0c411f932a1 expref: 12 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796855.229466:0:5841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000d500f348/0xca7fc0c411f932a8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xca7fc0c411f932a1 expref: 12 pid: 5819 timeout: 294 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788796855.229481:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d4897c81 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5841:1875689374485376:0@lo:104: 00000100:00100000:3.0:1788796855.229631:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796855.229708:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e421eaea going to sleep for 11 seconds 00000100:00100000:1.0:1788796855.229844:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374485376 00000100:00100000:1.0:1788796855.229854:0:5809:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374485376 00000100:00100000:1.0:1788796855.229905:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788796855.229914:0:5809:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000d438f0a0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+3:5841:x1875689374485376:12345-0@lo:104: 00010000:00010000:1.0:1788796855.229926:0:5809:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.138@tcp lock: 00000000be7b1247/0xca7fc0c411f932a1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xca7fc0c411f932a8 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796855.230164:0:5809:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788796855.230170:0:5809:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000d438f0a0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+3:5841:x1875689374485376:12345-0@lo:104: Request processed in 258us (540us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796855.230178:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:1.0:1788796855.230198:0:5815:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788796855.230203:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.138@tcp lock: 00000000be7b1247/0xca7fc0c411f932a1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xca7fc0c411f932a8 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796855.230211:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000be7b1247 already unused, calling callback (0000000041dfb12a) 10000000:00010000:1.0:1788796855.230213:0:5815:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.138@tcp lock: 00000000be7b1247/0xca7fc0c411f932a1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xca7fc0c411f932a8 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796855.230220:0:5815:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.138@tcp lock: 00000000be7b1247/0xca7fc0c411f932a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xca7fc0c411f932a8 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788796855.230227:0:5815:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.138@tcp lock: 00000000be7b1247/0xca7fc0c411f932a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xca7fc0c411f932a8 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788796855.230232:0:5815:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788796855.230266:0:5815:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.138@tcp lock: 00000000be7b1247/0xca7fc0c411f932a1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca7fc0c411f932a8 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796855.230273:0:5815:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788796855.230297:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.138@tcp lock: 00000000be7b1247/0xca7fc0c411f932a1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca7fc0c411f932a8 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796855.230304:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.138@tcp lock: 00000000be7b1247/0xca7fc0c411f932a1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca7fc0c411f932a8 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796855.230331:0:5815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788796855.230333:0:5815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788796855.230335:0:5815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788796855.230407:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d4897c81 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5841:1875689374485376:0@lo:104: 00010000:00010000:2.0:1788796855.230430:0:5841:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000e7cc11f5/0xca7fc0c411f932d9 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788796855.230584:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c3a00497 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:3301:1875689374485504:0@lo:103: 00000100:00100000:0.0:1788796855.230625:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788796855.230697:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374485504 00000100:00100000:2.0:1788796855.230710:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374485504 00010000:00010000:2.0:1788796855.230734:0:5811:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000d500f348/0xca7fc0c411f932a8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xca7fc0c411f932a1 expref: 13 pid: 5819 timeout: 294 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788796855.230758:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788796855.230765:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000008279f718 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+13:3301:x1875689374485504:12345-0@lo:103: 00010000:00010000:2.0:1788796855.230778:0:5811:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788796855.230783:0:5811:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000d500f348/0xca7fc0c411f932a8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xca7fc0c411f932a1 expref: 13 pid: 5819 timeout: 294 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796855.230793:0:5811:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000d500f348/0xca7fc0c411f932a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xca7fc0c411f932a1 expref: 13 pid: 5819 timeout: 294 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796855.230806:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000d500f348/0xca7fc0c411f932a8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xca7fc0c411f932a1 expref: 13 pid: 5819 timeout: 294 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796855.230819:0:5811:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000e7cc11f5/0xca7fc0c411f932d9 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796855.230827:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000e7cc11f5/0xca7fc0c411f932d9 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788796855.230840:0:5811:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001485111s 00010000:00010000:2.0:1788796855.230844:0:5811:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000e7cc11f5/0xca7fc0c411f932d9 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796855.230850:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000e7cc11f5/0xca7fc0c411f932d9 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796855.230857:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000e7cc11f5/0xca7fc0c411f932d9 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796855.230875:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000e7cc11f5/0xca7fc0c411f932d9 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796855.230880:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000e7cc11f5 already unused, calling callback (00000000bf1800db) 00010000:00010000:2.0:1788796855.230884:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000e7cc11f5/0xca7fc0c411f932d9 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796855.230891:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000e7cc11f5/0xca7fc0c411f932d9 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796855.230916:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000e7cc11f5/0xca7fc0c411f932d9 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796855.230926:0:5811:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788796855.231124:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000008279f718 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+12:3301:x1875689374485504:12345-0@lo:103: Request processed in 359us (498us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796855.231132:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788796855.231206:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c3a00497 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:3301:1875689374485504:0@lo:103: 00010000:00010000:0.0:1788796855.231224:0:5841:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000e7cc11f5/0xca7fc0c411f932d9 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796855.231243:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000e7cc11f5/0xca7fc0c411f932d9 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796855.231250:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000e7cc11f5/0xca7fc0c411f932d9 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788796855.240456:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000a06c3b54 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+11:5807:x1875689374485248:12345-0@lo:253: Request processed in 78897us (79010us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796855.240472:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788796855.240629:0:5807:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f1cb4443 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:5807:1875689374485248:0@lo:253: 10000000:01000000:0.0:1788796855.240654:0:5807:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1788796855.240658:0:5807:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788796855.240660:0:5807:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788796855.240661:0:5807:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788796855.240662:0:5807:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788796855.240663:0:5807:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788796855.240664:0:5807:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788796855.240666:0:5807:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788796855.240667:0:5807:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788796855.240668:0:5807:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788796855.240669:0:5807:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788796855.240671:0:5807:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788796855.240672:0:5807:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1788796855.240687:0:5807:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1788796855.246459:0:5807:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:2.0:1788796855.247121:0:5807:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1788796855.248326:0:5807:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:2.0:1788796855.248939:0:5807:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1788796855.249390:0:5807:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:2.0:1788796855.249673:0:5807:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:2.0:1788796855.250875:0:5807:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:3.0:1788796855.251396:0:5807:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:3.0:1788796855.251725:0:5807:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:3.0:1788796855.251917:0:5807:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:3.0:1788796855.252354:0:5807:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:3.0:1788796855.252611:0:5807:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 40000000:02000000:3.0:1788796855.300263:0:5807:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:3.0:1788796855.337225:0:5807:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:2.0:1788796855.337314:0:5859:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:2.0:1788796855.337326:0:5859:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:0.0:1788796855.337667:0:5860:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:3.0:1788796855.340784:0:5807:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:3.0:1788796855.341002:0:5807:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1788796855.341463:0:5807:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1788796855.341470:0:5807:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:3.0:1788796855.341616:0:5807:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788796855.343791:0:5807:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1788796855.344664:0:5807:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1788796855.344719:0:5807:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:3.0:1788796855.345024:0:5807:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:3.0:1788796855.345270:0:5807:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x11:0x0] (8/8/4) registered 00100000:10000000:3.0:1788796855.347124:0:5807:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:3.0:1788796855.347302:0:5807:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:3.0:1788796855.347694:0:5807:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:3.0:1788796855.347915:0:5807:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:3.0:1788796855.348078:0:5807:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:3.0:1788796855.348240:0:5807:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:3.0:1788796855.348358:0:5807:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:3.0:1788796855.348865:0:5807:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:3.0:1788796855.349024:0:5807:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:3.0:1788796855.349284:0:5807:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:3.0:1788796855.350484:0:5807:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:3.0:1788796855.350696:0:5807:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:3.0:1788796855.350856:0:5807:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:3.0:1788796855.351019:0:5807:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:3.0:1788796855.351212:0:5807:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:3.0:1788796855.351356:0:5807:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:3.0:1788796855.351704:0:5807:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:3.0:1788796855.351854:0:5807:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:3.0:1788796855.352061:0:5807:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:3.0:1788796855.352236:0:5807:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:3.0:1788796855.352413:0:5807:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:3.0:1788796855.352583:0:5807:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:3.0:1788796855.352813:0:5807:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:3.0:1788796855.353373:0:5807:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:3.0:1788796855.353814:0:5807:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:3.0:1788796855.353980:0:5807:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:3.0:1788796855.354186:0:5807:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:3.0:1788796855.354339:0:5807:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:3.0:1788796855.354529:0:5807:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:3.0:1788796855.354683:0:5807:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:3.0:1788796855.354860:0:5807:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:3.0:1788796855.355079:0:5807:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:3.0:1788796855.355296:0:5807:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000040:00080000:1.0:1788796855.402900:0:5860:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000001:00080000:2.0:1788796855.514764:0:5807:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1788796855.514807:0:5807:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffac66c1c47988 00100000:10000000:2.0:1788796855.514816:0:5807:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:1.0:1788796855.517133:0:5807:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1788796855.517151:0:5807:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.138@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1788796855.517163:0:5807:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=46 00000080:00000004:1.0:1788796855.517189:0:5807:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00000040:00080000:1.0:1788796855.583732:0:5860:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1788796855.583836:0:5860:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1788796855.583841:0:5860:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:1.0:1788796856.114400:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788796857.138377:0:5815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788796858.165483:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788796859.188994:0:5815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788796860.211137:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788796860.468068:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788796860.468079:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788796860.468083:0:8:0:(import.c:65:import_set_state_nolock()) 00000000bae0cc53 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788796860.468100:0:8:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000bae0cc53 using connection 192.168.204.138@tcp/0@lo 00000100:00100000:0.0:1788796860.468122:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000ac95c097 x1875689374485760/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788796860.468182:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ac95c097 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3299:1875689374485760:0@lo:38: 00000100:00100000:0.0:1788796860.468253:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788796860.468365:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374485760 00000100:00100000:0.0:1788796860.468374:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374485760 00000100:00100000:0.0:1788796860.468406:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788796860.468412:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000000e5c5003 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3299:x1875689374485760:12345-0@lo:38: 00010000:00080000:0.0:1788796860.468437:0:5827:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 149 last 0 00000020:00000080:0.0:1788796860.468475:0:5827:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xca7fc0c411f932e0 00000004:00100000:0.0:1788796860.468521:0:5827:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788796860.468665:0:5827:0:(import.c:65:import_set_state_nolock()) 000000004d0e3cd9 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788796860.468718:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000000e5c5003 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1875689374485760:12345-0@lo:38: Request processed in 304us (464us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796860.468725:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1788796860.468764:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000ac95c097 x1875689374485760/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788796870 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788796860.468779:0:3299:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1788796860.468786:0:3299:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1788796860.468791:0:3299:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788796860.468793:0:3299:0:(import.c:65:import_set_state_nolock()) 00000000bae0cc53 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788796860.468798:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ac95c097 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3299:1875689374485760:0@lo:38: 00000100:00100000:3.0:1788796860.468988:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000cfdd5685 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:3302:1875689374485632:0@lo:400: 00000100:00100000:3.0:1788796860.469025:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796860.469101:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374485632 00000100:00100000:3.0:1788796860.469105:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374485632 00000100:00100000:3.0:1788796860.469134:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788796860.469141:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000005a8a8dee pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+11:3302:x1875689374485632:12345-0@lo:400: 00000100:00100000:3.0:1788796860.469176:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000005a8a8dee pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+11:3302:x1875689374485632:12345-0@lo:400: Request processed in 37us (152us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796860.469181:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788796860.469215:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000cfdd5685 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:3302:1875689374485632:0@lo:400: 00000001:02000400:3.0:1788796861.103798:0:6103:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg438-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1788796861.246361:0:5815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788796862.260168:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788796863.284366:0:5815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788796864.050193:0:5822:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788796864.050201:0:5822:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8cb042f0b000 from 3 10000000:01000000:0.0:1788796864.050206:0:5822:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788796864.050254:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.138@tcp lock: 000000004debd26a/0xca7fc0c411f932e7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796864.050267:0:5822:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.138@tcp lock: 000000004debd26a/0xca7fc0c411f932e7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796864.050296:0:5822:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.138@tcp lock: 000000004debd26a/0xca7fc0c411f932e7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788796864.050322:0:5822:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ac95c097 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:5822:1875689374485888:0@lo:101: 00000100:00100000:0.0:1788796864.050476:0:5822:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788796864.050623:0:5822:0:(client.c:2716:ptlrpc_set_wait()) set 0000000024d8c34c going to sleep for 11 seconds 00000100:00100000:2.0:1788796864.050921:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374485888 00000100:00100000:2.0:1788796864.050929:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374485888 00000100:00100000:2.0:1788796864.050980:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788796864.050987:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000ffc953fb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+11:5822:x1875689374485888:12345-0@lo:101: 00010000:00010000:2.0:1788796864.051001:0:5820:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788796864.051013:0:5820:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000000884ac3e/0xca7fc0c411f932ee lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xca7fc0c411f932e7 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796864.051054:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000000884ac3e/0xca7fc0c411f932ee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xca7fc0c411f932e7 expref: 12 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796864.051066:0:5820:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000000884ac3e/0xca7fc0c411f932ee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xca7fc0c411f932e7 expref: 12 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796864.051075:0:5820:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000000884ac3e, rc 0) 00000100:00100000:2.0:1788796864.051118:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000ffc953fb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+12:5822:x1875689374485888:12345-0@lo:101: Request processed in 132us (643us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796864.051124:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788796864.052639:0:5822:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ac95c097 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:5822:1875689374485888:0@lo:101: 00010000:00010000:0.0:1788796864.052668:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.138@tcp lock: 000000004debd26a/0xca7fc0c411f932e7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xca7fc0c411f932ee expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796864.052680:0:5822:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.138@tcp lock: 000000004debd26a/0xca7fc0c411f932e7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xca7fc0c411f932ee expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788796864.052755:0:5822:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ac95c097 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:5822:1875689374486016:0@lo:256: 00000100:00100000:0.0:1788796864.052811:0:5822:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796864.052925:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374486016 00000100:00100000:3.0:1788796864.052933:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374486016 00000100:00100000:3.0:1788796864.052996:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788796864.053005:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000059e44864 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+12:5822:x1875689374486016:12345-0@lo:256: 20000000:01000000:3.0:1788796864.053056:0:5819:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788796864.053074:0:5819:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788796864.053078:0:5819:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:3.0:1788796864.053154:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000059e44864 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+12:5822:x1875689374486016:12345-0@lo:256: Request processed in 151us (343us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796864.053160:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788796864.058388:0:5822:0:(client.c:2716:ptlrpc_set_wait()) set 0000000024d8c34c going to sleep for 11 seconds 00000100:00100000:0.0:1788796864.058443:0:5822:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ac95c097 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:5822:1875689374486016:0@lo:256: 10000000:01000000:0.0:1788796864.058525:0:5822:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.138@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788796864.058534:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.138@tcp lock: 000000004debd26a/0xca7fc0c411f932e7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xca7fc0c411f932ee expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796864.058545:0:5822:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.138@tcp lock: 000000004debd26a/0xca7fc0c411f932e7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xca7fc0c411f932ee expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796864.306341:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788796865.332290:0:5815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788796865.587220:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000003402676c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:3303:1875689374486144:0@lo:400: 00000100:00100000:2.0:1788796865.587290:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788796865.587357:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000329854df pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3300:1875689374486272:0@lo:400: 00000100:00100000:3.0:1788796865.590140:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374486144 00000100:00100000:3.0:1788796865.590154:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374486144 00000100:00100000:3.0:1788796865.590218:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788796865.590227:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000ea3e5a2a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+12:3303:x1875689374486144:12345-0@lo:400: 00000100:00100000:3.0:1788796865.590325:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000ea3e5a2a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+12:3303:x1875689374486144:12345-0@lo:400: Request processed in 98us (3035us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796865.590345:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788796865.590397:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000003402676c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:3303:1875689374486144:0@lo:400: 00000100:00100000:2.0:1788796865.591474:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796865.592582:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374486272 00000100:00100000:3.0:1788796865.592594:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374486272 00000100:00100000:3.0:1788796865.592653:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788796865.592662:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000a61f5f64 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1875689374486272:12345-0@lo:400: 00000100:00100000:3.0:1788796865.592740:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000a61f5f64 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1875689374486272:12345-0@lo:400: Request processed in 79us (1269us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796865.592747:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1788796865.593111:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000329854df x1875689374486272/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788796881 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788796865.593126:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000329854df pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3300:1875689374486272:0@lo:400: 00010000:00010000:3.0:1788796866.355241:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788796866.720739:0:6318:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff68256410 20000000:00000080:0.0:1788796866.720763:0:6318:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8cb06ec1f000 uarg=0000000000000000 20000000:01000000:0.0:1788796866.720799:0:6318:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:0.0:1788796866.720806:0:6318:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:0.0:1788796866.720811:0:6318:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:0.0:1788796866.721502:0:6318:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:0.0:1788796866.721515:0:6318:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:1.0:1788796866.727707:0:6318:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788796866.727979:0:6318:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1788796866.728076:0:6318:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:1.0:1788796866.728130:0:6318:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:1.0:1788796866.728147:0:6318:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1788796866.728166:0:6318:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000001a4e96b1/0xca7fc0c411f932f5 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796866.728185:0:6318:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000577ee06b/0xca7fc0c411f932b6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xca7fc0c411f932af expref: 11 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796866.728193:0:6318:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000001a4e96b1/0xca7fc0c411f932f5 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796866.728242:0:6318:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000577ee06b/0xca7fc0c411f932b6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xca7fc0c411f932af expref: 11 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796866.728257:0:6318:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000577ee06b/0xca7fc0c411f932b6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xca7fc0c411f932af expref: 11 pid: 5819 timeout: 305 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788796866.728272:0:6318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d3b23699 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6318:1875689374486400:0@lo:104: 00000100:00100000:1.0:1788796866.728346:0:6318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788796866.728406:0:6318:0:(client.c:2716:ptlrpc_set_wait()) set 000000003bbb1655 going to sleep for 11 seconds 00000100:00100000:2.0:1788796866.731088:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374486400 00000100:00100000:2.0:1788796866.731105:0:5809:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374486400 00000100:00100000:2.0:1788796866.731158:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788796866.731167:0:5809:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000001577d7a7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+3:6318:x1875689374486400:12345-0@lo:104: 00010000:00010000:2.0:1788796866.731185:0:5809:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.138@tcp lock: 0000000042895792/0xca7fc0c411f932af lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xca7fc0c411f932b6 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796866.731276:0:5809:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788796866.731281:0:5809:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000001577d7a7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+3:6318:x1875689374486400:12345-0@lo:104: Request processed in 117us (2937us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796866.731288:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:2.0:1788796866.731323:0:5815:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788796866.731328:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.138@tcp lock: 0000000042895792/0xca7fc0c411f932af lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xca7fc0c411f932b6 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796866.731336:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000042895792 already unused, calling callback (0000000041dfb12a) 10000000:00010000:2.0:1788796866.731339:0:5815:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.138@tcp lock: 0000000042895792/0xca7fc0c411f932af lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xca7fc0c411f932b6 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796866.731347:0:5815:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.138@tcp lock: 0000000042895792/0xca7fc0c411f932af lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xca7fc0c411f932b6 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788796866.731353:0:5815:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.138@tcp lock: 0000000042895792/0xca7fc0c411f932af lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xca7fc0c411f932b6 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788796866.731359:0:5815:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788796866.731430:0:5815:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.138@tcp lock: 0000000042895792/0xca7fc0c411f932af lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca7fc0c411f932b6 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796866.731438:0:5815:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788796866.731461:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.138@tcp lock: 0000000042895792/0xca7fc0c411f932af lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca7fc0c411f932b6 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796866.731468:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.138@tcp lock: 0000000042895792/0xca7fc0c411f932af lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca7fc0c411f932b6 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796866.731484:0:5815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788796866.731485:0:5815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788796866.731487:0:5815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788796866.731500:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000329854df pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:3301:1875689374486528:0@lo:103: 00000100:00100000:2.0:1788796866.731537:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796866.731651:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374486528 00000100:00100000:3.0:1788796866.731658:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374486528 00010000:00010000:3.0:1788796866.731682:0:5811:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000577ee06b/0xca7fc0c411f932b6 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xca7fc0c411f932af expref: 12 pid: 5819 timeout: 305 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788796866.731713:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788796866.731719:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000005daf556f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+12:3301:x1875689374486528:12345-0@lo:103: 00010000:00010000:3.0:1788796866.731741:0:5811:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788796866.731746:0:5811:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000577ee06b/0xca7fc0c411f932b6 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xca7fc0c411f932af expref: 12 pid: 5819 timeout: 305 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796866.731756:0:5811:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000577ee06b/0xca7fc0c411f932b6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xca7fc0c411f932af expref: 12 pid: 5819 timeout: 305 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796866.731773:0:5811:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000001a4e96b1/0xca7fc0c411f932f5 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796866.731780:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000001a4e96b1/0xca7fc0c411f932f5 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796866.731802:0:5811:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000001a4e96b1/0xca7fc0c411f932f5 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796866.731808:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000001a4e96b1/0xca7fc0c411f932f5 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796866.731814:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000001a4e96b1/0xca7fc0c411f932f5 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796866.731819:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000001a4e96b1/0xca7fc0c411f932f5 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796866.731824:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000001a4e96b1 already unused, calling callback (00000000bf1800db) 00010000:00010000:3.0:1788796866.731826:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000001a4e96b1/0xca7fc0c411f932f5 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796866.731833:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000001a4e96b1/0xca7fc0c411f932f5 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796866.731841:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000001a4e96b1/0xca7fc0c411f932f5 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796866.731851:0:5811:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788796866.731883:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000005daf556f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+12:3301:x1875689374486528:12345-0@lo:103: Request processed in 164us (346us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796866.731889:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:1.0:1788796866.732984:0:6318:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000577ee06b/0xca7fc0c411f932b6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xca7fc0c411f932af expref: 11 pid: 5819 timeout: 305 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788796866.733000:0:6318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d3b23699 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6318:1875689374486400:0@lo:104: 00010000:00010000:1.0:1788796866.733020:0:6318:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000001a4e96b1/0xca7fc0c411f932f5 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788796866.733057:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000329854df pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:3301:1875689374486528:0@lo:103: 00010000:00010000:1.0:1788796866.733164:0:6318:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000001a4e96b1/0xca7fc0c411f932f5 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796866.733172:0:6318:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000001a4e96b1/0xca7fc0c411f932f5 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796866.733177:0:6318:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000001a4e96b1/0xca7fc0c411f932f5 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796867.378916:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788796868.402757:0:5815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788796869.427954:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788796870.451659:0:5815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788796870.711239:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000329854df pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:3302:1875689374486656:0@lo:400: 00000100:00100000:3.0:1788796870.711323:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796870.711402:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788796870.711409:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000081be80a8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875689374486784:0@lo:400: 00000100:00100000:3.0:1788796870.711441:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796870.711482:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374486784 00000100:00100000:3.0:1788796870.711489:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374486784 00000100:00100000:3.0:1788796870.711533:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788796870.711542:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000dd672ace pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875689374486784:12345-0@lo:400: 00000100:00100000:3.0:1788796870.711591:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000dd672ace pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875689374486784:12345-0@lo:400: Request processed in 52us (150us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796870.711597:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788796870.711631:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000081be80a8 x1875689374486784/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788796886 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788796870.711655:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000081be80a8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875689374486784:0@lo:400: 00000100:00100000:2.0:1788796870.711983:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374486656 00000100:00100000:2.0:1788796870.711988:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374486656 00000100:00100000:2.0:1788796870.712022:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788796870.712051:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000004b7e3548 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+11:3302:x1875689374486656:12345-0@lo:400: 00000100:00100000:2.0:1788796870.712096:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000004b7e3548 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+11:3302:x1875689374486656:12345-0@lo:400: Request processed in 69us (774us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796870.712102:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788796870.712287:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000329854df pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:3302:1875689374486656:0@lo:400: 00010000:00010000:1.0:1788796871.476842:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788796872.499024:0:5815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788796873.487011:0:6679:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788796873.487015:0:6679:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:2.0:1788796873.487209:0:6679:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 00000000faeb625f 00000020:01000004:2.0:1788796873.487225:0:6679:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:2.0:1788796873.487237:0:6679:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1788796873.487250:0:6679:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (00000000f8752257) 00000020:00000080:2.0:1788796873.487273:0:6679:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-zfs with refcount 2 00010000:00010000:1.0:1788796873.523326:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:3.0:1788796873.535381:0:6679:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:3.0:1788796873.535693:0:6679:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:1.0:1788796873.595593:0:6679:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:1.0:1788796873.601813:0:6679:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:1.0:1788796873.601848:0:6679:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:1.0:1788796873.602484:0:6679:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:1.0:1788796873.602514:0:6679:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:1.0:1788796873.602911:0:6679:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:1.0:1788796873.602932:0:6679:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:1.0:1788796873.602942:0:6679:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xca7fc0c411f93303 00000020:01000004:1.0:1788796873.602949:0:6679:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:1.0:1788796873.602968:0:6679:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.138@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1788796873.602972:0:6679:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.138@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1788796873.602982:0:6679:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0000 00000020:01000004:1.0:1788796873.602989:0:6679:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:1.0:1788796873.603000:0:6679:0:(genops.c:413:class_newdev()) Allocate new device OSS (00000000509e403e) 00000020:00000080:1.0:1788796873.603010:0:6679:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type ost with refcount 2 00000100:00100000:1.0:1788796873.605129:0:6679:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788796873.605562:0:6679:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:1.0:1788796873.605570:0:6679:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:2.0:1788796873.613435:0:6679:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:3.0:1788796873.613762:0:6679:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:0.0:1788796873.614487:0:6679:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:0.0:1788796873.614496:0:6679:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:1.0:1788796873.615921:0:6679:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788796873.616546:0:6679:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:1.0:1788796873.616554:0:6679:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:1.0:1788796873.617259:0:6679:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:1.0:1788796873.617267:0:6679:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:0.0:1788796873.635610:0:6679:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788796873.635853:0:6679:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1788796873.635860:0:6679:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:0.0:1788796873.637543:0:6679:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1788796873.637557:0:6679:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:0.0:1788796873.638328:0:6679:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1788796873.638336:0:6679:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:0.0:1788796873.641405:0:6679:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788796873.641596:0:6679:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:0.0:1788796873.641603:0:6679:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:0.0:1788796873.642654:0:6679:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:0.0:1788796873.642664:0:6679:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:0.0:1788796873.677368:0:6679:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788796873.677573:0:6679:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:0.0:1788796873.677579:0:6679:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:0.0:1788796873.678557:0:6679:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:0.0:1788796873.678567:0:6679:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:0.0:1788796873.678944:0:6679:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:0.0:1788796873.678970:0:6679:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:0.0:1788796873.678976:0:6679:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.138@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:0.0:1788796873.694633:0:6679:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.138@tcp ctxt 0 is initialized 00000020:01000004:0.0:1788796873.694673:0:6679:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.204.138@tcp, index=0000, flags=0x20062 00000020:01000004:0.0:1788796873.694677:0:6679:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1788796873.694678:0:6679:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788796873.694680:0:6679:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788796873.694681:0:6679:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788796873.694682:0:6679:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788796873.694684:0:6679:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788796873.694685:0:6679:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788796873.694687:0:6679:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788796873.694688:0:6679:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788796873.694689:0:6679:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788796873.694691:0:6679:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788796873.694694:0:6679:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:0.0:1788796873.694696:0:6679:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788796873.694697:0:6679:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788796873.694698:0:6679:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788796873.694699:0:6679:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788796873.694700:0:6679:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788796873.694701:0:6679:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788796873.694702:0:6679:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788796873.694703:0:6679:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788796873.694704:0:6679:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788796873.694705:0:6679:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788796873.694706:0:6679:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788796873.694732:0:6679:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1788796873.694749:0:6679:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ac95c097 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:6679:1875689374486912:0@lo:253: 00000100:00100000:0.0:1788796873.694826:0:6679:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796873.694986:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374486912 00000100:00100000:3.0:1788796873.694994:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374486912 00000100:00100000:3.0:1788796873.695059:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788796873.695067:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000000df84c18 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+11:6679:x1875689374486912:12345-0@lo:253: 20000000:01000000:3.0:1788796873.695094:0:5819:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1788796873.695098:0:5819:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:3.0:1788796873.695103:0:5819:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:3.0:1788796873.695106:0:5819:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:3.0:1788796873.695798:0:5819:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788796873.696004:0:5819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:3.0:1788796873.696018:0:5819:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:3.0:1788796873.696081:0:5819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 128 off8544 20000000:01000000:3.0:1788796873.696089:0:5819:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:3.0:1788796873.696140:0:5819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 112 off8656 00000040:00080000:3.0:1788796873.696211:0:5819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8880 00000040:00080000:3.0:1788796873.696529:0:5819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:3.0:1788796873.696549:0:5819:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.204.138@tcp 20000000:01000000:3.0:1788796873.696552:0:5819:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.138@tcp (null) (null) (null) 00000040:00080000:3.0:1788796873.696587:0:5819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:3.0:1788796873.696595:0:5819:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1788796873.696642:0:5819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:3.0:1788796873.696650:0:5819:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.204.138@tcp (null) (null) 00000040:00080000:3.0:1788796873.696680:0:5819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:3.0:1788796873.696688:0:5819:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:3.0:1788796873.696715:0:5819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:3.0:1788796873.696764:0:5819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 00000040:00080000:3.0:1788796873.697373:0:5819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:3.0:1788796873.697390:0:5819:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.204.138@tcp 20000000:01000000:3.0:1788796873.697391:0:5819:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.138@tcp (null) (null) (null) 00000040:00080000:3.0:1788796873.697426:0:5819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:3.0:1788796873.697433:0:5819:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:3.0:1788796873.697464:0:5819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:3.0:1788796873.697471:0:5819:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.204.138@tcp (null) (null) 00000040:00080000:3.0:1788796873.697518:0:5819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:3.0:1788796873.697527:0:5819:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:3.0:1788796873.697559:0:5819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 128 off12440 00000040:00080000:3.0:1788796873.697595:0:5819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12664 20000000:01000000:3.0:1788796873.697610:0:5819:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'autodegrade=on' 20000000:01000000:3.0:1788796873.697613:0:5819:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 20000000:01000000:3.0:1788796873.697619:0:5819:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:3.0:1788796873.697620:0:5819:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1788796873.697623:0:5819:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1788796873.697634:0:5819:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1788796873.697636:0:5819:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:3.0:1788796873.697666:0:5819:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1788796873.697674:0:5819:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000100:00100000:0.0:1788796873.698582:0:6679:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e2755bd5 going to sleep for 11 seconds 20000000:01000000:0.0:1788796873.698898:0:6694:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 10 marker 8 1->4: lustre sys.timeout 20000000:01000000:0.0:1788796873.698963:0:6694:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 12 marker 8 2->4: lustre sys.timeout 00000040:00080000:0.0:1788796873.699023:0:6694:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:3.0:1788796873.699792:0:5819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:3.0:1788796873.699830:0:5819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:3.0:1788796873.699909:0:5819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:3.0:1788796873.699924:0:5819:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1788796873.699927:0:5819:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:0.0:1788796873.700467:0:6695:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 9 1->4: lustre sys.timeout 20000000:01000000:0.0:1788796873.700515:0:6695:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 9 2->4: lustre sys.timeout 00000040:00080000:0.0:1788796873.700563:0:6695:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:3.0:1788796873.700839:0:5819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12888 00000040:00080000:3.0:1788796873.700865:0:5819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off12968 00000040:00080000:3.0:1788796873.700882:0:5819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13192 20000000:01000000:3.0:1788796873.700890:0:5819:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1788796873.700891:0:5819:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:3.0:1788796873.701299:0:6696:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 5 count 5 00000040:00080000:0.0:1788796873.701507:0:5819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9104 00000040:00080000:0.0:1788796873.701547:0:5819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 80 off9184 00000040:00080000:0.0:1788796873.701687:0:5819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9408 10000000:01000000:0.0:1788796873.701708:0:5819:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1788796873.701727:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000000153eebb/0xca7fc0c411f93311 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796873.701756:0:5819:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000039ca93bf/0xca7fc0c411f93238 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xca7fc0c411f93231 expref: 11 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796873.701763:0:5819:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000097094ba6/0xca7fc0c411f93254 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xca7fc0c411f9324d expref: 11 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796873.701767:0:5819:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000ae867b02/0xca7fc0c411f932c4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xca7fc0c411f932bd expref: 11 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796873.701773:0:5819:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000000153eebb/0xca7fc0c411f93311 lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796873.701808:0:5819:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000ae867b02/0xca7fc0c411f932c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xca7fc0c411f932bd expref: 11 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796873.701821:0:5819:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000ae867b02/0xca7fc0c411f932c4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xca7fc0c411f932bd expref: 11 pid: 5820 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788796873.701833:0:5819:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002dcd12de pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5819:1875689374487040:0@lo:104: 00000100:00100000:0.0:1788796873.701907:0:5819:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788796873.701974:0:5819:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000097094ba6/0xca7fc0c411f93254 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xca7fc0c411f9324d expref: 11 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796873.701981:0:5819:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000097094ba6/0xca7fc0c411f93254 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xca7fc0c411f9324d expref: 11 pid: 5819 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788796873.701989:0:5819:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a92a57fe pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5819:1875689374487168:0@lo:104: 00000100:00100000:3.0:1788796873.702000:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374487040 00000100:00100000:3.0:1788796873.702007:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374487040 00000100:00100000:0.0:1788796873.702017:0:5819:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796873.702065:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374487168 00000100:00100000:3.0:1788796873.702068:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374487168 00010000:00010000:0.0:1788796873.702070:0:5819:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000039ca93bf/0xca7fc0c411f93238 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xca7fc0c411f93231 expref: 11 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796873.702078:0:5819:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000039ca93bf/0xca7fc0c411f93238 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xca7fc0c411f93231 expref: 11 pid: 5818 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788796873.702082:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788796873.702085:0:5819:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000583eebf9 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5819:1875689374487296:0@lo:104: 00000100:00100000:3.0:1788796873.702090:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000000188c49d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+4:5819:x1875689374487040:12345-0@lo:104: 00010000:00010000:3.0:1788796873.702102:0:5810:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.138@tcp lock: 00000000301718fa/0xca7fc0c411f932bd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xca7fc0c411f932c4 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788796873.702271:0:5819:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788796873.702345:0:5810:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788796873.702349:0:5819:0:(client.c:2716:ptlrpc_set_wait()) set 000000000d1c8cce going to sleep for 11 seconds 00000100:00100000:3.0:1788796873.702350:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000000188c49d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+4:5819:x1875689374487040:12345-0@lo:104: Request processed in 262us (445us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796873.702357:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788796873.702368:0:5819:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002dcd12de pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5819:1875689374487040:0@lo:104: 00000100:00100000:3.0:1788796873.702371:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374487296 00000100:00100000:3.0:1788796873.702374:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374487296 00000100:00100000:3.0:1788796873.702405:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788796873.702410:0:5809:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:3.0:1788796873.702411:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000006ae33886 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+4:5819:x1875689374487168:12345-0@lo:104: 00000100:00100000:2.0:1788796873.702417:0:5809:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_002' 00010000:00010000:3.0:1788796873.702418:0:5810:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.138@tcp lock: 00000000d928ec69/0xca7fc0c411f9324d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xca7fc0c411f93254 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796873.702492:0:5815:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788796873.702497:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.138@tcp lock: 00000000301718fa/0xca7fc0c411f932bd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xca7fc0c411f932c4 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796873.702504:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000301718fa already unused, calling callback (0000000041dfb12a) 10000000:00010000:1.0:1788796873.702507:0:5815:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.138@tcp lock: 00000000301718fa/0xca7fc0c411f932bd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xca7fc0c411f932c4 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796873.702525:0:5815:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.138@tcp lock: 00000000301718fa/0xca7fc0c411f932bd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xca7fc0c411f932c4 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788796873.702531:0:5815:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.138@tcp lock: 00000000301718fa/0xca7fc0c411f932bd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xca7fc0c411f932c4 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788796873.702537:0:5815:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788796873.702570:0:5815:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.138@tcp lock: 00000000301718fa/0xca7fc0c411f932bd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca7fc0c411f932c4 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796873.702577:0:5815:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788796873.702595:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.138@tcp lock: 00000000301718fa/0xca7fc0c411f932bd lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca7fc0c411f932c4 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796873.702602:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.138@tcp lock: 00000000301718fa/0xca7fc0c411f932bd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca7fc0c411f932c4 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796873.702615:0:5815:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788796873.702617:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.138@tcp lock: 00000000d928ec69/0xca7fc0c411f9324d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xca7fc0c411f93254 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796873.702622:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000d928ec69 already unused, calling callback (0000000041dfb12a) 10000000:00010000:1.0:1788796873.702624:0:5815:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.138@tcp lock: 00000000d928ec69/0xca7fc0c411f9324d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xca7fc0c411f93254 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796873.702630:0:5815:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.138@tcp lock: 00000000d928ec69/0xca7fc0c411f9324d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xca7fc0c411f93254 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788796873.702635:0:5815:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.138@tcp lock: 00000000d928ec69/0xca7fc0c411f9324d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xca7fc0c411f93254 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788796873.702645:0:5815:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788796873.702657:0:5815:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.138@tcp lock: 00000000d928ec69/0xca7fc0c411f9324d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca7fc0c411f93254 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796873.702662:0:5815:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788796873.702667:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.138@tcp lock: 00000000d928ec69/0xca7fc0c411f9324d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca7fc0c411f93254 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796873.702672:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.138@tcp lock: 00000000d928ec69/0xca7fc0c411f9324d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca7fc0c411f93254 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796873.702679:0:5815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788796873.702681:0:5815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788796873.702683:0:5815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788796873.702693:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d3b23699 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:3300:1875689374487424:0@lo:103: 00000100:00100000:1.0:1788796873.702723:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:01000000:2.0:1788796873.702726:0:5822:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788796873.702729:0:5822:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8cb042f0b000 from 21 10000000:01000000:2.0:1788796873.702732:0:5822:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788796873.702751:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.138@tcp lock: 00000000d1026186/0xca7fc0c411f93318 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796873.702758:0:5822:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.138@tcp lock: 00000000d1026186/0xca7fc0c411f93318 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788796873.702758:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788796873.702763:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007ef2cfda pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:3300:1875689374487552:0@lo:103: 00010000:00010000:2.0:1788796873.702765:0:5822:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.138@tcp lock: 00000000d1026186/0xca7fc0c411f93318 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788796873.702776:0:5822:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007e07c108 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:5822:1875689374487680:0@lo:101: 00000100:00100000:1.0:1788796873.702782:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788796873.702801:0:5822:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788796873.702813:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374487424 00000100:00100000:1.0:1788796873.702817:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374487424 00000100:00100000:2.0:1788796873.702818:0:5822:0:(client.c:2716:ptlrpc_set_wait()) set 000000007a7c396f going to sleep for 11 seconds 00010000:00010000:1.0:1788796873.702834:0:5813:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000ae867b02/0xca7fc0c411f932c4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xca7fc0c411f932bd expref: 12 pid: 5820 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788796873.702861:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374487552 00000100:00100000:1.0:1788796873.702864:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374487552 00000100:00100000:0.0:1788796873.702872:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00010000:00010000:1.0:1788796873.702873:0:5813:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000097094ba6/0xca7fc0c411f93254 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xca7fc0c411f9324d expref: 13 pid: 5819 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788796873.702880:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000002ba5601 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+13:3300:x1875689374487424:12345-0@lo:103: 00010000:00010000:0.0:1788796873.702889:0:5811:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788796873.702893:0:5811:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000ae867b02/0xca7fc0c411f932c4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xca7fc0c411f932bd expref: 13 pid: 5820 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796873.702902:0:5811:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000ae867b02/0xca7fc0c411f932c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xca7fc0c411f932bd expref: 13 pid: 5820 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788796873.702906:0:5813:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:1.0:1788796873.702911:0:5813:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00010000:00010000:0.0:1788796873.702914:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000ae867b02/0xca7fc0c411f932c4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xca7fc0c411f932bd expref: 13 pid: 5820 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796873.702925:0:5811:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788796873.702952:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000002ba5601 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+12:3300:x1875689374487424:12345-0@lo:103: Request processed in 74us (229us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796873.702959:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788796873.702973:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788796873.702978:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000050e157c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+11:3300:x1875689374487552:12345-0@lo:103: 00010000:00010000:0.0:1788796873.702989:0:5811:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1788796873.702992:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00010000:00010000:0.0:1788796873.702993:0:5811:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000097094ba6/0xca7fc0c411f93254 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xca7fc0c411f9324d expref: 11 pid: 5819 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788796873.702997:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000003adc87d8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+4:5819:x1875689374487296:12345-0@lo:104: 00010000:00010000:0.0:1788796873.703001:0:5811:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000097094ba6/0xca7fc0c411f93254 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xca7fc0c411f9324d expref: 11 pid: 5819 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796873.703003:0:6697:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.138@tcp lock: 0000000021ce8fa1/0xca7fc0c411f93231 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xca7fc0c411f93238 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796873.703010:0:5811:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788796873.703053:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000050e157c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+11:3300:x1875689374487552:12345-0@lo:103: Request processed in 75us (269us total) trans 0 rc 0/0 00010000:00010000:1.0:1788796873.703058:0:6697:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788796873.703060:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788796873.703061:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000003adc87d8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+4:5819:x1875689374487296:12345-0@lo:104: Request processed in 66us (792us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796873.703066:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:1.0:1788796873.703076:0:5814:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788796873.703079:0:5814:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.138@tcp lock: 0000000021ce8fa1/0xca7fc0c411f93231 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xca7fc0c411f93238 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788796873.703083:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007ef2cfda pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:3300:1875689374487552:0@lo:103: 00010000:00010000:1.0:1788796873.703086:0:5814:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000021ce8fa1 already unused, calling callback (0000000041dfb12a) 10000000:00010000:1.0:1788796873.703088:0:5814:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.138@tcp lock: 0000000021ce8fa1/0xca7fc0c411f93231 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xca7fc0c411f93238 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788796873.703089:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d3b23699 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:3300:1875689374487424:0@lo:103: 00010000:00010000:1.0:1788796873.703094:0:5814:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.138@tcp lock: 0000000021ce8fa1/0xca7fc0c411f93231 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xca7fc0c411f93238 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788796873.703099:0:5814:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.138@tcp lock: 0000000021ce8fa1/0xca7fc0c411f93231 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xca7fc0c411f93238 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788796873.703104:0:5814:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788796873.703117:0:5814:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.138@tcp lock: 0000000021ce8fa1/0xca7fc0c411f93231 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca7fc0c411f93238 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796873.703133:0:5814:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788796873.703148:0:5814:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.138@tcp lock: 0000000021ce8fa1/0xca7fc0c411f93231 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca7fc0c411f93238 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796873.703153:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.138@tcp lock: 0000000021ce8fa1/0xca7fc0c411f93231 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca7fc0c411f93238 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796873.703162:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788796873.703163:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788796873.703165:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788796873.703237:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000009d67a86 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:3302:1875689374487808:0@lo:103: 00000100:00100000:0.0:1788796873.703263:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788796873.703340:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374487808 00000100:00100000:1.0:1788796873.703346:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374487808 00010000:00010000:1.0:1788796873.703359:0:5811:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000039ca93bf/0xca7fc0c411f93238 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xca7fc0c411f93231 expref: 11 pid: 5818 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788796873.703387:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788796873.703393:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000001b39c166 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+11:3302:x1875689374487808:12345-0@lo:103: 00010000:00010000:1.0:1788796873.703401:0:5811:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788796873.703404:0:5811:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000039ca93bf/0xca7fc0c411f93238 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xca7fc0c411f93231 expref: 11 pid: 5818 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796873.703411:0:5811:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000039ca93bf/0xca7fc0c411f93238 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xca7fc0c411f93231 expref: 11 pid: 5818 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796873.703421:0:5811:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000000153eebb/0xca7fc0c411f93311 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796873.703428:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000000153eebb/0xca7fc0c411f93311 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796873.703450:0:5811:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000000153eebb/0xca7fc0c411f93311 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796873.703456:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000000153eebb/0xca7fc0c411f93311 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796873.703461:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000000153eebb/0xca7fc0c411f93311 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796873.703467:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000000153eebb/0xca7fc0c411f93311 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796873.703472:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000000153eebb already unused, calling callback (00000000bf1800db) 00010000:00010000:1.0:1788796873.703475:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000000153eebb/0xca7fc0c411f93311 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796873.703481:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000000153eebb/0xca7fc0c411f93311 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796873.703488:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000000153eebb/0xca7fc0c411f93311 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796873.703496:0:5811:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788796873.703535:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000001b39c166 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+11:3302:x1875689374487808:12345-0@lo:103: Request processed in 142us (271us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796873.703541:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:3.0:1788796873.703556:0:5810:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:3.0:1788796873.703562:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000006ae33886 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+3:5819:x1875689374487168:12345-0@lo:104: Request processed in 1151us (1544us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796873.703568:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788796873.703592:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374487680 00000100:00100000:3.0:1788796873.703596:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374487680 00000100:00100000:0.0:1788796873.703597:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000009d67a86 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:3302:1875689374487808:0@lo:103: 00000100:00100000:3.0:1788796873.703627:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788796873.703633:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000f3ee6f6c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+11:5822:x1875689374487680:12345-0@lo:101: 00010000:00010000:3.0:1788796873.703643:0:5818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788796873.703658:0:5818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000848a423f/0xca7fc0c411f9331f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xca7fc0c411f93318 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796873.703674:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000848a423f/0xca7fc0c411f9331f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xca7fc0c411f93318 expref: 12 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796873.703684:0:5818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000848a423f/0xca7fc0c411f9331f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xca7fc0c411f93318 expref: 12 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796873.703690:0:5818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000848a423f, rc 0) 00000100:00100000:3.0:1788796873.703719:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000f3ee6f6c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+12:5822:x1875689374487680:12345-0@lo:101: Request processed in 87us (918us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796873.703725:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788796873.703726:0:5822:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007e07c108 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:5822:1875689374487680:0@lo:101: 00010000:00010000:2.0:1788796873.703738:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.138@tcp lock: 00000000d1026186/0xca7fc0c411f93318 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xca7fc0c411f9331f expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796873.703746:0:5815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788796873.703757:0:5822:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.138@tcp lock: 00000000d1026186/0xca7fc0c411f93318 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xca7fc0c411f9331f expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796873.703762:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000097094ba6/0xca7fc0c411f93254 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xca7fc0c411f9324d expref: 11 pid: 5819 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788796873.703771:0:5819:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a92a57fe pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5819:1875689374487168:0@lo:104: 00010000:00010000:3.0:1788796873.703779:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000039ca93bf/0xca7fc0c411f93238 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xca7fc0c411f93231 expref: 10 pid: 5818 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788796873.703793:0:5819:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000583eebf9 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5819:1875689374487296:0@lo:104: 00000100:00100000:2.0:1788796873.703799:0:5822:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007e07c108 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:5822:1875689374487936:0@lo:501: 00010000:00010000:3.0:1788796873.703809:0:5819:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000000153eebb/0xca7fc0c411f93311 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796873.703816:0:5819:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000000153eebb/0xca7fc0c411f93311 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796873.703822:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000000153eebb/0xca7fc0c411f93311 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788796873.703823:0:5822:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788796873.703827:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000000153eebb/0xca7fc0c411f93311 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788796873.703836:0:5819:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:2.0:1788796873.703846:0:5822:0:(client.c:2716:ptlrpc_set_wait()) set 000000007a7c396f going to sleep for 11 seconds 00000100:00100000:2.0:1788796873.704086:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374487936 00000100:00100000:2.0:1788796873.704105:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374487936 00000100:00100000:2.0:1788796873.704134:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788796873.704139:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000bca5eabe pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+10:5822:x1875689374487936:12345-0@lo:501: 00000100:00100000:2.0:1788796873.704243:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000bca5eabe pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+10:5822:x1875689374487936:12345-0@lo:501: Request processed in 104us (419us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796873.704250:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788796873.704289:0:5822:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007e07c108 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:5822:1875689374487936:0@lo:501: 00000100:00100000:2.0:1788796873.704314:0:5822:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007e07c108 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:5822:1875689374488064:0@lo:503: 00000100:00100000:2.0:1788796873.704350:0:5822:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788796873.704371:0:5822:0:(client.c:2716:ptlrpc_set_wait()) set 000000007a7c396f going to sleep for 11 seconds 00000100:00100000:2.0:1788796873.704382:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374488064 00000100:00100000:2.0:1788796873.704386:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374488064 00000100:00100000:2.0:1788796873.704400:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788796873.704404:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000464cb5d8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+10:5822:x1875689374488064:12345-0@lo:503: 00000100:00100000:2.0:1788796873.704534:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000464cb5d8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+10:5822:x1875689374488064:12345-0@lo:503: Request processed in 129us (183us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796873.704541:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788796873.704577:0:5822:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007e07c108 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:5822:1875689374488064:0@lo:503: 00000100:00100000:0.0:1788796873.705553:0:6699:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008b313874 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:6699:1875689374488192:0@lo:502: 00000100:00100000:0.0:1788796873.705674:0:6699:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788796873.705703:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374488192 00000100:00100000:0.0:1788796873.705709:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374488192 00000100:00100000:0.0:1788796873.705739:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788796873.705746:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000016d4f4ca pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+10:6699:x1875689374488192:12345-0@lo:502: 00000100:00100000:0.0:1788796873.705915:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000016d4f4ca pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+10:6699:x1875689374488192:12345-0@lo:502: Request processed in 169us (241us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796873.705923:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788796873.705964:0:6699:0:(client.c:2716:ptlrpc_set_wait()) set 000000003d81b92c going to sleep for 11 seconds 00000100:00100000:0.0:1788796873.705985:0:6699:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008b313874 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:6699:1875689374488192:0@lo:502: 00000100:00100000:0.0:1788796873.706056:0:6699:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008b313874 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:6699:1875689374488320:0@lo:502: 00000100:00100000:0.0:1788796873.706087:0:6699:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788796873.706105:0:6699:0:(client.c:2716:ptlrpc_set_wait()) set 000000003d81b92c going to sleep for 11 seconds 00000100:00100000:3.0:1788796873.706512:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374488320 00000100:00100000:3.0:1788796873.706519:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374488320 00000100:00100000:3.0:1788796873.706547:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788796873.706552:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000d00cbf38 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+10:6699:x1875689374488320:12345-0@lo:502: 00000100:00100000:3.0:1788796873.706696:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000d00cbf38 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+10:6699:x1875689374488320:12345-0@lo:502: Request processed in 143us (608us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796873.706703:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788796873.707741:0:6699:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008b313874 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:6699:1875689374488320:0@lo:502: 00000040:00080000:0.0:1788796873.707774:0:6699:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:0.0:1788796873.707841:0:5822:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:0.0:1788796873.707856:0:5822:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.138@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788796873.707863:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.138@tcp lock: 00000000d1026186/0xca7fc0c411f93318 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xca7fc0c411f9331f expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796873.707873:0:5822:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.138@tcp lock: 00000000d1026186/0xca7fc0c411f93318 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xca7fc0c411f9331f expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788796873.707882:0:5822:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1788796873.707885:0:5822:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:0.0:1788796873.707888:0:5822:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1788796873.707915:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.138@tcp lock: 0000000005b6d83b/0xca7fc0c411f93326 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796873.707922:0:5822:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.138@tcp lock: 0000000005b6d83b/0xca7fc0c411f93326 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796873.707930:0:5822:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.138@tcp lock: 0000000005b6d83b/0xca7fc0c411f93326 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788796873.707946:0:5822:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008b313874 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:5822:1875689374488448:0@lo:101: 00000100:00100000:0.0:1788796873.707988:0:5822:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788796873.708058:0:5822:0:(client.c:2716:ptlrpc_set_wait()) set 000000003d81b92c going to sleep for 11 seconds 00000100:00100000:3.0:1788796873.708508:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374488448 00000100:00100000:3.0:1788796873.708515:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374488448 00000100:00100000:3.0:1788796873.708557:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788796873.708566:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000958cbdf5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+10:5822:x1875689374488448:12345-0@lo:101: 00010000:00010000:3.0:1788796873.708577:0:5818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788796873.708588:0:5818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000fff90cbe/0xca7fc0c411f9332d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xca7fc0c411f93326 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796873.708621:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000fff90cbe/0xca7fc0c411f9332d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xca7fc0c411f93326 expref: 11 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796873.708631:0:5818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000fff90cbe/0xca7fc0c411f9332d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xca7fc0c411f93326 expref: 11 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796873.708639:0:5818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000fff90cbe, rc 0) 00000100:00100000:3.0:1788796873.708678:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000958cbdf5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+11:5822:x1875689374488448:12345-0@lo:101: Request processed in 113us (690us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796873.708684:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788796873.708783:0:5822:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008b313874 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:5822:1875689374488448:0@lo:101: 00010000:00010000:0.0:1788796873.708795:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.138@tcp lock: 0000000005b6d83b/0xca7fc0c411f93326 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xca7fc0c411f9332d expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796873.708803:0:5822:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.138@tcp lock: 0000000005b6d83b/0xca7fc0c411f93326 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xca7fc0c411f9332d expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788796873.708847:0:5822:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008b313874 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:5822:1875689374488576:0@lo:501: 00000100:00100000:0.0:1788796873.708873:0:5822:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788796873.708892:0:5822:0:(client.c:2716:ptlrpc_set_wait()) set 000000003d81b92c going to sleep for 11 seconds 00000100:00100000:0.0:1788796873.708905:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374488576 00000100:00100000:0.0:1788796873.708909:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374488576 00000100:00100000:0.0:1788796873.708968:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788796873.708975:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000090bb27ad pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+11:5822:x1875689374488576:12345-0@lo:501: 00000100:00100000:0.0:1788796873.709312:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000090bb27ad pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+11:5822:x1875689374488576:12345-0@lo:501: Request processed in 338us (438us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796873.709320:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788796873.709371:0:5822:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008b313874 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:5822:1875689374488576:0@lo:501: 00000100:00100000:1.0:1788796873.709399:0:5822:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000085b0ed41 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:5822:1875689374488704:0@lo:503: 00000100:00100000:1.0:1788796873.709440:0:5822:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788796873.709468:0:5822:0:(client.c:2716:ptlrpc_set_wait()) set 0000000012cd51a8 going to sleep for 11 seconds 00000100:00100000:1.0:1788796873.709481:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374488704 00000100:00100000:1.0:1788796873.709485:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374488704 00000100:00100000:1.0:1788796873.709503:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788796873.709509:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000ec6500cf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+11:5822:x1875689374488704:12345-0@lo:503: 00000100:00100000:1.0:1788796873.709641:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000ec6500cf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+11:5822:x1875689374488704:12345-0@lo:503: Request processed in 132us (201us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796873.709648:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788796873.709680:0:5822:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000085b0ed41 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:5822:1875689374488704:0@lo:503: 00000100:00100000:0.0:1788796873.711935:0:6700:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000025d8526f pname:cluuid:pid:xid:nid:opc:job llog_process_th:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:6700:1875689374488832:0@lo:502: 00000100:00100000:0.0:1788796873.712004:0:6700:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788796873.712061:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374488832 00000100:00100000:0.0:1788796873.712068:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374488832 00000100:00100000:0.0:1788796873.712109:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788796873.712118:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000dbd1d643 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+11:6700:x1875689374488832:12345-0@lo:502: 00000100:00100000:0.0:1788796873.712330:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000dbd1d643 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+11:6700:x1875689374488832:12345-0@lo:502: Request processed in 213us (326us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796873.712338:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788796873.712399:0:6700:0:(client.c:2716:ptlrpc_set_wait()) set 00000000f0e6af20 going to sleep for 11 seconds 00000100:00100000:0.0:1788796873.712419:0:6700:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000025d8526f pname:cluuid:pid:xid:nid:opc:job llog_process_th:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:6700:1875689374488832:0@lo:502: 00000020:01000000:0.0:1788796873.712447:0:6700:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788796873.712454:0:6700:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:0.0:1788796873.712460:0:6700:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788796873.712463:0:6700:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1788796873.712467:0:6700:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1788796873.712470:0:6700:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.138@tcp to nid 0x20000c0a8cc8a (192.168.204.138@tcp) 00000020:01000000:0.0:1788796873.712493:0:6700:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1788796873.712496:0:6700:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788796873.712510:0:6700:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (0000000067d4b9a9) 00000020:00000080:0.0:1788796873.712529:0:6700:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osp with refcount 2 00000020:00000080:0.0:1788796873.712534:0:6700:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1788796873.712628:0:6700:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:0.0:1788796873.712633:0:6700:0:(osd_handler.c:1574:osd_obd_connect()) connect #5 00000020:00000080:0.0:1788796873.712640:0:6700:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xca7fc0c411f9333b 00010000:00080000:0.0:1788796873.712666:0:6700:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000cac0076f@lustre-OST0000-osc-MDT0000: add connection 192.168.204.138@tcp at head 00010000:00010000:0.0:1788796873.712887:0:6700:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-2 is initialized 00000040:01000000:0.0:1788796873.757862:0:6700:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:0.0:1788796873.757888:0:6700:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1788796873.758985:0:6700:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788796873.759691:0:6700:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788796873.759752:0:6700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:0.0:1788796873.759827:0:6700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:0.0:1788796873.761732:0:6701:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788796873.761739:0:6701:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:3.0:1788796873.762503:0:6700:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788796873.762516:0:6700:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1788796873.762548:0:6700:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1788796873.762568:0:6700:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xca7fc0c411f93342 00000100:00080000:3.0:1788796873.762579:0:6700:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788796873.762604:0:6700:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import 00000000cac0076f using connection 192.168.204.138@tcp/0@lo 00000100:00100000:3.0:1788796873.762647:0:6700:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000b40aae22 x1875689374488960/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788796873.762670:0:6700:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:3.0:1788796873.762732:0:6700:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788796873.762736:0:6700:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788796873.762738:0:6700:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1788796873.762740:0:6700:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788796873.762744:0:6700:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788796873.762745:0:6700:0:(obd_config.c:1563:class_process_config()) marker 14 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788796873.762748:0:6700:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788796873.762749:0:6700:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1788796873.762775:0:6700:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005687320c pname:cluuid:pid:xid:nid:opc:job llog_process_th:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:6700:1875689374489088:0@lo:502: 00000100:00100000:3.0:1788796873.762863:0:6700:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796873.762903:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374489088 00000100:00100000:3.0:1788796873.762910:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374489088 00000100:00100000:3.0:1788796873.762943:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788796873.762951:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000e17880b0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+11:6700:x1875689374489088:12345-0@lo:502: 00000100:00100000:1.0:1788796873.763024:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b40aae22 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3299:1875689374488960:0@lo:8: 00000100:00100000:1.0:1788796873.763086:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796873.763233:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000e17880b0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+11:6700:x1875689374489088:12345-0@lo:502: Request processed in 282us (370us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796873.763241:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788796873.763603:0:6700:0:(client.c:2716:ptlrpc_set_wait()) set 00000000dacfe9d4 going to sleep for 11 seconds 00000100:00100000:3.0:1788796873.763638:0:6700:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005687320c pname:cluuid:pid:xid:nid:opc:job llog_process_th:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:6700:1875689374489088:0@lo:502: 00000020:01000000:3.0:1788796873.763670:0:6700:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000100:00100000:0.0:1788796873.763712:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374488960 00000100:00100000:0.0:1788796873.763719:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374488960 00000100:00100000:3.0:1788796873.763727:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000000df84c18 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+10:6679:x1875689374486912:12345-0@lo:253: Request processed in 68660us (68900us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796873.763734:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788796873.763745:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788796873.763751:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000085b0ed41 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3299:x1875689374488960:12345-0@lo:8: 00010000:00020000:0.0:1788796873.763774:0:6681:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788796873.763808:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000085b0ed41 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3299:x1875689374488960:12345-0@lo:8: Request processed in 57us (723us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788796873.763815:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788796873.763835:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007e07c108 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875689374489216:0@lo:400: 00000100:00100000:0.0:1788796873.763874:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788796873.763912:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374489216 00000100:00100000:0.0:1788796873.763916:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374489216 00000100:00100000:0.0:1788796873.763944:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788796873.763950:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000025d8526f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875689374489216:12345-0@lo:400: 00000020:00000080:3.0:1788796873.763986:0:6700:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788796873.763990:0:6700:0:(obd_config.c:1563:class_process_config()) marker 14 (0x2) lustre sys.timeout 00000100:00100000:0.0:1788796873.763994:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000025d8526f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875689374489216:12345-0@lo:400: Request processed in 45us (119us total) trans 0 rc 0/0 00000040:00080000:3.0:1788796873.763997:0:6700:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000100:00100000:0.0:1788796873.764004:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1788796873.764063:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000007e07c108 x1875689374489216/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788796889 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788796873.764075:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007e07c108 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875689374489216:0@lo:400: 00000020:01000000:3.0:1788796873.764091:0:5822:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:3.0:1788796873.764108:0:5822:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.138@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1788796873.764122:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.138@tcp lock: 0000000005b6d83b/0xca7fc0c411f93326 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xca7fc0c411f9332d expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796873.764131:0:5822:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.138@tcp lock: 0000000005b6d83b/0xca7fc0c411f93326 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xca7fc0c411f9332d expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788796873.764140:0:5822:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788796873.764142:0:5822:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8cb042f0b000 from 1 10000000:01000000:3.0:1788796873.764145:0:5822:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788796873.764171:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.138@tcp lock: 000000001a33a3bc/0xca7fc0c411f93349 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796873.764184:0:5822:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.138@tcp lock: 000000001a33a3bc/0xca7fc0c411f93349 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796873.764193:0:5822:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.138@tcp lock: 000000001a33a3bc/0xca7fc0c411f93349 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788796873.764207:0:5822:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005687320c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:5822:1875689374489344:0@lo:101: 00000100:00100000:3.0:1788796873.764232:0:5822:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796873.764262:0:5822:0:(client.c:2716:ptlrpc_set_wait()) set 00000000040ebcae going to sleep for 11 seconds 00000100:00100000:1.0:1788796873.764422:0:6679:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ac95c097 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:6679:1875689374486912:0@lo:253: 10000000:01000000:1.0:1788796873.764433:0:6679:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1788796873.764436:0:6679:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788796873.764438:0:6679:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788796873.764440:0:6679:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788796873.764441:0:6679:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:1.0:1788796873.764443:0:6679:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788796873.764445:0:6679:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788796873.764446:0:6679:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788796873.764449:0:6679:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:1.0:1788796873.764450:0:6679:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788796873.764452:0:6679:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1788796873.764467:0:6679:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000faeb625f from lustre-OST0000 10000000:01000000:1.0:1788796873.764485:0:6679:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:1.0:1788796873.764487:0:6679:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1788796873.764492:0:6679:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8cb0494f0000 local copy 10000000:01000000:1.0:1788796873.764495:0:6679:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1788796873.764512:0:6679:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.138@tcp lock: 000000001a4e96b1/0xca7fc0c411f93350 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796873.764531:0:6679:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.204.138@tcp lock: 000000001a4e96b1/0xca7fc0c411f93350 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796873.764538:0:6679:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.138@tcp lock: 000000001a4e96b1/0xca7fc0c411f93350 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788796873.764550:0:6679:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000de9cc014 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:6679:1875689374489472:0@lo:101: 00000100:00100000:1.0:1788796873.764576:0:6679:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788796873.764596:0:6679:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e2755bd5 going to sleep for 11 seconds 00000100:00080000:1.0:1788796873.764628:0:3299:0:(import.c:65:import_set_state_nolock()) 00000000cac0076f lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788796873.764633:0:3299:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788796873.764636:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b40aae22 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3299:1875689374488960:0@lo:8: 00000100:00100000:3.0:1788796873.764681:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374489344 00000100:00100000:3.0:1788796873.764687:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374489344 00000100:00100000:0.0:1788796873.764692:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374489472 00000100:00100000:0.0:1788796873.764699:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374489472 00000100:00100000:3.0:1788796873.764724:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788796873.764732:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000001b4302e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+11:5822:x1875689374489344:12345-0@lo:101: 00010000:00010000:3.0:1788796873.764753:0:5820:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788796873.764764:0:5820:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000be7b1247/0xca7fc0c411f93357 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xca7fc0c411f93349 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796873.764783:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000be7b1247/0xca7fc0c411f93357 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xca7fc0c411f93349 expref: 12 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796873.764792:0:5820:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000be7b1247/0xca7fc0c411f93357 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xca7fc0c411f93349 expref: 12 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796873.764800:0:5820:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000be7b1247, rc 0) 00000100:00100000:0.0:1788796873.764847:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788796873.764865:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000002d37aff3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+12:6679:x1875689374489472:12345-0@lo:101: 00010000:00010000:0.0:1788796873.764874:0:5818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788796873.764882:0:5818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000d500f348/0xca7fc0c411f9335e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xca7fc0c411f93350 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796873.764896:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000d500f348/0xca7fc0c411f9335e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xca7fc0c411f93350 expref: 13 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796873.764915:0:5818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000d500f348/0xca7fc0c411f9335e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xca7fc0c411f93350 expref: 13 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796873.764920:0:5818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000d500f348, rc 0) 00000100:00100000:2.0:1788796873.765109:0:5822:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005687320c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:5822:1875689374489344:0@lo:101: 00010000:00010000:2.0:1788796873.765122:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.138@tcp lock: 000000001a33a3bc/0xca7fc0c411f93349 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xca7fc0c411f93357 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796873.765130:0:5822:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.138@tcp lock: 000000001a33a3bc/0xca7fc0c411f93349 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xca7fc0c411f93357 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788796873.765186:0:5822:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000044033e2c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:5822:1875689374489600:0@lo:501: 00000100:00100000:1.0:1788796873.765515:0:6679:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000de9cc014 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:6679:1875689374489472:0@lo:101: 00010000:00010000:1.0:1788796873.765525:0:6679:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.138@tcp lock: 000000001a4e96b1/0xca7fc0c411f93350 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0xca7fc0c411f9335e expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796873.765532:0:6679:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.138@tcp lock: 000000001a4e96b1/0xca7fc0c411f93350 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0xca7fc0c411f9335e expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788796873.765633:0:6679:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000de9cc014 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:6679:1875689374489728:0@lo:501: 00000100:00100000:3.0:1788796873.765705:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000001b4302e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+13:5822:x1875689374489344:12345-0@lo:101: Request processed in 973us (1471us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796873.765715:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788796873.765719:0:5822:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788796873.765752:0:5822:0:(client.c:2716:ptlrpc_set_wait()) set 00000000acba8ea6 going to sleep for 11 seconds 00000100:00100000:3.0:1788796873.766026:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374489600 00000100:00100000:1.0:1788796873.766050:0:6679:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796873.766057:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374489600 00000100:00100000:1.0:1788796873.766063:0:6679:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e2755bd5 going to sleep for 11 seconds 00000100:00100000:3.0:1788796873.766078:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374489728 00000100:00100000:3.0:1788796873.766082:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374489728 00000100:00100000:1.0:1788796873.766090:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788796873.766104:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000798a038e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+14:5822:x1875689374489600:12345-0@lo:501: 00000100:00100000:1.0:1788796873.766345:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000798a038e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+14:5822:x1875689374489600:12345-0@lo:501: Request processed in 248us (632us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796873.766361:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788796873.766382:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788796873.766387:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000041906761 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+13:6679:x1875689374489728:12345-0@lo:501: 00000100:00100000:1.0:1788796873.766499:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000041906761 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+13:6679:x1875689374489728:12345-0@lo:501: Request processed in 112us (471us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788796873.766506:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788796873.766540:0:6679:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000de9cc014 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:6679:1875689374489728:0@lo:501: 10000000:01000000:3.0:1788796873.766556:0:6679:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.138@tcp: no remote llog for lustre-sptlrpc, check MGS config 00000100:00100000:2.0:1788796873.766598:0:5822:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000044033e2c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:5822:1875689374489600:0@lo:501: 10000000:01000000:3.0:1788796873.766603:0:6679:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.138@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1788796873.766609:0:6679:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.138@tcp lock: 000000001a4e96b1/0xca7fc0c411f93350 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0xca7fc0c411f9335e expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788796873.766629:0:5822:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000044033e2c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:5822:1875689374489856:0@lo:503: 00000100:00100000:2.0:1788796873.766666:0:5822:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788796873.766695:0:5822:0:(client.c:2716:ptlrpc_set_wait()) set 00000000acba8ea6 going to sleep for 11 seconds 00000100:00100000:1.0:1788796873.766746:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374489856 00000100:00100000:1.0:1788796873.766751:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374489856 00000100:00100000:1.0:1788796873.766779:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788796873.766785:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000000f01d646 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+13:5822:x1875689374489856:12345-0@lo:503: 00010000:00010000:3.0:1788796873.766808:0:6679:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.138@tcp lock: 000000001a4e96b1/0xca7fc0c411f93350 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000400000000 nid: local remote: 0xca7fc0c411f9335e expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796873.766817:0:6679:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.138@tcp lock: 000000001a4e96b1/0xca7fc0c411f93350 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000400000000 nid: local remote: 0xca7fc0c411f9335e expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796873.766838:0:6679:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1788796873.766860:0:6679:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8cb042fda000 10000000:01000000:3.0:1788796873.766865:0:6679:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788796873.766870:0:6679:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff8cb0494f0000 10000000:01000000:3.0:1788796873.766873:0:6679:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:3.0:1788796873.766877:0:6679:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8cb0494f0000 from 1 10000000:01000000:3.0:1788796873.766880:0:6679:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1788796873.766913:0:6679:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.138@tcp lock: 00000000577ee06b/0xca7fc0c411f93365 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796873.766920:0:6679:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.138@tcp lock: 00000000577ee06b/0xca7fc0c411f93365 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796873.766927:0:6679:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.138@tcp lock: 00000000577ee06b/0xca7fc0c411f93365 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788796873.766943:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000000f01d646 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+13:5822:x1875689374489856:12345-0@lo:503: Request processed in 157us (275us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796873.766950:0:6679:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000531b7ee5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:6679:1875689374489984:0@lo:101: 00000100:00100000:1.0:1788796873.766951:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00010000:1.0:1788796873.766988:0:5814:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:3.0:1788796873.766989:0:6679:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788796873.766996:0:5814:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.138@tcp lock: 000000001a4e96b1/0xca7fc0c411f93350 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x400000000 nid: local remote: 0xca7fc0c411f9335e expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796873.767005:0:5814:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000001a4e96b1 already unused, calling callback (0000000041dfb12a) 00000100:00100000:3.0:1788796873.767006:0:6679:0:(client.c:2716:ptlrpc_set_wait()) set 0000000076cfa345 going to sleep for 11 seconds 10000000:00010000:1.0:1788796873.767008:0:5814:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.138@tcp lock: 000000001a4e96b1/0xca7fc0c411f93350 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x400000000 nid: local remote: 0xca7fc0c411f9335e expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796873.767018:0:5814:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.138@tcp lock: 000000001a4e96b1/0xca7fc0c411f93350 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x8400000000 nid: local remote: 0xca7fc0c411f9335e expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788796873.767024:0:5814:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.138@tcp lock: 000000001a4e96b1/0xca7fc0c411f93350 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x9400000000 nid: local remote: 0xca7fc0c411f9335e expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788796873.767053:0:5814:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788796873.767077:0:5814:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.138@tcp lock: 000000001a4e96b1/0xca7fc0c411f93350 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x4809400000020 nid: local remote: 0xca7fc0c411f9335e expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796873.767084:0:5814:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788796873.767108:0:5814:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.138@tcp lock: 000000001a4e96b1/0xca7fc0c411f93350 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x4809400000020 nid: local remote: 0xca7fc0c411f9335e expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796873.767115:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.138@tcp lock: 000000001a4e96b1/0xca7fc0c411f93350 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x4809400000020 nid: local remote: 0xca7fc0c411f9335e expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796873.767126:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788796873.767128:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788796873.767129:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788796873.767138:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788796873.767147:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b87815e3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:3301:1875689374490112:0@lo:103: 00000100:00100000:1.0:1788796873.767177:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796873.767205:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374490112 00000100:00100000:3.0:1788796873.767211:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374490112 00000100:00100000:1.0:1788796873.767218:0:5822:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000044033e2c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:5822:1875689374489856:0@lo:503: 00000100:00100000:3.0:1788796873.767246:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788796873.767254:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000b82ac70e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+13:3301:x1875689374490112:12345-0@lo:103: 00010000:00010000:3.0:1788796873.767264:0:5811:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788796873.767289:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000d500f348/0xca7fc0c411f9335e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xca7fc0c411f93350 expref: 13 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796873.767301:0:5811:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788796873.767331:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000b82ac70e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+12:3301:x1875689374490112:12345-0@lo:103: Request processed in 79us (155us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796873.767339:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788796873.767398:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b87815e3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:3301:1875689374490112:0@lo:103: 00000100:00100000:1.0:1788796873.767430:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374489984 00000100:00100000:1.0:1788796873.767434:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374489984 00000100:00100000:1.0:1788796873.767450:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788796873.767456:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000006cace982 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+12:6679:x1875689374489984:12345-0@lo:101: 00010000:00010000:1.0:1788796873.767464:0:5820:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788796873.767475:0:5820:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000fe904349/0xca7fc0c411f9336c lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xca7fc0c411f93365 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796873.767493:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000fe904349/0xca7fc0c411f9336c lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xca7fc0c411f93365 expref: 13 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788796873.767506:0:6703:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000461d82fb pname:cluuid:pid:xid:nid:opc:job llog_process_th:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:6703:1875689374490240:0@lo:502: 00010000:00010000:1.0:1788796873.767522:0:5820:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000fe904349/0xca7fc0c411f9336c lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xca7fc0c411f93365 expref: 13 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796873.767529:0:5820:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000fe904349, rc 0) 00000100:00100000:1.0:1788796873.767576:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000006cace982 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+13:6679:x1875689374489984:12345-0@lo:101: Request processed in 117us (585us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796873.767579:0:6703:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788796873.767587:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788796873.767751:0:6679:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000531b7ee5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:6679:1875689374489984:0@lo:101: 00010000:00010000:2.0:1788796873.767763:0:6679:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.138@tcp lock: 00000000577ee06b/0xca7fc0c411f93365 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xca7fc0c411f9336c expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796873.767771:0:6679:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.138@tcp lock: 00000000577ee06b/0xca7fc0c411f93365 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xca7fc0c411f9336c expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788796873.767786:0:6679:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.138@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1788796873.767790:0:6679:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.138@tcp lock: 00000000577ee06b/0xca7fc0c411f93365 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xca7fc0c411f9336c expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796873.767797:0:6679:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.138@tcp lock: 00000000577ee06b/0xca7fc0c411f93365 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xca7fc0c411f9336c expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788796873.767803:0:6679:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1788796873.767807:0:6679:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788796873.767811:0:6679:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:2.0:1788796873.767813:0:6679:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1788796873.767826:0:6679:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.138@tcp lock: 00000000c081d453/0xca7fc0c411f93373 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796873.767833:0:6679:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.138@tcp lock: 00000000c081d453/0xca7fc0c411f93373 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796873.767845:0:6679:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.138@tcp lock: 00000000c081d453/0xca7fc0c411f93373 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788796873.767856:0:6679:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000737987be pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:6679:1875689374490368:0@lo:101: 00000100:00100000:2.0:1788796873.767882:0:6679:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788796873.767911:0:6679:0:(client.c:2716:ptlrpc_set_wait()) set 000000002e49a1e4 going to sleep for 11 seconds 00000100:00100000:0.0:1788796873.767961:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000002d37aff3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+12:6679:x1875689374489472:12345-0@lo:101: Request processed in 3106us (3383us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796873.767968:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788796873.768010:0:6703:0:(client.c:2716:ptlrpc_set_wait()) set 000000008eac4532 going to sleep for 11 seconds 00000100:00100000:0.0:1788796873.768127:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374490368 00000100:00100000:0.0:1788796873.768132:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374490368 00000100:00100000:0.0:1788796873.768150:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374490240 00000100:00100000:0.0:1788796873.768153:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374490240 00000100:00100000:0.0:1788796873.768164:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788796873.768168:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000001d748403 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+13:6679:x1875689374490368:12345-0@lo:101: 00010000:00010000:0.0:1788796873.768175:0:5818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788796873.768182:0:5818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000008bf68295/0xca7fc0c411f9337a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xca7fc0c411f93373 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796873.768195:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000008bf68295/0xca7fc0c411f9337a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xca7fc0c411f93373 expref: 14 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796873.768202:0:5818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000008bf68295/0xca7fc0c411f9337a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xca7fc0c411f93373 expref: 14 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796873.768208:0:5818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000008bf68295, rc 0) 00000100:00100000:0.0:1788796873.768238:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000001d748403 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+14:6679:x1875689374490368:12345-0@lo:101: Request processed in 69us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796873.768243:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788796873.768264:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788796873.768270:0:6679:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000737987be pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:6679:1875689374490368:0@lo:101: 00000100:00100000:0.0:1788796873.768293:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000bc5c29f4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+13:6703:x1875689374490240:12345-0@lo:502: 00010000:00010000:3.0:1788796873.768299:0:6679:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.138@tcp lock: 00000000c081d453/0xca7fc0c411f93373 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xca7fc0c411f9337a expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796873.768308:0:6679:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.138@tcp lock: 00000000c081d453/0xca7fc0c411f93373 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xca7fc0c411f9337a expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788796873.768411:0:6679:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000bc1b5984 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:6679:1875689374490496:0@lo:501: 00000100:00100000:3.0:1788796873.768448:0:6679:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796873.768470:0:6679:0:(client.c:2716:ptlrpc_set_wait()) set 0000000076cfa345 going to sleep for 11 seconds 00000100:00100000:0.0:1788796873.768518:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000bc5c29f4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+13:6703:x1875689374490240:12345-0@lo:502: Request processed in 228us (944us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796873.768525:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788796873.768533:0:6703:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000461d82fb pname:cluuid:pid:xid:nid:opc:job llog_process_th:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:6703:1875689374490240:0@lo:502: 00000100:00100000:0.0:1788796873.768553:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374490496 00000100:00100000:0.0:1788796873.768558:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374490496 00000020:01000000:3.0:1788796873.768561:0:6703:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788796873.768573:0:6703:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000100:00100000:0.0:1788796873.768576:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000020:00000080:3.0:1788796873.768577:0:6703:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000100:00100000:0.0:1788796873.768586:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000016f42ecf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+13:6679:x1875689374490496:12345-0@lo:501: 00000020:01000000:3.0:1788796873.768716:0:6703:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8cb042f0b000 00000020:00000080:3.0:1788796873.768720:0:6703:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788796873.768770:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000016f42ecf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+13:6679:x1875689374490496:12345-0@lo:501: Request processed in 186us (321us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796873.768776:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788796873.768907:0:6679:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb0774e6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:6679:1875689374490496:0@lo:501: 00000100:00100000:3.0:1788796873.768934:0:6679:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb0774e6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:6679:1875689374490624:0@lo:503: 00000100:00100000:3.0:1788796873.768968:0:6679:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796873.768991:0:6679:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb048bf7840 going to sleep for 11 seconds 00000100:00100000:3.0:1788796873.769015:0:6703:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb0774e7480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:6703:1875689374490752:0@lo:502: 00000100:00100000:3.0:1788796873.769082:0:6703:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796873.769108:0:6703:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb048bf7600 going to sleep for 11 seconds 00000100:00100000:2.0:1788796873.769113:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374490624 00000100:00100000:2.0:1788796873.769119:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374490624 00000100:00100000:2.0:1788796873.769138:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374490752 00000100:00100000:2.0:1788796873.769141:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374490752 00000100:00100000:2.0:1788796873.769152:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788796873.769158:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb060707450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+14:6679:x1875689374490624:12345-0@lo:503: 00000100:00100000:2.0:1788796873.769310:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb060707450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+14:6679:x1875689374490624:12345-0@lo:503: Request processed in 151us (341us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796873.769317:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788796873.769343:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788796873.769349:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb060705850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+13:6703:x1875689374490752:12345-0@lo:502: 00000100:00100000:2.0:1788796873.769462:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb060705850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+13:6703:x1875689374490752:12345-0@lo:502: Request processed in 112us (378us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796873.769470:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788796873.769481:0:6679:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb0774e6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:6679:1875689374490624:0@lo:503: 00000040:00080000:3.0:1788796873.769870:0:6679:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788796873.769929:0:6679:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb0774e6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:6679:1875689374490880:0@lo:502: 00000100:00100000:3.0:1788796873.769968:0:6679:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796873.769991:0:6679:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb048bf7840 going to sleep for 11 seconds 00000100:00100000:3.0:1788796873.770014:0:6703:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb0774e7480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:6703:1875689374490752:0@lo:502: 00000020:01000000:3.0:1788796873.770053:0:6703:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788796873.770059:0:6703:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788796873.770060:0:6703:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1788796873.770063:0:6703:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000100:00100000:2.0:1788796873.770249:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374490880 00000100:00100000:2.0:1788796873.770256:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374490880 00000020:01000000:1.0:1788796873.770326:0:5822:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1788796873.770345:0:5822:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.138@tcp: configuration from log 'params' succeeded (0). 00000100:00100000:2.0:1788796873.770348:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00010000:00010000:1.0:1788796873.770354:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.138@tcp lock: ffff8cb082045400/0xca7fc0c411f93349 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xca7fc0c411f93357 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788796873.770356:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb060705050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+13:6679:x1875689374490880:12345-0@lo:502: 00010000:00010000:1.0:1788796873.770363:0:5822:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.138@tcp lock: ffff8cb082045400/0xca7fc0c411f93349 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xca7fc0c411f93357 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788796873.770371:0:5822:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1788796873.770374:0:5822:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8cb0494f0000 from 1 10000000:01000000:1.0:1788796873.770377:0:5822:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1788796873.770397:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.138@tcp lock: ffff8cb0821f0000/0xca7fc0c411f93381 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796873.770405:0:5822:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.138@tcp lock: ffff8cb0821f0000/0xca7fc0c411f93381 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796873.770413:0:5822:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.138@tcp lock: ffff8cb0821f0000/0xca7fc0c411f93381 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788796873.770425:0:5822:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb0498ec700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:5822:1875689374491008:0@lo:101: 00000100:00100000:1.0:1788796873.770453:0:5822:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788796873.770528:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb060705050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+13:6679:x1875689374490880:12345-0@lo:502: Request processed in 171us (557us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796873.770546:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788796873.770608:0:6679:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb0774e6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:6679:1875689374490880:0@lo:502: 00000040:00080000:3.0:1788796873.770893:0:6679:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1788796873.770942:0:6679:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:3.0:1788796873.770973:0:6679:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:3.0:1788796873.771017:0:6679:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:3.0:1788796873.771079:0:6679:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:3.0:1788796873.771129:0:6679:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:3.0:1788796873.771154:0:6679:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb0774e6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:6679:1875689374491136:0@lo:502: 00000100:00100000:3.0:1788796873.771192:0:6679:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788796873.771987:0:5822:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb048dc0b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788796873.771993:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374491008 00000100:00100000:2.0:1788796873.771999:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374491008 00000100:00100000:2.0:1788796873.772050:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788796873.772059:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb051758c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+13:5822:x1875689374491008:12345-0@lo:101: 00010000:00010000:2.0:1788796873.772070:0:5819:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788796873.772084:0:5819:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cb041484c00/0xca7fc0c411f93388 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xca7fc0c411f93381 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796873.772121:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cb041484c00/0xca7fc0c411f93388 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xca7fc0c411f93381 expref: 14 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796873.772130:0:5819:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cb041484c00/0xca7fc0c411f93388 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xca7fc0c411f93381 expref: 14 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796873.772136:0:5819:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb041484c00, rc 0) 00000100:00100000:2.0:1788796873.772172:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb051758c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+14:5822:x1875689374491008:12345-0@lo:101: Request processed in 115us (1718us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796873.772179:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788796873.772195:0:5822:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb0498ec700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:5822:1875689374491008:0@lo:101: 00010000:00010000:1.0:1788796873.772208:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.138@tcp lock: ffff8cb0821f0000/0xca7fc0c411f93381 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xca7fc0c411f93388 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796873.772217:0:5822:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.138@tcp lock: ffff8cb0821f0000/0xca7fc0c411f93381 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xca7fc0c411f93388 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788796873.772265:0:5822:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb0498ec700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:5822:1875689374491264:0@lo:501: 00000100:00100000:1.0:1788796873.772305:0:5822:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788796873.772332:0:5822:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb048dc0b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788796873.772437:0:6679:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb048bf7840 going to sleep for 11 seconds 00000100:00100000:0.0:1788796873.772785:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374491264 00000100:00100000:0.0:1788796873.772790:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374491264 00000100:00100000:0.0:1788796873.772813:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374491136 00000100:00100000:0.0:1788796873.772816:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374491136 00000100:00100000:0.0:1788796873.772827:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788796873.772834:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb051758450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+15:5822:x1875689374491264:12345-0@lo:501: 00000100:00100000:2.0:1788796873.772935:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788796873.772942:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb05175ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+15:6679:x1875689374491136:12345-0@lo:502: 00000100:00100000:0.0:1788796873.773104:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb051758450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+15:5822:x1875689374491264:12345-0@lo:501: Request processed in 270us (798us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788796873.773112:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788796873.773183:0:5822:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb0498ec700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:5822:1875689374491264:0@lo:501: 10000000:01000000:1.0:1788796873.773206:0:5822:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.138@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1788796873.773213:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.138@tcp lock: ffff8cb0821f0000/0xca7fc0c411f93381 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xca7fc0c411f93388 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796873.773221:0:5822:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.138@tcp lock: ffff8cb0821f0000/0xca7fc0c411f93381 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xca7fc0c411f93388 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788796873.773411:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb05175ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+14:6679:x1875689374491136:12345-0@lo:502: Request processed in 469us (2218us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796873.773417:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788796873.773475:0:6679:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb0774e6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:6679:1875689374491136:0@lo:502: 00000040:00080000:3.0:1788796873.773591:0:6679:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:3.0:1788796873.773604:0:6679:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 7 count 8 00000020:01000000:3.0:1788796873.774183:0:6704:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788796873.774192:0:6704:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:3.0:1788796873.774198:0:6704:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788796873.774200:0:6704:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:3.0:1788796873.774205:0:6704:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788796873.774219:0:6704:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff8cb048f73380) 00000020:00000080:3.0:1788796873.774239:0:6704:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type obdfilter with refcount 2 00000020:00000080:3.0:1788796873.774244:0:6704:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788796873.774320:0:6704:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8cb042fda000 from lustre-OST0000, refs=2 00080000:01000000:3.0:1788796873.774327:0:6704:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788796873.774333:0:6704:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xca7fc0c411f93396 00010000:00010000:3.0:1788796873.779548:0:6704:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:02000400:3.0:1788796873.779842:0:6704:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:3.0:1788796873.791981:0:6704:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:3.0:1788796873.794416:0:6704:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:0.0:1788796873.806147:0:6704:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:0.0:1788796873.806651:0:6704:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:0.0:1788796873.808166:0:6704:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:0.0:1788796873.808179:0:6704:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788796873.808186:0:6704:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788796873.808188:0:6704:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:0.0:1788796873.808192:0:6704:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788796873.808198:0:6704:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788796873.808204:0:6704:0:(obd_config.c:1563:class_process_config()) marker 16 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788796873.808208:0:6704:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788796873.808210:0:6704:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1788796873.808257:0:6704:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788796873.808261:0:6704:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788796873.808262:0:6704:0:(obd_config.c:1563:class_process_config()) marker 16 (0x2) lustre sys.timeout 00000040:00080000:0.0:1788796873.808265:0:6704:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:3.0:1788796873.808481:0:6679:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:3.0:1788796873.808506:0:6679:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.138@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1788796873.808569:0:6679:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.138@tcp lock: ffff8cb041484000/0xca7fc0c411f93373 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xca7fc0c411f9337a expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796873.808598:0:6679:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.138@tcp lock: ffff8cb041484000/0xca7fc0c411f93373 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xca7fc0c411f9337a expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788796873.808607:0:6679:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8cb042fda000 from 1 10000000:01000000:3.0:1788796873.808609:0:6679:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788796873.808641:0:6679:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.138@tcp lock: ffff8cb082045e00/0xca7fc0c411f9339d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796873.808646:0:6679:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.138@tcp lock: ffff8cb082045e00/0xca7fc0c411f9339d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796873.808655:0:6679:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.138@tcp lock: ffff8cb082045e00/0xca7fc0c411f9339d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788796873.808673:0:6679:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb0774e6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:6679:1875689374491392:0@lo:101: 00000100:00100000:3.0:1788796873.808729:0:6679:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788796873.808771:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374491392 00000100:00100000:3.0:1788796873.808773:0:6679:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb048bf7d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788796873.808777:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374491392 00000100:00100000:0.0:1788796873.808835:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788796873.808847:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb051759450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+14:6679:x1875689374491392:12345-0@lo:101: 00010000:00010000:0.0:1788796873.808862:0:5818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788796873.808878:0:5818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cb040030400/0xca7fc0c411f933a4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xca7fc0c411f9339d expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796873.808906:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cb040030400/0xca7fc0c411f933a4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xca7fc0c411f9339d expref: 15 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796873.808917:0:5818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cb040030400/0xca7fc0c411f933a4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xca7fc0c411f9339d expref: 15 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796873.808926:0:5818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb040030400, rc 0) 00000100:00100000:0.0:1788796873.808976:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb051759450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+15:6679:x1875689374491392:12345-0@lo:101: Request processed in 131us (245us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796873.808983:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788796873.809021:0:6679:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb0774e6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:6679:1875689374491392:0@lo:101: 00010000:00010000:3.0:1788796873.809066:0:6679:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.138@tcp lock: ffff8cb082045e00/0xca7fc0c411f9339d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xca7fc0c411f933a4 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796873.809077:0:6679:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.138@tcp lock: ffff8cb082045e00/0xca7fc0c411f9339d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xca7fc0c411f933a4 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788796873.809212:0:6679:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb06f609880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:6679:1875689374491520:0@lo:501: 00000100:00100000:0.0:1788796873.809248:0:6679:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788796873.809292:0:6679:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb069810180 going to sleep for 11 seconds 00000100:00100000:2.0:1788796873.809307:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374491520 00000100:00100000:2.0:1788796873.809312:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374491520 00000100:00100000:2.0:1788796873.809379:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788796873.809388:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb051758850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+15:6679:x1875689374491520:12345-0@lo:501: 00000100:00100000:2.0:1788796873.809606:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb051758850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+15:6679:x1875689374491520:12345-0@lo:501: Request processed in 220us (356us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796873.809613:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788796873.809621:0:6679:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb06f609880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:6679:1875689374491520:0@lo:501: 00000100:00100000:0.0:1788796873.809650:0:6679:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb06f609880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:6679:1875689374491648:0@lo:503: 00000100:00100000:0.0:1788796873.809698:0:6679:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796873.809806:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374491648 00000100:00100000:0.0:1788796873.809808:0:6679:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb069810180 going to sleep for 11 seconds 00000100:00100000:3.0:1788796873.809811:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374491648 00000100:00100000:2.0:1788796873.809858:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788796873.809865:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0465dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+15:6679:x1875689374491648:12345-0@lo:503: 00000100:00100000:2.0:1788796873.810009:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0465dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+15:6679:x1875689374491648:12345-0@lo:503: Request processed in 144us (309us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796873.810016:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788796873.810302:0:6679:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb06f609880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:6679:1875689374491648:0@lo:503: 00000040:00080000:0.0:1788796873.810713:0:6679:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788796873.810777:0:6679:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb06f609880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:6679:1875689374491776:0@lo:502: 00000100:00100000:0.0:1788796873.810906:0:6679:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796873.810995:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374491776 00000100:00100000:0.0:1788796873.810995:0:6679:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb069810180 going to sleep for 11 seconds 00000100:00100000:3.0:1788796873.811001:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374491776 00000100:00100000:3.0:1788796873.811062:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788796873.811070:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0465dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+15:6679:x1875689374491776:12345-0@lo:502: 00000100:00100000:3.0:1788796873.811229:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0465dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+15:6679:x1875689374491776:12345-0@lo:502: Request processed in 160us (322us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796873.811237:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788796873.811253:0:6679:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb06f609880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:6679:1875689374491776:0@lo:502: 00000040:00080000:0.0:1788796873.811939:0:6679:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:0.0:1788796873.812002:0:6679:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:0.0:1788796873.812061:0:6679:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb06f609880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:6679:1875689374491904:0@lo:502: 00000100:00100000:0.0:1788796873.812117:0:6679:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788796873.812212:0:6679:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb069810180 going to sleep for 11 seconds 00000100:00100000:2.0:1788796873.812254:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374491904 00000100:00100000:2.0:1788796873.812260:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374491904 00000100:00100000:2.0:1788796873.812317:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788796873.812326:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0465dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+15:6679:x1875689374491904:12345-0@lo:502: 00000100:00100000:2.0:1788796873.812542:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0465dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+15:6679:x1875689374491904:12345-0@lo:502: Request processed in 217us (425us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796873.812550:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788796873.812893:0:6679:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb06f609880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:6679:1875689374491904:0@lo:502: 00000040:00080000:0.0:1788796873.813009:0:6679:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:0.0:1788796873.813021:0:6679:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:0.0:1788796873.813573:0:6708:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788796873.813583:0:6708:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788796873.813586:0:6708:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788796873.813593:0:6708:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8cb042fda000 00000020:00000080:0.0:1788796873.813596:0:6708:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788796873.813617:0:6708:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788796873.813621:0:6708:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788796873.813623:0:6708:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1788796873.813625:0:6708:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:3.0:1788796873.813684:0:6679:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1788796873.813705:0:6679:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.138@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788796873.813753:0:6679:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.138@tcp lock: ffff8cb082045e00/0xca7fc0c411f9339d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xca7fc0c411f933a4 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796873.813765:0:6679:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.138@tcp lock: ffff8cb082045e00/0xca7fc0c411f9339d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xca7fc0c411f933a4 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788796873.813807:0:6679:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1788796873.813810:0:6679:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8cb042fda000 10000000:01000000:3.0:1788796873.813813:0:6679:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8cb042fda000 10000000:01000000:3.0:1788796873.813826:0:6679:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788796873.813832:0:6679:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8cb042fda000 from 1 10000000:01000000:3.0:1788796873.813835:0:6679:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788796873.813865:0:6679:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.138@tcp lock: ffff8cb082045600/0xca7fc0c411f933ab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796873.813875:0:6679:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.138@tcp lock: ffff8cb082045600/0xca7fc0c411f933ab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796873.813885:0:6679:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.138@tcp lock: ffff8cb082045600/0xca7fc0c411f933ab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788796873.813908:0:6679:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb0774e6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:6679:1875689374492032:0@lo:101: 00000100:00100000:3.0:1788796873.813955:0:6679:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788796873.813996:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374492032 00000100:00100000:3.0:1788796873.814001:0:6679:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb048bf73c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788796873.814004:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374492032 00000100:00100000:2.0:1788796873.814080:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788796873.814091:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0465dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+15:6679:x1875689374492032:12345-0@lo:101: 00010000:00010000:2.0:1788796873.814102:0:5819:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788796873.814115:0:5819:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cb041485c00/0xca7fc0c411f933b2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xca7fc0c411f933ab expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796873.814137:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cb041485c00/0xca7fc0c411f933b2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xca7fc0c411f933ab expref: 16 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796873.814147:0:5819:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cb041485c00/0xca7fc0c411f933b2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xca7fc0c411f933ab expref: 16 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796873.814164:0:5819:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb041485c00, rc 0) 00000100:00100000:2.0:1788796873.814214:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0465dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+16:6679:x1875689374492032:12345-0@lo:101: Request processed in 125us (258us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796873.814222:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788796873.814249:0:6679:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb0774e6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:6679:1875689374492032:0@lo:101: 00010000:00010000:3.0:1788796873.814264:0:6679:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.138@tcp lock: ffff8cb082045600/0xca7fc0c411f933ab lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xca7fc0c411f933b2 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796873.814285:0:6679:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.138@tcp lock: ffff8cb082045600/0xca7fc0c411f933ab lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xca7fc0c411f933b2 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788796873.814394:0:6679:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb0774e6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:6679:1875689374492160:0@lo:501: 00000100:00100000:3.0:1788796873.814420:0:6679:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796873.814454:0:6679:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb048bf73c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788796873.814728:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374492160 00000100:00100000:2.0:1788796873.814732:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374492160 00000100:00100000:2.0:1788796873.814759:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788796873.814771:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0465de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+16:6679:x1875689374492160:12345-0@lo:501: 00000100:00100000:2.0:1788796873.814985:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0465de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+16:6679:x1875689374492160:12345-0@lo:501: Request processed in 214us (563us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796873.814992:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788796873.815054:0:6679:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb0774e6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:6679:1875689374492160:0@lo:501: 00000100:00100000:0.0:1788796873.815091:0:6679:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb06f609880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:6679:1875689374492288:0@lo:503: 00000100:00100000:0.0:1788796873.815144:0:6679:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788796873.815181:0:6679:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb069810540 going to sleep for 11 seconds 00000100:00100000:3.0:1788796873.815218:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374492288 00000100:00100000:3.0:1788796873.815223:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374492288 00000100:00100000:3.0:1788796873.815254:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788796873.815261:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0465df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+16:6679:x1875689374492288:12345-0@lo:503: 00000100:00100000:3.0:1788796873.815421:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0465df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+16:6679:x1875689374492288:12345-0@lo:503: Request processed in 160us (276us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796873.815428:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788796873.815527:0:6679:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb06f609880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:6679:1875689374492288:0@lo:503: 00000040:00080000:0.0:1788796873.815789:0:6679:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788796873.815847:0:6679:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb06f609880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:6679:1875689374492416:0@lo:502: 00000100:00100000:0.0:1788796873.815881:0:6679:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788796873.815900:0:6679:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb069810540 going to sleep for 11 seconds 00000100:00100000:2.0:1788796873.815921:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374492416 00000100:00100000:2.0:1788796873.815926:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374492416 00000100:00100000:2.0:1788796873.815962:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788796873.815969:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0465dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+16:6679:x1875689374492416:12345-0@lo:502: 00000100:00100000:2.0:1788796873.816153:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0465dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+16:6679:x1875689374492416:12345-0@lo:502: Request processed in 184us (270us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796873.816159:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788796873.816289:0:6679:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb06f609880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:6679:1875689374492416:0@lo:502: 00000040:00080000:0.0:1788796873.816541:0:6679:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:0.0:1788796873.816665:0:6679:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:0.0:1788796873.816705:0:6679:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:0.0:1788796873.816746:0:6679:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:0.0:1788796873.816779:0:6679:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:0.0:1788796873.816805:0:6679:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:0.0:1788796873.816822:0:6679:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:0.0:1788796873.816838:0:6679:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:0.0:1788796873.816863:0:6679:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:0.0:1788796873.816896:0:6679:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:0.0:1788796873.816929:0:6679:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:0.0:1788796873.816975:0:6679:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:0.0:1788796873.817010:0:6679:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:0.0:1788796873.817094:0:6679:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:0.0:1788796873.817163:0:6679:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:0.0:1788796873.817200:0:6679:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:0.0:1788796873.817232:0:6679:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:0.0:1788796873.817306:0:6679:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:0.0:1788796873.817354:0:6679:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:0.0:1788796873.817392:0:6679:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:0.0:1788796873.817452:0:6679:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:0.0:1788796873.817483:0:6679:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:0.0:1788796873.817526:0:6679:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:0.0:1788796873.817571:0:6679:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:0.0:1788796873.817725:0:6679:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:0.0:1788796873.817762:0:6679:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:0.0:1788796873.817812:0:6679:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:0.0:1788796873.817849:0:6679:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000100:00100000:0.0:1788796873.817889:0:6679:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb06f609880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:6679:1875689374492544:0@lo:502: 00000100:00100000:0.0:1788796873.817955:0:6679:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788796873.818004:0:6679:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb069810540 going to sleep for 11 seconds 00000100:00100000:3.0:1788796873.818122:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374492544 00000100:00100000:3.0:1788796873.818130:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374492544 00000100:00100000:3.0:1788796873.818171:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788796873.818179:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0465dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+16:6679:x1875689374492544:12345-0@lo:502: 00000100:00100000:3.0:1788796873.818382:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0465dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+16:6679:x1875689374492544:12345-0@lo:502: Request processed in 202us (426us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796873.818389:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788796873.818653:0:6679:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb06f609880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:6679:1875689374492544:0@lo:502: 00000040:00080000:1.0:1788796873.818741:0:6679:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:1.0:1788796873.818753:0:6679:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:0.0:1788796873.819429:0:6709:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1788796873.819445:0:6709:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff8cb0812d0000) 00000020:00000080:0.0:1788796873.819465:0:6709:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type lwp with refcount 2 00000020:01000004:0.0:1788796873.819548:0:6709:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8cb042fda000 from lustre-OST0000, refs=3 00000020:01000004:0.0:1788796873.819553:0:6709:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8cb042fda000 from lustre-OST0000, refs=3 00000020:01000004:0.0:1788796873.819555:0:6709:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8cb042fda000 3 00010000:00080000:0.0:1788796873.819673:0:6709:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8cb06f613800@lustre-MDT0000-lwp-OST0000: add connection 192.168.204.138@tcp at head 00010000:00010000:0.0:1788796873.822252:0:6709:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-3 is initialized 00000020:00000080:0.0:1788796873.822499:0:6709:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:0.0:1788796873.822536:0:6709:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788796873.822549:0:6709:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xca7fc0c411f933c0 00000100:00080000:0.0:1788796873.822559:0:6709:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788796873.822570:0:6709:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8cb06f613800 using connection 192.168.204.138@tcp/0@lo 00000100:00100000:0.0:1788796873.822671:0:6709:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cb06f609c00 x1875689374492672/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788796873.822692:0:6709:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1788796873.822732:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb06f609c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3299:1875689374492672:0@lo:38: 00000100:00100000:1.0:1788796873.822806:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788796873.822896:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374492672 00000100:00100000:1.0:1788796873.822903:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374492672 00000100:00100000:1.0:1788796873.822945:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788796873.822952:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0498ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3299:x1875689374492672:12345-0@lo:38: 00010000:00080000:1.0:1788796873.822987:0:5826:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 162 last 0 00000020:00000080:1.0:1788796873.823047:0:5826:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xca7fc0c411f933c7 00000004:00100000:1.0:1788796873.823065:0:5826:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788796873.823099:0:5826:0:(import.c:65:import_set_state_nolock()) ffff8cb0812cc800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788796873.823159:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0498ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1875689374492672:12345-0@lo:38: Request processed in 205us (352us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796873.823167:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1788796873.823214:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8cb06f609c00 x1875689374492672/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788796883 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788796873.823225:0:3299:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788796873.823234:0:3299:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000040:00080000:0.0:1788796873.823234:0:6709:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000100:00080000:1.0:1788796873.823241:0:3299:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1788796873.823248:0:3299:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788796873.823250:0:3299:0:(import.c:65:import_set_state_nolock()) ffff8cb06f613800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788796873.823257:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb06f609c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3299:1875689374492672:0@lo:38: 00000020:01000000:3.0:1788796873.823375:0:6679:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:3.0:1788796873.823403:0:6679:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.138@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788796873.823423:0:6679:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.138@tcp lock: ffff8cb082045600/0xca7fc0c411f933ab lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xca7fc0c411f933b2 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796873.823439:0:6679:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.138@tcp lock: ffff8cb082045600/0xca7fc0c411f933ab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xca7fc0c411f933b2 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1788796873.823482:0:6679:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1788796873.823484:0:6679:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788796873.823486:0:6679:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788796873.823487:0:6679:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788796873.823488:0:6679:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788796873.823490:0:6679:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788796873.823492:0:6679:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788796873.823493:0:6679:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788796873.823494:0:6679:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788796873.823496:0:6679:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788796873.823497:0:6679:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788796873.823501:0:6679:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:3.0:1788796873.823503:0:6679:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788796873.823505:0:6679:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788796873.823506:0:6679:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788796873.823507:0:6679:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788796873.823508:0:6679:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788796873.823509:0:6679:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788796873.823510:0:6679:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788796873.823511:0:6679:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788796873.823512:0:6679:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788796873.823513:0:6679:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788796873.823514:0:6679:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788796873.823530:0:6679:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1788796873.823541:0:6679:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb0774e7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:6679:1875689374492800:0@lo:253: 00000100:00100000:3.0:1788796873.823578:0:6679:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796873.823685:0:6679:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb048bf7f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788796873.823732:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374492800 00000100:00100000:0.0:1788796873.823737:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374492800 00000100:00100000:0.0:1788796873.823776:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788796873.823783:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0465df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+16:6679:x1875689374492800:12345-0@lo:253: 20000000:01000000:0.0:1788796873.823810:0:5820:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1788796873.823820:0:5820:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1788796873.861163:0:5820:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788796873.861176:0:5820:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:2.0:1788796873.861183:0:5841:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788796873.861187:0:5841:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788796873.861208:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cb041485600/0xca7fc0c411f933ce lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796873.861227:0:5841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cb041484a00/0xca7fc0c411f932ee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xca7fc0c411f932e7 expref: 16 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796873.861237:0:5841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8cb041485600/0xca7fc0c411f933ce lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796873.861310:0:5841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cb041484a00/0xca7fc0c411f932ee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xca7fc0c411f932e7 expref: 16 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796873.861324:0:5841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cb041484a00/0xca7fc0c411f932ee lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xca7fc0c411f932e7 expref: 16 pid: 5820 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788796873.861339:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb048e2a680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5841:1875689374492928:0@lo:104: 00000100:00100000:2.0:1788796873.861486:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788796873.861556:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff8caf419b9900 going to sleep for 11 seconds 00000100:00100000:1.0:1788796873.862119:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374492928 00000100:00100000:1.0:1788796873.862128:0:5809:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374492928 00000100:00100000:1.0:1788796873.862171:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788796873.862179:0:5809:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb048e2bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+3:5841:x1875689374492928:12345-0@lo:104: 00010000:00010000:1.0:1788796873.862192:0:5809:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.138@tcp lock: ffff8cb040030800/0xca7fc0c411f932e7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xca7fc0c411f932ee expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796873.862397:0:5809:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788796873.862404:0:5809:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb048e2bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+3:5841:x1875689374492928:12345-0@lo:104: Request processed in 226us (919us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796873.862412:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788796873.863217:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb048e2a680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5841:1875689374492928:0@lo:104: 00010000:00010000:0.0:1788796873.863240:0:5841:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8cb041485600/0xca7fc0c411f933ce lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796873.863355:0:5815:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788796873.863362:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.138@tcp lock: ffff8cb040030800/0xca7fc0c411f932e7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xca7fc0c411f932ee expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796873.863370:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb040030800 already unused, calling callback (ffffffffc1adac20) 10000000:00010000:3.0:1788796873.863385:0:5815:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.138@tcp lock: ffff8cb040030800/0xca7fc0c411f932e7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xca7fc0c411f932ee expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796873.863395:0:5815:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.138@tcp lock: ffff8cb040030800/0xca7fc0c411f932e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xca7fc0c411f932ee expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788796873.863478:0:5815:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.138@tcp lock: ffff8cb040030800/0xca7fc0c411f932e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xca7fc0c411f932ee expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788796873.863484:0:5815:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788796873.863529:0:5815:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.138@tcp lock: ffff8cb040030800/0xca7fc0c411f932e7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca7fc0c411f932ee expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796873.863536:0:5815:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788796873.863566:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.138@tcp lock: ffff8cb040030800/0xca7fc0c411f932e7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca7fc0c411f932ee expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796873.863573:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.138@tcp lock: ffff8cb040030800/0xca7fc0c411f932e7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca7fc0c411f932ee expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796873.863590:0:5815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788796873.863592:0:5815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788796873.863594:0:5815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788796873.863600:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb0774e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:3301:1875689374493056:0@lo:103: 00000100:00100000:2.0:1788796873.863649:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796873.863787:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374493056 00000100:00100000:3.0:1788796873.863794:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374493056 00010000:00010000:3.0:1788796873.863816:0:5813:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cb041484a00/0xca7fc0c411f932ee lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xca7fc0c411f932e7 expref: 17 pid: 5820 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788796873.863885:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788796873.863894:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb042eda050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+17:3301:x1875689374493056:12345-0@lo:103: 00010000:00010000:3.0:1788796873.863906:0:5813:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788796873.863919:0:5813:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cb041484a00/0xca7fc0c411f932ee lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xca7fc0c411f932e7 expref: 17 pid: 5820 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796873.863929:0:5813:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cb041484a00/0xca7fc0c411f932ee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xca7fc0c411f932e7 expref: 17 pid: 5820 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796873.863942:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cb041484a00/0xca7fc0c411f932ee lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xca7fc0c411f932e7 expref: 17 pid: 5820 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796873.863955:0:5813:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8cb041485600/0xca7fc0c411f933ce lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796873.863964:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cb041485600/0xca7fc0c411f933ce lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788796873.863978:0:5813:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002791802s 00010000:00010000:3.0:1788796873.863983:0:5813:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cb041485600/0xca7fc0c411f933ce lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796873.863990:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cb041485600/0xca7fc0c411f933ce lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796873.863997:0:5813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cb041485600/0xca7fc0c411f933ce lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796873.864003:0:5813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cb041485600/0xca7fc0c411f933ce lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796873.864009:0:5813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb041485600 already unused, calling callback (ffffffffc14d98b0) 00010000:00010000:3.0:1788796873.864013:0:5813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cb041485600/0xca7fc0c411f933ce lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796873.864055:0:5813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cb041485600/0xca7fc0c411f933ce lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796873.864078:0:5813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cb041485600/0xca7fc0c411f933ce lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796873.864088:0:5813:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788796873.864124:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb042eda050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+16:3301:x1875689374493056:12345-0@lo:103: Request processed in 232us (475us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796873.864132:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:1.0:1788796873.864496:0:5841:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8cb041485600/0xca7fc0c411f933ce lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796873.864505:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cb041485600/0xca7fc0c411f933ce lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796873.864511:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cb041485600/0xca7fc0c411f933ce lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788796873.866915:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb0774e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:3301:1875689374493056:0@lo:103: 00000100:00100000:0.0:1788796873.871115:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0465df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+15:6679:x1875689374492800:12345-0@lo:253: Request processed in 47322us (47525us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796873.871131:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788796873.871169:0:6679:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb0774e7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:6679:1875689374492800:0@lo:253: 10000000:01000000:3.0:1788796873.871186:0:6679:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1788796873.871189:0:6679:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788796873.871191:0:6679:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788796873.871192:0:6679:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788796873.871194:0:6679:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788796873.871195:0:6679:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788796873.871196:0:6679:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788796873.871198:0:6679:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788796873.871199:0:6679:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788796873.871201:0:6679:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788796873.871202:0:6679:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788796873.871204:0:6679:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1788796873.871304:0:6679:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1788796873.878535:0:6679:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:3.0:1788796873.879488:0:6679:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1788796873.879832:0:6679:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1788796873.882954:0:6679:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1788796873.883255:0:6679:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:2.0:1788796873.883538:0:6679:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:3.0:1788796873.884979:0:6679:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:3.0:1788796874.004594:0:6679:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:3.0:1788796874.004602:0:6679:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:3.0:1788796874.004638:0:6679:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1788796874.004707:0:6679:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.138@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1788796874.004723:0:6679:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=48 00000080:00000004:3.0:1788796874.004883:0:6679:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:1.0:1788796874.546327:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788796875.575713:0:5815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788796876.598450:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788796877.620133:0:5815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788796878.642719:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788796878.906995:0:467:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788796878.907008:0:467:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1788796878.907013:0:467:0:(import.c:65:import_set_state_nolock()) ffff8cb0812ce000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788796878.907024:0:467:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 162 00000100:00080000:1.0:1788796878.907057:0:467:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788796878.907073:0:467:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8cb0812ce000 using connection 192.168.204.138@tcp/0@lo 00000100:00100000:1.0:1788796878.907103:0:467:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cb0498ed880 x1875689374493440/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788796878.907259:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb0498ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3299:1875689374493440:0@lo:8: 00000100:00100000:1.0:1788796878.907384:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788796878.907725:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb0498edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3300:1875689374493568:0@lo:400: 00000100:00100000:1.0:1788796878.907759:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788796878.907798:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374493568 00000100:00100000:1.0:1788796878.907806:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374493568 00000100:00100000:1.0:1788796878.907938:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788796878.907947:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0498efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1875689374493568:12345-0@lo:400: 00000100:00100000:1.0:1788796878.908015:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0498efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1875689374493568:12345-0@lo:400: Request processed in 69us (255us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796878.908022:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:1.0:1788796878.908074:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1788796878.908181:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cb0498edc00 x1875689374493568/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788796894 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788796878.908198:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb0498edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3300:1875689374493568:0@lo:400: 00000100:00100000:2.0:1788796878.908368:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb0498eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875689374493312:0@lo:400: 00000100:00100000:2.0:1788796878.908401:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788796878.908445:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788796878.908452:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb0498ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:3303:1875689374493184:0@lo:400: 00000100:00100000:2.0:1788796878.908478:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788796878.908535:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374493184 00000100:00100000:2.0:1788796878.908539:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374493184 00000100:00100000:2.0:1788796878.908569:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788796878.908576:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0465ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+15:3303:x1875689374493184:12345-0@lo:400: 00000100:00100000:2.0:1788796878.908612:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0465ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+15:3303:x1875689374493184:12345-0@lo:400: Request processed in 36us (132us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796878.908626:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788796878.908661:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb0498ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:3303:1875689374493184:0@lo:400: 00000100:00100000:2.0:1788796878.908771:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374493312 00000100:00100000:2.0:1788796878.908775:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374493312 00000100:00100000:2.0:1788796878.908800:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788796878.908806:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb048e28e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875689374493312:12345-0@lo:400: 00000100:00100000:2.0:1788796878.909674:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb048e28e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875689374493312:12345-0@lo:400: Request processed in 864us (1269us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796878.909683:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1788796878.909766:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cb0498eed80 x1875689374493312/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788796894 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788796878.909778:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb0498eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875689374493312:0@lo:400: 00000100:00100000:0.0:1788796878.909866:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374493440 00000100:00100000:0.0:1788796878.909871:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374493440 00000100:00100000:0.0:1788796878.909902:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788796878.909908:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0498ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3299:x1875689374493440:12345-0@lo:8: 00010000:00080000:0.0:1788796878.909932:0:6684:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 167 last 0 00000020:00000080:0.0:1788796878.909960:0:6684:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xca7fc0c411f933d5 00002000:00100000:0.0:1788796878.909998:0:6684:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff8cb06f610800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:0.0:1788796878.910002:0:6684:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00000001:00000004:0.0:1788796878.910006:0:6684:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:0.0:1788796878.911580:0:6684:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1788796878.912277:0:6684:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1788796878.912320:0:6684:0:(import.c:65:import_set_state_nolock()) ffff8cb06f611000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788796878.912433:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0498ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3299:x1875689374493440:12345-0@lo:8: Request processed in 2521us (5050us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796878.912443:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1788796878.912538:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cb0498ed880 x1875689374493440/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788796893 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788796878.912550:0:3299:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788796878.912561:0:3299:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1788796878.912571:0:3299:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1788796878.912575:0:3299:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1788796878.912578:0:3299:0:(import.c:65:import_set_state_nolock()) ffff8cb0812ce000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1788796878.912601:0:3299:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1788796878.912607:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb0498ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3299:1875689374493440:0@lo:8: 00000004:00080000:0.0:1788796878.912777:0:6701:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1788796878.917104:0:6701:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 167923069620ns, next at 0ns, rc = 0 00000004:00080000:2.0:1788796879.003747:0:6702:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:2.0:1788796879.003780:0:6702:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb048e2b100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6702:1875689374493824:0@lo:7: 00000100:00100000:1.0:1788796879.003803:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb048e29f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875689374493696:0@lo:13: 00000100:00100000:1.0:1788796879.003862:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788796879.003950:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374493696 00000100:00100000:1.0:1788796879.003958:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374493696 00000100:00100000:2.0:1788796879.004019:0:6702:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788796879.004091:0:6702:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb06f1cf900 going to sleep for 11 seconds 00000100:00100000:1.0:1788796879.004120:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788796879.004132:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0498ed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3301:x1875689374493696:12345-0@lo:13: 00002000:00000024:1.0:1788796879.004197:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:1.0:1788796879.004382:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0498ed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3301:x1875689374493696:12345-0@lo:13: Request processed in 252us (520us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796879.004390:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788796879.004423:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374493824 00000100:00100000:1.0:1788796879.004428:0:6683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374493824 00000100:00100000:1.0:1788796879.004455:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788796879.004528:0:6683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb048e2b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:6702:x1875689374493824:12345-0@lo:7: 00000100:00080000:3.0:1788796879.006860:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788796879.010347:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cb048e29f80 x1875689374493696/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788796895 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788796879.010377:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb048e29f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875689374493696:0@lo:13: 00002000:00080000:1.0:1788796879.011417:0:6683:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:1.0:1788796879.011424:0:6683:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:1.0:1788796879.011578:0:6683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb048e2b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:6702:x1875689374493824:12345-0@lo:7: Request processed in 7113us (7559us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796879.011588:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1788796879.011820:0:6702:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cb048e2b100 x1875689374493824/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788796895 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788796879.011836:0:6702:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb048e2b100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6702:1875689374493824:0@lo:7: 00000004:00080000:3.0:1788796879.011853:0:6702:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:3.0:1788796879.011957:0:6702:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb0774e7480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6702:1875689374493952:0@lo:5: 00000100:00100000:3.0:1788796879.011999:0:6702:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796879.012084:0:6702:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb04919aa80 going to sleep for 11 seconds 00000100:00100000:1.0:1788796879.012143:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374493952 00000100:00100000:1.0:1788796879.012148:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374493952 00000100:00100000:1.0:1788796879.012196:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788796879.012203:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0774e5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6702:x1875689374493952:12345-0@lo:5: 00002000:00080000:1.0:1788796879.012225:0:6684:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:1.0:1788796879.012228:0:6684:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000100:00100000:1.0:1788796879.012445:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0774e5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:6702:x1875689374493952:12345-0@lo:5: Request processed in 242us (445us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1788796879.012451:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1788796879.012492:0:6702:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cb0774e7480 x1875689374493952/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788796895 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788796879.012518:0:6702:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb0774e7480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6702:1875689374493952:0@lo:5: 00000004:00080000:1.0:1788796879.012528:0:6702:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:1.0:1788796879.012551:0:6702:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb0498eed80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6702:1875689374494080:0@lo:700: 00000100:00100000:1.0:1788796879.012576:0:6702:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788796879.012604:0:6702:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb081353180 going to sleep for 11 seconds 00000100:00100000:3.0:1788796879.018344:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374494080 00000100:00100000:3.0:1788796879.018360:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374494080 00000100:00100000:3.0:1788796879.018419:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788796879.018429:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0498edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:6702:x1875689374494080:12345-0@lo:700: 00000100:00100000:3.0:1788796879.018496:0:6690:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb0774e4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6690:1875689374494208:0@lo:700: 00000100:00100000:3.0:1788796879.018568:0:6690:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788796879.018879:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374494208 00000100:00100000:2.0:1788796879.018884:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374494208 00000100:00100000:2.0:1788796879.018916:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788796879.018923:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0774e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6690:x1875689374494208:12345-0@lo:700: 00000100:00100000:3.0:1788796879.019802:0:6690:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb04919a840 going to sleep for 11 seconds 00000004:00080000:0.0:1788796879.043285:0:5848:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 40000000:02000000:0.0:1788796879.071900:0:5832:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost 00000100:00100000:1.0:1788796879.080194:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0774e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6690:x1875689374494208:12345-0@lo:700: Request processed in 61265us (61620us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796879.080216:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1788796879.080460:0:6690:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cb0774e4a80 x1875689374494208/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788796895 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788796879.080476:0:6690:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb0774e4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6690:1875689374494208:0@lo:700: 40000000:02000000:3.0:1788796879.080503:0:6690:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] 00000001:00100000:0.0:1788796879.153810:0:6713:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:0.0:1788796879.153833:0:6713:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000100:00100000:1.0:1788796879.153977:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0498edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:6702:x1875689374494080:12345-0@lo:700: Request processed in 135544us (141394us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796879.153994:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1788796879.154096:0:6702:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cb0498eed80 x1875689374494080/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788796895 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788796879.154108:0:6702:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:3.0:1788796879.154126:0:6702:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb0498eed80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6702:1875689374494080:0@lo:700: 00000004:02000040:3.0:1788796879.179752:0:6702:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 00000100:00100000:2.0:1788796879.185633:0:6702:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb048e29500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6702:1875689374494336:0@lo:5: 00000100:00100000:2.0:1788796879.185716:0:6702:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788796879.185792:0:6702:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb06f1cfb40 going to sleep for 11 seconds 00000100:00100000:3.0:1788796879.185795:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374494336 00000100:00100000:3.0:1788796879.185812:0:6683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374494336 00000100:00100000:3.0:1788796879.186335:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788796879.186352:0:6683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb048e2b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:6702:x1875689374494336:12345-0@lo:5: 00002000:00080000:0.0:1788796879.195404:0:6683:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:0.0:1788796879.195426:0:6683:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 2 00000100:00100000:0.0:1788796879.202899:0:6683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb048e2b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:6702:x1875689374494336:12345-0@lo:5: Request processed in 16544us (17174us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1788796879.202912:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1788796879.202983:0:6702:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cb048e29500 x1875689374494336/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788796895 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788796879.203002:0:6702:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb048e29500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6702:1875689374494336:0@lo:5: 00000004:00080000:0.0:1788796879.203018:0:6702:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x1:0x0]-[0x240000400:0x21:0x0] 00000001:02000400:3.0:1788796879.470635:0:7055:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg438-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1788796879.674787:0:5815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788796880.692768:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788796881.714535:0:5815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788796882.740910:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788796882.995687:0:5822:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788796882.995695:0:5822:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8cb042f0b000 from 4 10000000:01000000:2.0:1788796882.995701:0:5822:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788796882.995763:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.138@tcp lock: ffff8cb041484200/0xca7fc0c411f933dc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796882.995775:0:5822:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.138@tcp lock: ffff8cb041484200/0xca7fc0c411f933dc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796882.995803:0:5822:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.138@tcp lock: ffff8cb041484200/0xca7fc0c411f933dc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788796882.995827:0:5822:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb048e29f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:5822:1875689374494464:0@lo:101: 00000100:00100000:2.0:1788796882.995907:0:5822:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788796882.995963:0:5822:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb04370f6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788796882.996268:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374494464 00000100:00100000:1.0:1788796882.996277:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374494464 00000100:00100000:1.0:1788796882.996333:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788796882.996343:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb06cfc5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+15:5822:x1875689374494464:12345-0@lo:101: 00010000:00010000:1.0:1788796882.996358:0:5820:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788796882.996372:0:5820:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cb0821f1c00/0xca7fc0c411f933e3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xca7fc0c411f933dc expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796882.996398:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cb0821f1c00/0xca7fc0c411f933e3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xca7fc0c411f933dc expref: 16 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796882.996420:0:5820:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cb0821f1c00/0xca7fc0c411f933e3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xca7fc0c411f933dc expref: 16 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796882.996438:0:5820:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb0821f1c00, rc 0) 00000100:00100000:1.0:1788796882.996487:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb06cfc5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+16:5822:x1875689374494464:12345-0@lo:101: Request processed in 146us (581us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796882.996494:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788796882.996879:0:5822:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb048e29f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:5822:1875689374494464:0@lo:101: 00010000:00010000:3.0:1788796882.996897:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.138@tcp lock: ffff8cb041484200/0xca7fc0c411f933dc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xca7fc0c411f933e3 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796882.996907:0:5822:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.138@tcp lock: ffff8cb041484200/0xca7fc0c411f933dc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xca7fc0c411f933e3 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788796882.996967:0:5822:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb0774e7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:5822:1875689374494592:0@lo:256: 00000100:00100000:3.0:1788796882.997005:0:5822:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796882.997066:0:5822:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb048fde0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788796882.997233:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374494592 00000100:00100000:1.0:1788796882.997240:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374494592 00000100:00100000:1.0:1788796882.997273:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788796882.997281:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0585b2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+16:5822:x1875689374494592:12345-0@lo:256: 20000000:01000000:1.0:1788796882.997295:0:5819:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788796882.997312:0:5819:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788796882.997315:0:5819:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:1.0:1788796882.997397:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0585b2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+16:5822:x1875689374494592:12345-0@lo:256: Request processed in 116us (391us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796882.997416:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788796882.998154:0:5822:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb0774e7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:5822:1875689374494592:0@lo:256: 10000000:01000000:3.0:1788796882.998226:0:5822:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.138@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788796882.998236:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.138@tcp lock: ffff8cb041484200/0xca7fc0c411f933dc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xca7fc0c411f933e3 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796882.998245:0:5822:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.138@tcp lock: ffff8cb041484200/0xca7fc0c411f933dc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xca7fc0c411f933e3 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796883.765962:0:5815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788796884.018294:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb06f60a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875689374494976:0@lo:400: 00000100:00100000:0.0:1788796884.018311:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb06f60a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:3302:1875689374494720:0@lo:400: 00000100:00100000:1.0:1788796884.018461:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb06f609c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3301:1875689374495104:0@lo:400: 00000100:00100000:0.0:1788796884.023403:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788796884.023500:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb0774e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875689374495232:0@lo:13: 00000100:00100000:0.0:1788796884.023537:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788796884.023563:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788796884.023570:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb06f609f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875689374494848:0@lo:400: 00000100:00100000:0.0:1788796884.023595:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796884.023613:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374494720 00000100:00100000:3.0:1788796884.023623:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374494720 00000100:00100000:3.0:1788796884.023675:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788796884.023685:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0585b2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+16:3302:x1875689374494720:12345-0@lo:400: 00000100:00100000:0.0:1788796884.023720:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374495232 00000100:00100000:0.0:1788796884.023726:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374495232 00000100:00100000:3.0:1788796884.023745:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0585b2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+16:3302:x1875689374494720:12345-0@lo:400: Request processed in 61us (351us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796884.023765:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788796884.023769:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788796884.023778:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb06f609880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3302:x1875689374495232:12345-0@lo:13: 00002000:00000024:0.0:1788796884.023809:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:3.0:1788796884.023810:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788796884.023852:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb06f609880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3302:x1875689374495232:12345-0@lo:13: Request processed in 76us (314us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796884.023859:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788796884.023881:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374494848 00000100:00100000:0.0:1788796884.023886:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374494848 00000100:00100000:0.0:1788796884.023923:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788796884.023932:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb06f60b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875689374494848:12345-0@lo:400: 00000100:00100000:0.0:1788796884.023973:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb06f60b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875689374494848:12345-0@lo:400: Request processed in 43us (376us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796884.023980:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1788796884.024162:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cb06f609f80 x1875689374494848/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788796900 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788796884.024177:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb06f609f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875689374494848:0@lo:400: 00010000:00080000:0.0:1788796884.024190:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cb0774e7480 x1875689374495232/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788796900 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788796884.024207:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb0774e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875689374495232:0@lo:13: 00000100:00100000:0.0:1788796884.024221:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb06f60a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:3302:1875689374494720:0@lo:400: 00000100:00100000:1.0:1788796884.027599:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788796884.027676:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374495104 00000100:00100000:1.0:1788796884.027687:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374495104 00000100:00100000:1.0:1788796884.027750:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788796884.027760:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0498eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1875689374495104:12345-0@lo:400: 00000100:00100000:1.0:1788796884.027811:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0498eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1875689374495104:12345-0@lo:400: Request processed in 54us (220us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796884.027818:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:1.0:1788796884.027852:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1788796884.027878:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cb06f609c00 x1875689374495104/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788796900 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788796884.027922:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb06f609c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3301:1875689374495104:0@lo:400: 00000100:00100000:2.0:1788796884.028781:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796884.028949:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374494976 00000100:00100000:3.0:1788796884.028963:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374494976 00000100:00100000:3.0:1788796884.029070:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788796884.029089:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb048e2a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3300:x1875689374494976:12345-0@lo:400: 00000100:00100000:3.0:1788796884.029138:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb048e2a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3300:x1875689374494976:12345-0@lo:400: Request processed in 52us (359us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796884.029145:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1788796884.029231:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cb06f60a300 x1875689374494976/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788796900 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788796884.029253:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb06f60a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875689374494976:0@lo:400: 00000001:00080000:0.0:1788796884.617793:0:6713:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00010000:00010000:2.0:1788796884.787680:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788796885.810247:0:5815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788796886.835208:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788796887.862136:0:5815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788796888.882767:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788796889.145363:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb0774e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875689374495360:0@lo:13: 00000100:00100000:3.0:1788796889.145446:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796889.145537:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374495360 00000100:00100000:3.0:1788796889.145544:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374495360 00000100:00100000:3.0:1788796889.145596:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788796889.145605:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0774e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875689374495360:12345-0@lo:13: 00002000:00000024:3.0:1788796889.145641:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788796889.145688:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0774e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875689374495360:12345-0@lo:13: Request processed in 84us (241us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796889.145694:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:3.0:1788796889.145716:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788796889.145749:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cb0774e4a80 x1875689374495360/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788796905 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788796889.145758:0:3303:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:3.0:1788796889.145782:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb0774e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875689374495360:0@lo:13: 00000100:00100000:3.0:1788796889.147238:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb0774e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3301:1875689374495616:0@lo:400: 00000100:00100000:3.0:1788796889.147300:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796889.147344:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788796889.147351:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb0774e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:3301:1875689374495488:0@lo:400: 00000100:00100000:3.0:1788796889.147381:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796889.147418:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb0774e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3302:1875689374495744:0@lo:400: 00000100:00100000:3.0:1788796889.147443:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796889.147478:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374495616 00000100:00100000:3.0:1788796889.147484:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374495616 00000100:00100000:3.0:1788796889.147521:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374495744 00000100:00100000:3.0:1788796889.147523:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374495744 00000100:00100000:3.0:1788796889.147544:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788796889.147552:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0774e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1875689374495616:12345-0@lo:400: 00000100:00100000:3.0:1788796889.147594:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0774e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1875689374495616:12345-0@lo:400: Request processed in 43us (294us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796889.147601:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788796889.147615:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788796889.147620:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0774e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1875689374495744:12345-0@lo:400: 00000100:00100000:3.0:1788796889.147649:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0774e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1875689374495744:12345-0@lo:400: Request processed in 28us (205us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796889.147654:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:3.0:1788796889.147673:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1788796889.147696:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cb0774e6d80 x1875689374495744/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788796905 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788796889.147708:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb0774e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3302:1875689374495744:0@lo:400: 00010000:00080000:3.0:1788796889.147735:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cb0774e4380 x1875689374495616/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788796905 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788796889.147744:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb0774e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3301:1875689374495616:0@lo:400: 00000100:00100000:1.0:1788796889.150158:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374495488 00000100:00100000:1.0:1788796889.150175:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374495488 00000100:00100000:1.0:1788796889.150245:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788796889.150257:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0585b0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+16:3301:x1875689374495488:12345-0@lo:400: 00000100:00100000:1.0:1788796889.151469:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0585b0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+16:3301:x1875689374495488:12345-0@lo:400: Request processed in 1210us (4082us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796889.151481:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788796889.151553:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb0774e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:3301:1875689374495488:0@lo:400: 00010000:00010000:1.0:1788796889.906279:0:5815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788796890.930524:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1788796891.733485:0:7623:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1788796891.733489:0:7623:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:1.0:1788796891.733738:0:7623:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8cb042fd2800 00000020:01000004:1.0:1788796891.733757:0:7623:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:1.0:1788796891.733770:0:7623:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:1.0:1788796891.733785:0:7623:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff8cb0499319c0) 00000020:00000080:1.0:1788796891.733801:0:7623:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1788796891.763278:0:7623:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:0.0:1788796891.763948:0:7623:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:3.0:1788796891.801177:0:7623:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:3.0:1788796891.807424:0:7623:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1788796891.807463:0:7623:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:3.0:1788796891.807524:0:7623:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1788796891.807550:0:7623:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:3.0:1788796891.808074:0:7623:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:3.0:1788796891.808089:0:7623:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788796891.808099:0:7623:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xca7fc0c411f933f1 00000020:01000004:3.0:1788796891.808107:0:7623:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:3.0:1788796891.808128:0:7623:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.138@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1788796891.808132:0:7623:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.138@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1788796891.808371:0:7623:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0001 00000020:01000004:3.0:1788796891.808393:0:7623:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:3.0:1788796891.808397:0:7623:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.138@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:2.0:1788796891.833760:0:7623:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.138@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788796891.833807:0:7623:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.204.138@tcp, index=0001, flags=0x20062 00000020:01000004:2.0:1788796891.833812:0:7623:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788796891.833815:0:7623:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788796891.833816:0:7623:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788796891.833817:0:7623:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788796891.833818:0:7623:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788796891.833820:0:7623:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788796891.833821:0:7623:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788796891.833823:0:7623:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788796891.833824:0:7623:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788796891.833826:0:7623:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788796891.833828:0:7623:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788796891.833832:0:7623:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:2.0:1788796891.833835:0:7623:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788796891.833836:0:7623:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788796891.833837:0:7623:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788796891.833843:0:7623:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788796891.833844:0:7623:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788796891.833846:0:7623:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788796891.833847:0:7623:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788796891.833848:0:7623:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788796891.833849:0:7623:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788796891.833850:0:7623:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788796891.833851:0:7623:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788796891.833883:0:7623:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1788796891.833909:0:7623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb048e2a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:7623:1875689374495872:0@lo:253: 00000100:00100000:2.0:1788796891.834016:0:7623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788796891.834307:0:7623:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb046bf0300 going to sleep for 11 seconds 00000100:00100000:3.0:1788796891.834453:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374495872 00000100:00100000:3.0:1788796891.834462:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374495872 00000100:00100000:3.0:1788796891.834623:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788796891.834635:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0585b2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+16:7623:x1875689374495872:12345-0@lo:253: 20000000:01000000:3.0:1788796891.834752:0:5819:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:3.0:1788796891.834757:0:5819:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:3.0:1788796891.834763:0:5819:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:3.0:1788796891.834768:0:5819:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:2.0:1788796891.840786:0:5819:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788796891.841317:0:5819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:2.0:1788796891.841335:0:5819:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:2.0:1788796891.841378:0:5819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:2.0:1788796891.841385:0:5819:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:2.0:1788796891.841412:0:5819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:2.0:1788796891.841453:0:5819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:2.0:1788796891.842460:0:5819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:2.0:1788796891.842490:0:5819:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.204.138@tcp 20000000:01000000:2.0:1788796891.842493:0:5819:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.138@tcp (null) (null) (null) 00000040:00080000:2.0:1788796891.842555:0:5819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:2.0:1788796891.842562:0:5819:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1788796891.842611:0:5819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:2.0:1788796891.842620:0:5819:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.204.138@tcp (null) (null) 00000040:00080000:2.0:1788796891.842728:0:5819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:2.0:1788796891.842739:0:5819:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:2.0:1788796891.842771:0:5819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:2.0:1788796891.842832:0:5819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:2.0:1788796891.844184:0:5819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13416 20000000:01000000:2.0:1788796891.844220:0:5819:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.204.138@tcp 20000000:01000000:2.0:1788796891.844222:0:5819:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.138@tcp (null) (null) (null) 00000040:00080000:2.0:1788796891.844416:0:5819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13504 20000000:01000000:2.0:1788796891.844425:0:5819:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:2.0:1788796891.844456:0:5819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13632 20000000:01000000:2.0:1788796891.844463:0:5819:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.204.138@tcp (null) (null) 00000040:00080000:2.0:1788796891.844495:0:5819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13776 20000000:01000000:2.0:1788796891.844569:0:5819:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:2.0:1788796891.844626:0:5819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13904 00000040:00080000:2.0:1788796891.848403:0:5819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14128 20000000:01000000:2.0:1788796891.848448:0:5819:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'autodegrade=on' 20000000:01000000:2.0:1788796891.848451:0:5819:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 20000000:01000000:2.0:1788796891.848457:0:5819:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:2.0:1788796891.848459:0:5819:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1788796891.848462:0:5819:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1788796891.848477:0:5819:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1788796891.848479:0:5819:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:2.0:1788796891.848772:0:5819:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:2.0:1788796891.848775:0:5819:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:0.0:1788796891.849603:0:7625:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:2.0:1788796891.849973:0:5819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:2.0:1788796891.850017:0:5819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:2.0:1788796891.850148:0:5819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:2.0:1788796891.850162:0:5819:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1788796891.850165:0:5819:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:2.0:1788796891.853486:0:7626:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 14 1->4: lustre sys.timeout 20000000:01000000:2.0:1788796891.853754:0:7626:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 14 2->4: lustre sys.timeout 00000040:00080000:2.0:1788796891.853815:0:7626:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:1.0:1788796891.854464:0:5819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:1.0:1788796891.854579:0:5819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:1.0:1788796891.854745:0:5819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:1.0:1788796891.854762:0:5819:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1788796891.854765:0:5819:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:1.0:1788796891.857817:0:7627:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 15 1->4: lustre sys.timeout 20000000:01000000:1.0:1788796891.857899:0:7627:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 15 2->4: lustre sys.timeout 00000040:00080000:1.0:1788796891.857968:0:7627:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:2.0:1788796891.858474:0:5819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14352 00000040:00080000:2.0:1788796891.858528:0:5819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14432 00000040:00080000:2.0:1788796891.858561:0:5819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14656 20000000:01000000:2.0:1788796891.858575:0:5819:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:2.0:1788796891.858578:0:5819:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1788796891.860943:0:7628:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 16 1->4: lustre sys.timeout 20000000:01000000:1.0:1788796891.861084:0:7628:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 16 2->4: lustre sys.timeout 00000040:00080000:1.0:1788796891.861120:0:7628:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 8 count 8 00000040:00080000:3.0:1788796891.861602:0:5819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 224 off9632 00000040:00080000:3.0:1788796891.861645:0:5819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 80 off9712 00000040:00080000:3.0:1788796891.861830:0:5819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off9936 10000000:01000000:3.0:1788796891.861849:0:5819:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1788796891.861869:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cb080437c00/0xca7fc0c411f933f8 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796891.861896:0:5819:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cb082044600/0xca7fc0c411f9331f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xca7fc0c411f93318 expref: 16 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796891.861904:0:5819:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cb082045200/0xca7fc0c411f9332d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xca7fc0c411f93326 expref: 16 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796891.861911:0:5819:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cb040030000/0xca7fc0c411f9337a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xca7fc0c411f93373 expref: 16 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796891.861917:0:5819:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cb041484c00/0xca7fc0c411f93388 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xca7fc0c411f93381 expref: 16 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796891.861935:0:5819:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cb041485c00/0xca7fc0c411f933b2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xca7fc0c411f933ab expref: 16 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796891.861942:0:5819:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8cb080437c00/0xca7fc0c411f933f8 lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796891.861980:0:5819:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cb041485c00/0xca7fc0c411f933b2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xca7fc0c411f933ab expref: 16 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796891.861997:0:5819:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cb041485c00/0xca7fc0c411f933b2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xca7fc0c411f933ab expref: 16 pid: 5819 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788796891.862011:0:5819:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb0774e4380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5819:1875689374496000:0@lo:104: 00000100:00100000:3.0:1788796891.862220:0:5819:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788796891.862365:0:5819:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cb041484c00/0xca7fc0c411f93388 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xca7fc0c411f93381 expref: 16 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796891.862374:0:5819:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cb041484c00/0xca7fc0c411f93388 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xca7fc0c411f93381 expref: 16 pid: 5819 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788796891.862392:0:5819:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb0774e6d80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5819:1875689374496128:0@lo:104: 00010000:00010000:3.0:1788796891.862416:0:5819:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cb040030000/0xca7fc0c411f9337a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xca7fc0c411f93373 expref: 16 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796891.862423:0:5819:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cb040030000/0xca7fc0c411f9337a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xca7fc0c411f93373 expref: 16 pid: 5818 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788796891.862431:0:5819:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb0774e4000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5819:1875689374496256:0@lo:104: 00010000:00010000:3.0:1788796891.862449:0:5819:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cb082045200/0xca7fc0c411f9332d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xca7fc0c411f93326 expref: 16 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796891.862456:0:5819:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cb082045200/0xca7fc0c411f9332d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xca7fc0c411f93326 expref: 16 pid: 5818 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788796891.862463:0:5819:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb0774e6a00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5819:1875689374496384:0@lo:104: 00010000:00010000:3.0:1788796891.862484:0:5819:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cb082044600/0xca7fc0c411f9331f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xca7fc0c411f93318 expref: 16 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796891.862491:0:5819:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cb082044600/0xca7fc0c411f9331f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xca7fc0c411f93318 expref: 16 pid: 5818 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788796891.862499:0:5819:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb0774e5500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5819:1875689374496512:0@lo:104: 00000100:00100000:3.0:1788796891.862528:0:5819:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb079a91f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788796891.864999:0:6697:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1788796891.865739:0:6697:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788796891.865838:0:6697:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788796891.865918:0:6697:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788796891.866014:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374496000 00000100:00100000:1.0:1788796891.866064:0:5809:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374496000 00000100:00100000:1.0:1788796891.866115:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374496128 00000100:00100000:1.0:1788796891.866118:0:5809:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374496128 00000100:00100000:1.0:1788796891.866126:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374496256 00000100:00100000:1.0:1788796891.866128:0:5809:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374496256 00000100:00100000:1.0:1788796891.866151:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788796891.866160:0:5809:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb048f05050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+5:5819:x1875689374496000:12345-0@lo:104: 00010000:00010000:1.0:1788796891.866179:0:5809:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.138@tcp lock: ffff8cb082045600/0xca7fc0c411f933ab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xca7fc0c411f933b2 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796891.866278:0:5809:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788796891.866284:0:5809:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb048f05050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+5:5819:x1875689374496000:12345-0@lo:104: Request processed in 126us (4064us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796891.866291:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788796891.866341:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788796891.866347:0:5809:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb06f60a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+4:5819:x1875689374496128:12345-0@lo:104: 00010000:00010000:1.0:1788796891.866355:0:5809:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.138@tcp lock: ffff8cb0821f0000/0xca7fc0c411f93381 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xca7fc0c411f93388 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796891.866388:0:5809:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788796891.866393:0:5809:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb06f60a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+4:5819:x1875689374496128:12345-0@lo:104: Request processed in 48us (661us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796891.866399:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788796891.866412:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788796891.866418:0:5809:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb06f609f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+3:5819:x1875689374496256:12345-0@lo:104: 00010000:00010000:1.0:1788796891.866425:0:5809:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.138@tcp lock: ffff8cb041484000/0xca7fc0c411f93373 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xca7fc0c411f9337a expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796891.866463:0:5809:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1788796891.866468:0:5809:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb06f609f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+3:5819:x1875689374496256:12345-0@lo:104: Request processed in 51us (631us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796891.866473:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:1.0:1788796891.866489:0:5815:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788796891.866495:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.138@tcp lock: ffff8cb082045600/0xca7fc0c411f933ab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xca7fc0c411f933b2 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796891.866501:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb082045600 already unused, calling callback (ffffffffc1adac20) 10000000:00010000:1.0:1788796891.866517:0:5815:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.138@tcp lock: ffff8cb082045600/0xca7fc0c411f933ab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xca7fc0c411f933b2 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796891.866526:0:5815:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.138@tcp lock: ffff8cb082045600/0xca7fc0c411f933ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xca7fc0c411f933b2 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788796891.866534:0:5815:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.138@tcp lock: ffff8cb082045600/0xca7fc0c411f933ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xca7fc0c411f933b2 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788796891.866540:0:5815:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788796891.866574:0:5815:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.138@tcp lock: ffff8cb082045600/0xca7fc0c411f933ab lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca7fc0c411f933b2 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796891.866581:0:5815:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788796891.866598:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.138@tcp lock: ffff8cb082045600/0xca7fc0c411f933ab lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca7fc0c411f933b2 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796891.866605:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.138@tcp lock: ffff8cb082045600/0xca7fc0c411f933ab lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca7fc0c411f933b2 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796891.866629:0:5815:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788796891.866633:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.138@tcp lock: ffff8cb0821f0000/0xca7fc0c411f93381 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xca7fc0c411f93388 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796891.866639:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb0821f0000 already unused, calling callback (ffffffffc1adac20) 10000000:00010000:1.0:1788796891.866642:0:5815:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.138@tcp lock: ffff8cb0821f0000/0xca7fc0c411f93381 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xca7fc0c411f93388 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796891.866659:0:5815:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.138@tcp lock: ffff8cb0821f0000/0xca7fc0c411f93381 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xca7fc0c411f93388 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788796891.866666:0:5815:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.138@tcp lock: ffff8cb0821f0000/0xca7fc0c411f93381 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xca7fc0c411f93388 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788796891.866672:0:5815:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788796891.866685:0:5815:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.138@tcp lock: ffff8cb0821f0000/0xca7fc0c411f93381 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca7fc0c411f93388 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796891.866691:0:5815:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788796891.866705:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.138@tcp lock: ffff8cb0821f0000/0xca7fc0c411f93381 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca7fc0c411f93388 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796891.866711:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.138@tcp lock: ffff8cb0821f0000/0xca7fc0c411f93381 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca7fc0c411f93388 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796891.866721:0:5815:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788796891.866724:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.138@tcp lock: ffff8cb041484000/0xca7fc0c411f93373 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xca7fc0c411f9337a expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796891.866738:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb041484000 already unused, calling callback (ffffffffc1adac20) 10000000:00010000:1.0:1788796891.866741:0:5815:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.138@tcp lock: ffff8cb041484000/0xca7fc0c411f93373 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xca7fc0c411f9337a expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796891.866748:0:5815:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.138@tcp lock: ffff8cb041484000/0xca7fc0c411f93373 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xca7fc0c411f9337a expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788796891.866755:0:5815:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.138@tcp lock: ffff8cb041484000/0xca7fc0c411f93373 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xca7fc0c411f9337a expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788796891.866760:0:5815:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788796891.866773:0:5815:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.138@tcp lock: ffff8cb041484000/0xca7fc0c411f93373 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca7fc0c411f9337a expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796891.866778:0:5815:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788796891.866784:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.138@tcp lock: ffff8cb041484000/0xca7fc0c411f93373 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca7fc0c411f9337a expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796891.866790:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.138@tcp lock: ffff8cb041484000/0xca7fc0c411f93373 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca7fc0c411f9337a expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796891.866799:0:5815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788796891.866801:0:5815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788796891.866803:0:5815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788796891.866810:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788796891.866832:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb0498ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:3303:1875689374496640:0@lo:103: 00000100:00100000:1.0:1788796891.866869:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788796891.866932:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb0498ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:3300:1875689374496768:0@lo:103: 00000100:00100000:1.0:1788796891.866965:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788796891.866985:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788796891.866990:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb0498ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:3300:1875689374496896:0@lo:103: 00000100:00100000:1.0:1788796891.867008:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788796891.867081:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374496640 00000100:00100000:1.0:1788796891.867088:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374496640 00010000:00010000:1.0:1788796891.867107:0:5812:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cb041485c00/0xca7fc0c411f933b2 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xca7fc0c411f933ab expref: 17 pid: 5819 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788796891.867126:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374496768 00000100:00100000:1.0:1788796891.867129:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374496768 00010000:00010000:1.0:1788796891.867154:0:5812:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cb041484c00/0xca7fc0c411f93388 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xca7fc0c411f93381 expref: 18 pid: 5819 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788796891.867164:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374496896 00000100:00100000:1.0:1788796891.867167:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374496896 00010000:00010000:1.0:1788796891.867176:0:5812:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cb040030000/0xca7fc0c411f9337a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xca7fc0c411f93373 expref: 19 pid: 5818 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788796891.867188:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788796891.867195:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0498eea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+19:3303:x1875689374496640:12345-0@lo:103: 00010000:00010000:1.0:1788796891.867205:0:5812:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788796891.867210:0:5812:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cb041485c00/0xca7fc0c411f933b2 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xca7fc0c411f933ab expref: 19 pid: 5819 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796891.867220:0:5812:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cb041485c00/0xca7fc0c411f933b2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xca7fc0c411f933ab expref: 19 pid: 5819 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796891.867238:0:5812:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788796891.867268:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0498eea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+19:3303:x1875689374496640:12345-0@lo:103: Request processed in 74us (398us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796891.867281:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788796891.867296:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788796891.867302:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0498ee300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+18:3300:x1875689374496768:12345-0@lo:103: 00010000:00010000:1.0:1788796891.867309:0:5812:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788796891.867314:0:5812:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cb041484c00/0xca7fc0c411f93388 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xca7fc0c411f93381 expref: 18 pid: 5819 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796891.867322:0:5812:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cb041484c00/0xca7fc0c411f93388 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xca7fc0c411f93381 expref: 18 pid: 5819 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796891.867332:0:5812:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788796891.867357:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0498ee300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+18:3300:x1875689374496768:12345-0@lo:103: Request processed in 56us (392us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796891.867363:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788796891.867374:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788796891.867380:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0498eca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+17:3300:x1875689374496896:12345-0@lo:103: 00010000:00010000:1.0:1788796891.867387:0:5812:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788796891.867390:0:5812:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cb040030000/0xca7fc0c411f9337a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xca7fc0c411f93373 expref: 17 pid: 5818 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796891.867399:0:5812:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cb040030000/0xca7fc0c411f9337a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xca7fc0c411f93373 expref: 17 pid: 5818 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796891.867407:0:5812:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788796891.867425:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0498eca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+17:3300:x1875689374496896:12345-0@lo:103: Request processed in 45us (416us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796891.867431:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788796891.867474:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb0498ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:3303:1875689374496640:0@lo:103: 00000100:00100000:1.0:1788796891.867507:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb0498ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:3300:1875689374496896:0@lo:103: 00000100:00100000:1.0:1788796891.867514:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb0498ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:3300:1875689374496768:0@lo:103: 00010000:00010000:1.0:1788796891.867537:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cb041485c00/0xca7fc0c411f933b2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xca7fc0c411f933ab expref: 16 pid: 5819 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788796891.867548:0:5819:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb0774e4380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5819:1875689374496000:0@lo:104: 00010000:00010000:1.0:1788796891.867557:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cb041484c00/0xca7fc0c411f93388 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xca7fc0c411f93381 expref: 15 pid: 5819 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788796891.867565:0:5819:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb0774e6d80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5819:1875689374496128:0@lo:104: 00010000:00010000:1.0:1788796891.867573:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cb040030000/0xca7fc0c411f9337a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xca7fc0c411f93373 expref: 14 pid: 5818 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788796891.867581:0:5819:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb0774e4000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5819:1875689374496256:0@lo:104: 00000100:00100000:0.0:1788796891.868455:0:6697:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796891.868530:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374496384 00000100:00100000:3.0:1788796891.868537:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374496384 00000100:00100000:3.0:1788796891.868568:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374496512 00000100:00100000:3.0:1788796891.868571:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374496512 00000100:00100000:3.0:1788796891.868585:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788796891.868603:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb06f608380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+4:5819:x1875689374496384:12345-0@lo:104: 00010000:00010000:3.0:1788796891.868618:0:5810:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.138@tcp lock: ffff8cb040031a00/0xca7fc0c411f93326 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xca7fc0c411f9332d expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796891.868703:0:5810:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788796891.868709:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb06f608380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+4:5819:x1875689374496384:12345-0@lo:104: Request processed in 109us (2790us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796891.868716:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788796891.868732:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788796891.868737:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb06f608a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+3:5819:x1875689374496512:12345-0@lo:104: 00010000:00010000:3.0:1788796891.868744:0:5810:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.138@tcp lock: ffff8cb041484400/0xca7fc0c411f93318 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xca7fc0c411f9331f expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796891.868775:0:5810:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788796891.868780:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb06f608a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+3:5819:x1875689374496512:12345-0@lo:104: Request processed in 43us (329us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796891.868786:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788796891.868989:0:5819:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb0774e6a00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5819:1875689374496384:0@lo:104: 00000100:00100000:2.0:1788796891.869002:0:5819:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb0774e5500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5819:1875689374496512:0@lo:104: 00010000:00010000:2.0:1788796891.869071:0:5819:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8cb080437c00/0xca7fc0c411f933f8 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796891.869355:0:5814:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788796891.869361:0:5814:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.138@tcp lock: ffff8cb040031a00/0xca7fc0c411f93326 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xca7fc0c411f9332d expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796891.869368:0:5814:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb040031a00 already unused, calling callback (ffffffffc1adac20) 10000000:00010000:1.0:1788796891.869372:0:5814:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.138@tcp lock: ffff8cb040031a00/0xca7fc0c411f93326 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xca7fc0c411f9332d expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796891.869381:0:5814:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.138@tcp lock: ffff8cb040031a00/0xca7fc0c411f93326 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xca7fc0c411f9332d expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788796891.869388:0:5814:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.138@tcp lock: ffff8cb040031a00/0xca7fc0c411f93326 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xca7fc0c411f9332d expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788796891.869405:0:5814:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788796891.869436:0:5814:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.138@tcp lock: ffff8cb040031a00/0xca7fc0c411f93326 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca7fc0c411f9332d expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796891.869442:0:5814:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788796891.869468:0:5814:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.138@tcp lock: ffff8cb040031a00/0xca7fc0c411f93326 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca7fc0c411f9332d expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796891.869476:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.138@tcp lock: ffff8cb040031a00/0xca7fc0c411f93326 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca7fc0c411f9332d expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796891.869488:0:5814:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788796891.869491:0:5814:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.138@tcp lock: ffff8cb041484400/0xca7fc0c411f93318 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xca7fc0c411f9331f expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796891.869496:0:5814:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb041484400 already unused, calling callback (ffffffffc1adac20) 10000000:00010000:1.0:1788796891.869498:0:5814:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.138@tcp lock: ffff8cb041484400/0xca7fc0c411f93318 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xca7fc0c411f9331f expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796891.869512:0:5814:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.138@tcp lock: ffff8cb041484400/0xca7fc0c411f93318 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xca7fc0c411f9331f expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788796891.869517:0:5814:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.138@tcp lock: ffff8cb041484400/0xca7fc0c411f93318 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xca7fc0c411f9331f expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788796891.869522:0:5814:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788796891.869532:0:5814:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.138@tcp lock: ffff8cb041484400/0xca7fc0c411f93318 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca7fc0c411f9331f expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796891.869537:0:5814:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788796891.869547:0:5814:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.138@tcp lock: ffff8cb041484400/0xca7fc0c411f93318 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca7fc0c411f9331f expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796891.869553:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.138@tcp lock: ffff8cb041484400/0xca7fc0c411f93318 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca7fc0c411f9331f expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796891.869566:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788796891.869567:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788796891.869569:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788796891.869580:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb0498ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:3303:1875689374497152:0@lo:103: 00000100:00100000:1.0:1788796891.869614:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788796891.869779:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788796891.869788:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb0498ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:3303:1875689374497024:0@lo:103: 00000100:00100000:1.0:1788796891.869812:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788796891.869841:0:5815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788796891.869851:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374497152 00000100:00100000:1.0:1788796891.869856:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374497152 00010000:00010000:1.0:1788796891.869875:0:5812:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cb082044600/0xca7fc0c411f9331f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xca7fc0c411f93318 expref: 14 pid: 5818 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788796891.869894:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374497024 00000100:00100000:1.0:1788796891.869897:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374497024 00010000:00010000:1.0:1788796891.869907:0:5812:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cb082045200/0xca7fc0c411f9332d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xca7fc0c411f93326 expref: 15 pid: 5818 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788796891.869935:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788796891.869943:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0498ef800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+15:3303:x1875689374497152:12345-0@lo:103: 00010000:00010000:1.0:1788796891.869953:0:5812:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788796891.869958:0:5812:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cb082044600/0xca7fc0c411f9331f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xca7fc0c411f93318 expref: 15 pid: 5818 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796891.869978:0:5812:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cb082044600/0xca7fc0c411f9331f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xca7fc0c411f93318 expref: 15 pid: 5818 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796891.869992:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cb082044600/0xca7fc0c411f9331f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xca7fc0c411f93318 expref: 15 pid: 5818 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796891.870003:0:5812:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788796891.870054:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0498ef800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+14:3303:x1875689374497152:12345-0@lo:103: Request processed in 113us (439us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796891.870061:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788796891.870074:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788796891.870081:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0498ec000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+13:3303:x1875689374497024:12345-0@lo:103: 00010000:00010000:1.0:1788796891.870088:0:5812:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788796891.870092:0:5812:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cb082045200/0xca7fc0c411f9332d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xca7fc0c411f93326 expref: 13 pid: 5818 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796891.870101:0:5812:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cb082045200/0xca7fc0c411f9332d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xca7fc0c411f93326 expref: 13 pid: 5818 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796891.870110:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cb082045200/0xca7fc0c411f9332d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xca7fc0c411f93326 expref: 13 pid: 5818 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796891.870122:0:5812:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8cb080437c00/0xca7fc0c411f933f8 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796891.870130:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cb080437c00/0xca7fc0c411f933f8 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796891.870143:0:5812:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cb080437c00/0xca7fc0c411f933f8 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796891.870156:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cb080437c00/0xca7fc0c411f933f8 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796891.870162:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cb080437c00/0xca7fc0c411f933f8 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796891.870168:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cb080437c00/0xca7fc0c411f933f8 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796891.870173:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb080437c00 already unused, calling callback (ffffffffc14d98b0) 00010000:00010000:1.0:1788796891.870177:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cb080437c00/0xca7fc0c411f933f8 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796891.870184:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cb080437c00/0xca7fc0c411f933f8 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796891.870199:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cb080437c00/0xca7fc0c411f933f8 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796891.870208:0:5812:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788796891.870230:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0498ec000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+12:3303:x1875689374497024:12345-0@lo:103: Request processed in 150us (418us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796891.870353:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788796891.870395:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb0498ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:3303:1875689374497024:0@lo:103: 00000100:00100000:1.0:1788796891.870402:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb0498ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:3303:1875689374497152:0@lo:103: 00010000:00010000:1.0:1788796891.870422:0:5819:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8cb080437c00/0xca7fc0c411f933f8 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796891.870430:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cb080437c00/0xca7fc0c411f933f8 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796891.870441:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cb080437c00/0xca7fc0c411f933f8 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788796891.870454:0:5819:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:3.0:1788796891.938318:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0585b2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+11:7623:x1875689374495872:12345-0@lo:253: Request processed in 103673us (104290us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796891.938339:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788796891.938467:0:7623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb048e2a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:7623:1875689374495872:0@lo:253: 10000000:01000000:1.0:1788796891.938483:0:7623:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1788796891.938487:0:7623:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788796891.938489:0:7623:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788796891.938490:0:7623:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788796891.938491:0:7623:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:1.0:1788796891.938492:0:7623:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788796891.938494:0:7623:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788796891.938495:0:7623:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788796891.938497:0:7623:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:1.0:1788796891.938498:0:7623:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788796891.938500:0:7623:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1788796891.938525:0:7623:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8cb042fd2800 from lustre-OST0001 10000000:01000000:1.0:1788796891.938551:0:7623:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:1.0:1788796891.938553:0:7623:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1788796891.938561:0:7623:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8cb0494f0000 local copy 10000000:01000000:1.0:1788796891.938566:0:7623:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1788796891.938611:0:7623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.138@tcp lock: ffff8cb0821f0000/0xca7fc0c411f933ff lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796891.938625:0:7623:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.204.138@tcp lock: ffff8cb0821f0000/0xca7fc0c411f933ff lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796891.938635:0:7623:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.138@tcp lock: ffff8cb0821f0000/0xca7fc0c411f933ff lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788796891.938668:0:7623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb0498ef480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:7623:1875689374497280:0@lo:101: 00000100:00100000:1.0:1788796891.938727:0:7623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788796891.938783:0:7623:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb0452ac0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788796891.938967:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374497280 00000100:00100000:3.0:1788796891.938977:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374497280 00000100:00100000:3.0:1788796891.939061:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788796891.939071:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0585b0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+11:7623:x1875689374497280:12345-0@lo:101: 00010000:00010000:3.0:1788796891.939087:0:5818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788796891.939102:0:5818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cb080437000/0xca7fc0c411f93406 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xca7fc0c411f933ff expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796891.939136:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cb080437000/0xca7fc0c411f93406 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xca7fc0c411f933ff expref: 12 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796891.939149:0:5818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cb080437000/0xca7fc0c411f93406 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xca7fc0c411f933ff expref: 12 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796891.939159:0:5818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb080437000, rc 0) 00000100:00100000:3.0:1788796891.939193:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0585b0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+12:7623:x1875689374497280:12345-0@lo:101: Request processed in 124us (465us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796891.939199:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788796891.939847:0:7623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb0498ef480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:7623:1875689374497280:0@lo:101: 00010000:00010000:1.0:1788796891.939867:0:7623:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.138@tcp lock: ffff8cb0821f0000/0xca7fc0c411f933ff lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xca7fc0c411f93406 expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796891.939879:0:7623:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.138@tcp lock: ffff8cb0821f0000/0xca7fc0c411f933ff lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xca7fc0c411f93406 expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788796891.940084:0:7623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb0498ef480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:7623:1875689374497408:0@lo:501: 00000100:00100000:1.0:1788796891.940127:0:7623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788796891.940169:0:7623:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb0452ac0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788796891.940497:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374497408 00000100:00100000:3.0:1788796891.940515:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374497408 00000100:00100000:3.0:1788796891.940557:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788796891.940567:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0585b1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+12:7623:x1875689374497408:12345-0@lo:501: 00000100:00100000:3.0:1788796891.940854:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0585b1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+12:7623:x1875689374497408:12345-0@lo:501: Request processed in 288us (726us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788796891.940863:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788796891.941076:0:7623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb0498ef480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:7623:1875689374497408:0@lo:501: 10000000:01000000:0.0:1788796891.941095:0:7623:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.138@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1788796891.941129:0:7623:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.138@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1788796891.941137:0:7623:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.138@tcp lock: ffff8cb0821f0000/0xca7fc0c411f933ff lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xca7fc0c411f93406 expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796891.941147:0:7623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.138@tcp lock: ffff8cb0821f0000/0xca7fc0c411f933ff lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xca7fc0c411f93406 expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796891.941154:0:7623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.138@tcp lock: ffff8cb0821f0000/0xca7fc0c411f933ff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xca7fc0c411f93406 expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796891.941173:0:7623:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1788796891.941199:0:7623:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8cb042fd2800 10000000:01000000:0.0:1788796891.941203:0:7623:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1788796891.941209:0:7623:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1788796891.941211:0:7623:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788796891.941215:0:7623:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:0.0:1788796891.941218:0:7623:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1788796891.941253:0:7623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.138@tcp lock: ffff8cb040030c00/0xca7fc0c411f9340d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796891.941262:0:7623:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.138@tcp lock: ffff8cb040030c00/0xca7fc0c411f9340d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796891.941272:0:7623:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.138@tcp lock: ffff8cb040030c00/0xca7fc0c411f9340d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788796891.941288:0:7623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb06f608000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:7623:1875689374497536:0@lo:101: 00000100:00100000:0.0:1788796891.941329:0:7623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788796891.941365:0:7623:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb081353180 going to sleep for 11 seconds 00010000:00010000:2.0:1788796891.941476:0:5814:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788796891.941484:0:5814:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.138@tcp lock: ffff8cb0821f0000/0xca7fc0c411f933ff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xca7fc0c411f93406 expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796891.941492:0:5814:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb0821f0000 already unused, calling callback (ffffffffc1adac20) 10000000:00010000:2.0:1788796891.941496:0:5814:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.138@tcp lock: ffff8cb0821f0000/0xca7fc0c411f933ff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xca7fc0c411f93406 expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796891.941504:0:5814:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.138@tcp lock: ffff8cb0821f0000/0xca7fc0c411f933ff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0xca7fc0c411f93406 expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788796891.941512:0:5814:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.138@tcp lock: ffff8cb0821f0000/0xca7fc0c411f933ff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0xca7fc0c411f93406 expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788796891.941518:0:5814:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788796891.941537:0:5814:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.138@tcp lock: ffff8cb0821f0000/0xca7fc0c411f933ff lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xca7fc0c411f93406 expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796891.941544:0:5814:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788796891.941572:0:5814:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.138@tcp lock: ffff8cb0821f0000/0xca7fc0c411f933ff lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xca7fc0c411f93406 expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796891.941579:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.138@tcp lock: ffff8cb0821f0000/0xca7fc0c411f933ff lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xca7fc0c411f93406 expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796891.941595:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788796891.941597:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788796891.941598:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788796891.941615:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788796891.941627:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb048e29c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:3301:1875689374497664:0@lo:103: 00000100:00100000:2.0:1788796891.941672:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788796891.941708:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374497664 00000100:00100000:2.0:1788796891.941714:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374497664 00000100:00100000:2.0:1788796891.941759:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788796891.941768:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb048e29880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+12:3301:x1875689374497664:12345-0@lo:103: 00010000:00010000:2.0:1788796891.941781:0:6698:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788796891.941795:0:6698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cb080437000/0xca7fc0c411f93406 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xca7fc0c411f933ff expref: 12 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796891.941810:0:6698:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788796891.941840:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb048e29880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+11:3301:x1875689374497664:12345-0@lo:103: Request processed in 73us (168us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796891.941846:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788796891.941877:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb048e29c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:3301:1875689374497664:0@lo:103: 00000100:00100000:3.0:1788796891.942016:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374497536 00000100:00100000:3.0:1788796891.942021:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374497536 00000100:00100000:3.0:1788796891.942081:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788796891.942088:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0585b0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+11:7623:x1875689374497536:12345-0@lo:101: 00010000:00010000:3.0:1788796891.942102:0:5820:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788796891.942117:0:5820:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cb080437e00/0xca7fc0c411f93414 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xca7fc0c411f9340d expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796891.942136:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cb080437e00/0xca7fc0c411f93414 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xca7fc0c411f9340d expref: 12 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796891.942160:0:5820:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cb080437e00/0xca7fc0c411f93414 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xca7fc0c411f9340d expref: 12 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796891.942167:0:5820:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb080437e00, rc 0) 00000100:00100000:3.0:1788796891.942196:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0585b0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+12:7623:x1875689374497536:12345-0@lo:101: Request processed in 109us (868us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796891.942202:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788796891.942427:0:7623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb06f608000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:7623:1875689374497536:0@lo:101: 00010000:00010000:0.0:1788796891.942440:0:7623:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.138@tcp lock: ffff8cb040030c00/0xca7fc0c411f9340d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xca7fc0c411f93414 expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796891.942449:0:7623:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.138@tcp lock: ffff8cb040030c00/0xca7fc0c411f9340d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xca7fc0c411f93414 expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788796891.942545:0:7623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb06f608000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:7623:1875689374497792:0@lo:501: 00000100:00100000:0.0:1788796891.942573:0:7623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788796891.942604:0:7623:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb081353180 going to sleep for 11 seconds 00000100:00100000:2.0:1788796891.943060:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374497792 00000100:00100000:2.0:1788796891.943066:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374497792 00000100:00100000:2.0:1788796891.943095:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788796891.943104:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0585b3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+12:7623:x1875689374497792:12345-0@lo:501: 00000100:00100000:2.0:1788796891.943449:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0585b3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+12:7623:x1875689374497792:12345-0@lo:501: Request processed in 345us (874us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796891.943456:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788796891.943498:0:7623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb06f608000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:7623:1875689374497792:0@lo:501: 00000100:00100000:2.0:1788796891.943542:0:7623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb048e29c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:7623:1875689374497920:0@lo:503: 00000100:00100000:2.0:1788796891.943583:0:7623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788796891.943608:0:7623:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb046bf0480 going to sleep for 11 seconds 00000100:00100000:2.0:1788796891.943628:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374497920 00000100:00100000:2.0:1788796891.943631:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374497920 00000100:00100000:1.0:1788796891.944257:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788796891.944271:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0585b2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+12:7623:x1875689374497920:12345-0@lo:503: 00000100:00100000:1.0:1788796891.944461:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0585b2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+12:7623:x1875689374497920:12345-0@lo:503: Request processed in 194us (876us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796891.944468:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788796891.944639:0:7623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb048e29c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:7623:1875689374497920:0@lo:503: 00000040:00080000:0.0:1788796891.944942:0:7623:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788796891.945067:0:7623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb06f60b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:7623:1875689374498048:0@lo:502: 00000100:00100000:0.0:1788796891.945108:0:7623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788796891.945135:0:7623:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb081353480 going to sleep for 11 seconds 00000100:00100000:3.0:1788796891.945276:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374498048 00000100:00100000:3.0:1788796891.945283:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374498048 00000100:00100000:3.0:1788796891.945311:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788796891.945320:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0585b3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+12:7623:x1875689374498048:12345-0@lo:502: 00000100:00100000:3.0:1788796891.945488:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0585b3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+12:7623:x1875689374498048:12345-0@lo:502: Request processed in 169us (379us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796891.945496:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788796891.945737:0:7623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb06f60b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:7623:1875689374498048:0@lo:502: 00000040:00080000:0.0:1788796891.946059:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:0.0:1788796891.946114:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:0.0:1788796891.946148:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:0.0:1788796891.946196:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:1.0:1788796891.949152:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:1.0:1788796891.949299:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:1.0:1788796891.949366:0:7623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb0498ec380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:7623:1875689374498176:0@lo:502: 00000100:00100000:1.0:1788796891.949478:0:7623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788796891.949531:0:7623:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb0452ac480 going to sleep for 11 seconds 00000100:00100000:3.0:1788796891.949828:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374498176 00000100:00100000:3.0:1788796891.949837:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374498176 00000100:00100000:3.0:1788796891.949893:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788796891.949904:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0585b1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+12:7623:x1875689374498176:12345-0@lo:502: 00000100:00100000:3.0:1788796891.950186:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0585b1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+12:7623:x1875689374498176:12345-0@lo:502: Request processed in 283us (708us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796891.950194:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788796891.950439:0:7623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb0498ec380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:7623:1875689374498176:0@lo:502: 00000040:00080000:1.0:1788796891.950582:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:1.0:1788796891.950597:0:7623:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:2.0:1788796891.951686:0:7630:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788796891.951697:0:7630:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:2.0:1788796891.951704:0:7630:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788796891.951706:0:7630:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:2.0:1788796891.951713:0:7630:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788796891.951733:0:7630:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff8cb0494f3380) 00000020:00000080:2.0:1788796891.951764:0:7630:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type obdfilter with refcount 2 00000020:00000080:2.0:1788796891.951771:0:7630:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1788796891.951845:0:7630:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8cb042fd2800 from lustre-OST0001, refs=2 00080000:01000000:2.0:1788796891.951853:0:7630:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788796891.951871:0:7630:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xca7fc0c411f93422 00010000:00010000:1.0:1788796891.954507:0:5815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788796891.959438:0:7630:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:02000400:3.0:1788796891.960005:0:7630:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:3.0:1788796891.962586:0:7630:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:3.0:1788796891.962998:0:7630:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:2.0:1788796891.970378:0:7630:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:2.0:1788796891.971198:0:7630:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:2.0:1788796891.976522:0:7630:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:2.0:1788796891.976535:0:7630:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788796891.976542:0:7630:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788796891.976544:0:7630:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:2.0:1788796891.976549:0:7630:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788796891.976554:0:7630:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788796891.976555:0:7630:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788796891.976558:0:7630:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788796891.976560:0:7630:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1788796891.976618:0:7630:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788796891.976622:0:7630:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788796891.976624:0:7630:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000040:00080000:2.0:1788796891.976627:0:7630:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:0.0:1788796891.976873:0:7623:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:0.0:1788796891.976905:0:7623:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.138@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1788796891.976935:0:7623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.138@tcp lock: ffff8cb040030c00/0xca7fc0c411f9340d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xca7fc0c411f93414 expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796891.976961:0:7623:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.138@tcp lock: ffff8cb040030c00/0xca7fc0c411f9340d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xca7fc0c411f93414 expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788796891.976970:0:7623:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8cb042fd2800 from 1 10000000:01000000:0.0:1788796891.976973:0:7623:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788796891.977008:0:7623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.138@tcp lock: ffff8cb040031e00/0xca7fc0c411f93429 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796891.977016:0:7623:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.138@tcp lock: ffff8cb040031e00/0xca7fc0c411f93429 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796891.977048:0:7623:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.138@tcp lock: ffff8cb040031e00/0xca7fc0c411f93429 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788796891.977076:0:7623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb06f60b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:7623:1875689374498304:0@lo:101: 00000100:00100000:0.0:1788796891.977145:0:7623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788796891.977189:0:7623:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb081353c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788796891.978558:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374498304 00000100:00100000:0.0:1788796891.978571:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374498304 00000100:00100000:0.0:1788796891.978632:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788796891.978642:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0585b1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+12:7623:x1875689374498304:12345-0@lo:101: 00010000:00010000:0.0:1788796891.978671:0:5818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788796891.978687:0:5818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cb040031a00/0xca7fc0c411f93430 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xca7fc0c411f93429 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796891.978713:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cb040031a00/0xca7fc0c411f93430 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xca7fc0c411f93429 expref: 13 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796891.978724:0:5818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cb040031a00/0xca7fc0c411f93430 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xca7fc0c411f93429 expref: 13 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796891.978747:0:5818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb040031a00, rc 0) 00000100:00100000:0.0:1788796891.978823:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0585b1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+13:7623:x1875689374498304:12345-0@lo:101: Request processed in 182us (1678us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796891.978830:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788796891.978907:0:7623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb06f60b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:7623:1875689374498304:0@lo:101: 00010000:00010000:0.0:1788796891.978936:0:7623:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.138@tcp lock: ffff8cb040031e00/0xca7fc0c411f93429 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xca7fc0c411f93430 expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796891.978945:0:7623:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.138@tcp lock: ffff8cb040031e00/0xca7fc0c411f93429 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xca7fc0c411f93430 expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788796891.979124:0:7623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb06f60b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:7623:1875689374498432:0@lo:501: 00000100:00100000:0.0:1788796891.979171:0:7623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788796891.979203:0:7623:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb081353c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788796891.979488:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374498432 00000100:00100000:2.0:1788796891.979493:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374498432 00000100:00100000:2.0:1788796891.979526:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788796891.979534:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0585b3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+13:7623:x1875689374498432:12345-0@lo:501: 00000100:00100000:2.0:1788796891.979781:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0585b3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+13:7623:x1875689374498432:12345-0@lo:501: Request processed in 248us (609us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796891.979794:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788796891.979827:0:7623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb06f60b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:7623:1875689374498432:0@lo:501: 00000100:00100000:2.0:1788796891.979857:0:7623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb048e2ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:7623:1875689374498560:0@lo:503: 00000100:00100000:2.0:1788796891.979894:0:7623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788796891.979908:0:7623:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb046bf0180 going to sleep for 11 seconds 00000100:00100000:0.0:1788796891.980747:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374498560 00000100:00100000:0.0:1788796891.980757:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374498560 00000100:00100000:0.0:1788796891.980793:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1788796891.980801:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0585b1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+13:7623:x1875689374498560:12345-0@lo:503: 00000100:00100000:0.0:1788796891.982000:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0585b1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+13:7623:x1875689374498560:12345-0@lo:503: Request processed in 1192us (2098us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796891.982012:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1788796891.982818:0:7623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb048e2ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:7623:1875689374498560:0@lo:503: 00000040:00080000:3.0:1788796891.985735:0:7623:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788796891.986482:0:7623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb0774e7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:7623:1875689374498688:0@lo:502: 00000100:00100000:3.0:1788796891.986582:0:7623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796891.986669:0:7623:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb046abfa80 going to sleep for 11 seconds 00000100:00100000:0.0:1788796891.986824:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374498688 00000100:00100000:0.0:1788796891.986833:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374498688 00000100:00100000:0.0:1788796891.986884:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1788796891.986894:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0585b3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+13:7623:x1875689374498688:12345-0@lo:502: 00000100:00100000:0.0:1788796891.987595:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0585b3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+13:7623:x1875689374498688:12345-0@lo:502: Request processed in 700us (1011us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796891.987611:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1788796891.988481:0:7623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb0774e7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:7623:1875689374498688:0@lo:502: 00000040:00080000:3.0:1788796891.988817:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:3.0:1788796891.988873:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:3.0:1788796891.988929:0:7623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb0774e7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:7623:1875689374498816:0@lo:502: 00000100:00100000:3.0:1788796891.989001:0:7623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796891.989066:0:7623:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb05098f240 going to sleep for 11 seconds 00000100:00100000:0.0:1788796891.989336:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374498816 00000100:00100000:0.0:1788796891.989346:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374498816 00000100:00100000:0.0:1788796891.989391:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1788796891.989400:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0585b0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+13:7623:x1875689374498816:12345-0@lo:502: 00000100:00100000:0.0:1788796891.989613:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0585b0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+13:7623:x1875689374498816:12345-0@lo:502: Request processed in 213us (611us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796891.989620:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1788796891.990628:0:7623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb0774e7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:7623:1875689374498816:0@lo:502: 00000040:00080000:3.0:1788796891.990795:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:3.0:1788796891.990810:0:7623:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:3.0:1788796891.991790:0:7634:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788796891.991803:0:7634:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788796891.991805:0:7634:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788796891.991811:0:7634:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8cb042fd2800 00000020:00000080:3.0:1788796891.991813:0:7634:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788796891.991831:0:7634:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788796891.991834:0:7634:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788796891.991835:0:7634:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1788796891.991838:0:7634:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:0.0:1788796891.995312:0:7623:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1788796891.995355:0:7623:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.138@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788796891.995412:0:7623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.138@tcp lock: ffff8cb040031e00/0xca7fc0c411f93429 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xca7fc0c411f93430 expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796891.995426:0:7623:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.138@tcp lock: ffff8cb040031e00/0xca7fc0c411f93429 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xca7fc0c411f93430 expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788796891.995478:0:7623:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788796891.995481:0:7623:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8cb042fd2800 10000000:01000000:0.0:1788796891.995484:0:7623:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8cb042fd2800 10000000:01000000:0.0:1788796891.995487:0:7623:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788796891.995493:0:7623:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8cb042fd2800 from 1 10000000:01000000:0.0:1788796891.995496:0:7623:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788796891.995542:0:7623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.138@tcp lock: ffff8cb040030000/0xca7fc0c411f93437 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796891.995551:0:7623:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.138@tcp lock: ffff8cb040030000/0xca7fc0c411f93437 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796891.995563:0:7623:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.138@tcp lock: ffff8cb040030000/0xca7fc0c411f93437 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788796891.995615:0:7623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb06f60b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:7623:1875689374498944:0@lo:101: 00000100:00100000:0.0:1788796891.995855:0:7623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788796891.995928:0:7623:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb081353780 going to sleep for 11 seconds 00000100:00100000:1.0:1788796891.996001:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374498944 00000100:00100000:1.0:1788796891.996018:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374498944 00000100:00100000:1.0:1788796891.996100:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1788796891.996109:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb048868c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+13:7623:x1875689374498944:12345-0@lo:101: 00010000:00010000:1.0:1788796891.996122:0:5820:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788796891.996143:0:5820:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cb0821f0a00/0xca7fc0c411f9343e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xca7fc0c411f93437 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796891.996173:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cb0821f0a00/0xca7fc0c411f9343e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xca7fc0c411f93437 expref: 14 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796891.996186:0:5820:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cb0821f0a00/0xca7fc0c411f9343e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xca7fc0c411f93437 expref: 14 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796891.996195:0:5820:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb0821f0a00, rc 0) 00000100:00100000:3.0:1788796891.996363:0:7623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb06f60b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:7623:1875689374498944:0@lo:101: 00010000:00010000:3.0:1788796891.996383:0:7623:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.138@tcp lock: ffff8cb040030000/0xca7fc0c411f93437 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xca7fc0c411f9343e expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796891.996393:0:7623:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.138@tcp lock: ffff8cb040030000/0xca7fc0c411f93437 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xca7fc0c411f9343e expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788796891.996541:0:7623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb0774e7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:7623:1875689374499072:0@lo:501: 00000100:00100000:3.0:1788796891.999065:0:7623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796891.999119:0:7623:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb05098fd80 going to sleep for 11 seconds 00000100:00100000:0.0:1788796891.999275:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374499072 00000100:00100000:0.0:1788796891.999284:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374499072 00000100:00100000:0.0:1788796891.999345:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1788796891.999357:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb04886ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+15:7623:x1875689374499072:12345-0@lo:501: 00000100:00100000:0.0:1788796891.999680:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb04886ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+15:7623:x1875689374499072:12345-0@lo:501: Request processed in 325us (627us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796891.999689:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1788796891.999858:0:7623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb0774e7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:7623:1875689374499072:0@lo:501: 00000100:00100000:3.0:1788796891.999936:0:7623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb0774e7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:7623:1875689374499200:0@lo:503: 00000100:00100000:3.0:1788796891.999984:0:7623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796892.000012:0:7623:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb05098fd80 going to sleep for 11 seconds 00000100:00100000:0.0:1788796892.001692:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374499200 00000100:00100000:0.0:1788796892.001709:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374499200 00000100:00100000:0.0:1788796892.001779:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1788796892.001791:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb048868450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+15:7623:x1875689374499200:12345-0@lo:503: 00000100:00100000:0.0:1788796892.002125:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb048868450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+15:7623:x1875689374499200:12345-0@lo:503: Request processed in 336us (2138us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796892.002133:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1788796892.002488:0:7623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb0774e7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:7623:1875689374499200:0@lo:503: 00000040:00080000:3.0:1788796892.002931:0:7623:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788796892.003021:0:7623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb0774e7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:7623:1875689374499328:0@lo:502: 00000100:00100000:3.0:1788796892.003103:0:7623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796892.003132:0:7623:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb05098fd80 going to sleep for 11 seconds 00000100:00100000:0.0:1788796892.003441:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374499328 00000100:00100000:0.0:1788796892.003447:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374499328 00000100:00100000:0.0:1788796892.003483:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1788796892.003492:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb048869450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+15:7623:x1875689374499328:12345-0@lo:502: 00000100:00100000:0.0:1788796892.003780:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb048869450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+15:7623:x1875689374499328:12345-0@lo:502: Request processed in 288us (676us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796892.003790:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788796892.004149:0:7623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb0774e7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:7623:1875689374499328:0@lo:502: 00000040:00080000:3.0:1788796892.004485:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:3.0:1788796892.004681:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:3.0:1788796892.004715:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:3.0:1788796892.004756:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:3.0:1788796892.004792:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:3.0:1788796892.004853:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:3.0:1788796892.004889:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:3.0:1788796892.004933:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:3.0:1788796892.004998:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:3.0:1788796892.005080:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:3.0:1788796892.005118:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:3.0:1788796892.005167:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:3.0:1788796892.005204:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:3.0:1788796892.005451:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:3.0:1788796892.005595:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:3.0:1788796892.005710:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:3.0:1788796892.005750:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:3.0:1788796892.005801:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:3.0:1788796892.005840:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:3.0:1788796892.005875:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:3.0:1788796892.005940:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:3.0:1788796892.005977:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:3.0:1788796892.006010:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:3.0:1788796892.006363:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:3.0:1788796892.006399:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:3.0:1788796892.006429:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:3.0:1788796892.006471:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000100:00100000:1.0:1788796892.006631:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb048868c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+14:7623:x1875689374498944:12345-0@lo:101: Request processed in 10519us (10772us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796892.006641:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000040:00080000:3.0:1788796892.007174:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000040:00080000:3.0:1788796892.007592:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:3.0:1788796892.007851:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13416 00000040:00080000:3.0:1788796892.007891:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13504 00000040:00080000:3.0:1788796892.007975:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13632 00000040:00080000:3.0:1788796892.008007:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13776 00000040:00080000:3.0:1788796892.008206:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13904 00000040:00080000:3.0:1788796892.008393:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14128 00000040:00080000:3.0:1788796892.008446:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14352 00000040:00080000:3.0:1788796892.008479:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14432 00000100:00100000:3.0:1788796892.008612:0:7623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb0774e7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:7623:1875689374499456:0@lo:502: 00000100:00100000:3.0:1788796892.008797:0:7623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796892.009203:0:7623:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb05098fd80 going to sleep for 11 seconds 00000100:00100000:0.0:1788796892.009334:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374499456 00000100:00100000:0.0:1788796892.009343:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374499456 00000100:00100000:0.0:1788796892.009460:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788796892.009469:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb048868850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+14:7623:x1875689374499456:12345-0@lo:502: 00000100:00100000:0.0:1788796892.009942:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb048868850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+14:7623:x1875689374499456:12345-0@lo:502: Request processed in 473us (1144us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796892.009951:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1788796892.010099:0:7623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb0774e7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:7623:1875689374499456:0@lo:502: 00000040:00080000:3.0:1788796892.010219:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14656 00000040:00080000:3.0:1788796892.010306:0:7623:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:2.0:1788796892.011716:0:7635:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1788796892.011753:0:7635:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff8cb06f094d40) 00000020:00000080:2.0:1788796892.011782:0:7635:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type lwp with refcount 2 00000020:01000004:2.0:1788796892.011855:0:7635:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8cb042fd2800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1788796892.011860:0:7635:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8cb042fd2800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1788796892.011862:0:7635:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8cb042fd2800 3 00010000:00080000:2.0:1788796892.011897:0:7635:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8cb0585a9000@lustre-MDT0000-lwp-OST0001: add connection 192.168.204.138@tcp at head 00010000:00010000:3.0:1788796892.014773:0:7635:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-4 is initialized 00000020:00000080:3.0:1788796892.017849:0:7635:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:3.0:1788796892.017956:0:7635:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788796892.017977:0:7635:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xca7fc0c411f9344c 00000100:00080000:3.0:1788796892.017991:0:7635:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788796892.018005:0:7635:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8cb0585a9000 using connection 192.168.204.138@tcp/0@lo 00000100:00100000:3.0:1788796892.018065:0:7635:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cb0774e7800 x1875689374499584/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788796892.018150:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb0774e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3299:1875689374499584:0@lo:38: 00000100:00100000:1.0:1788796892.018301:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796892.018404:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374499584 00000100:00100000:3.0:1788796892.018414:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374499584 00000100:00100000:3.0:1788796892.018452:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788796892.018460:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0498ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3299:x1875689374499584:12345-0@lo:38: 00010000:00080000:3.0:1788796892.018485:0:5826:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 181 last 0 00000020:00000080:3.0:1788796892.018527:0:5826:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xca7fc0c411f93453 00000004:00100000:3.0:1788796892.018546:0:5826:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788796892.018582:0:5826:0:(import.c:65:import_set_state_nolock()) ffff8caf41995800 : changing import state from RECOVER to FULL 00000100:00080000:0.0:1788796892.021415:0:7635:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1788796892.021551:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788796892.021576:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb06f60bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3300:1875689374499712:0@lo:400: 00000100:00100000:0.0:1788796892.021676:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788796892.021732:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb06f60b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3303:1875689374499968:0@lo:400: 00000100:00100000:0.0:1788796892.021763:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788796892.021777:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788796892.021781:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb06f60b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875689374499840:0@lo:400: 00000100:00100000:0.0:1788796892.021808:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788796892.021842:0:5827:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1788796892.021851:0:5827:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:0.0:1788796892.021874:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374499840 00000100:00100000:0.0:1788796892.021885:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374499840 00000100:00100000:0.0:1788796892.021963:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788796892.021973:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb06f608700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1875689374499840:12345-0@lo:400: 00000100:00100000:0.0:1788796892.022054:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb06f608700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1875689374499840:12345-0@lo:400: Request processed in 82us (245us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796892.022061:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:0.0:1788796892.022083:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788796892.022116:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cb06f60b100 x1875689374499840/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788796908 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788796892.022130:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb06f60b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875689374499840:0@lo:400: 00000100:00100000:2.0:1788796892.023964:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374499712 00000100:00100000:2.0:1788796892.023980:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374499712 00000100:00100000:2.0:1788796892.024810:0:5827:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1788796892.024830:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374499968 00000100:00100000:2.0:1788796892.024836:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374499968 00000100:00100000:2.0:1788796892.024889:0:5827:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1788796892.024901:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788796892.024911:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb06f608000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1875689374499712:12345-0@lo:400: 00000100:00100000:2.0:1788796892.025075:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb06f608000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1875689374499712:12345-0@lo:400: Request processed in 166us (3398us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796892.025082:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788796892.025100:0:5827:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1788796892.025106:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788796892.025112:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb06f60aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875689374499968:12345-0@lo:400: 00000100:00100000:2.0:1788796892.025149:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb06f60aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875689374499968:12345-0@lo:400: Request processed in 37us (3385us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796892.025169:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:2.0:1788796892.025192:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1788796892.027578:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cb06f60bb80 x1875689374499712/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788796908 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788796892.027608:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb06f60bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3300:1875689374499712:0@lo:400: 00010000:00080000:2.0:1788796892.027719:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cb06f60b480 x1875689374499968/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788796908 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788796892.027728:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb06f60b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3303:1875689374499968:0@lo:400: 00000100:00100000:3.0:1788796892.034020:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0498ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1875689374499584:12345-0@lo:38: Request processed in 15540us (15771us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796892.034063:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1788796892.034225:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cb0774e7800 x1875689374499584/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788796902 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788796892.034239:0:3299:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788796892.034250:0:3299:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:1.0:1788796892.034260:0:3299:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1788796892.034266:0:3299:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788796892.034270:0:3299:0:(import.c:65:import_set_state_nolock()) ffff8cb0585a9000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788796892.034278:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb0774e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3299:1875689374499584:0@lo:38: 00000040:00080000:0.0:1788796892.034898:0:7635:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000020:01000000:1.0:1788796892.035056:0:7623:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:1.0:1788796892.035104:0:7623:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.138@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788796892.035121:0:7623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.138@tcp lock: ffff8cb040030000/0xca7fc0c411f93437 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xca7fc0c411f9343e expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796892.035132:0:7623:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.138@tcp lock: ffff8cb040030000/0xca7fc0c411f93437 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xca7fc0c411f9343e expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1788796892.035190:0:7623:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1788796892.035193:0:7623:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788796892.035194:0:7623:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788796892.035196:0:7623:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788796892.035197:0:7623:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788796892.035198:0:7623:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788796892.035200:0:7623:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788796892.035201:0:7623:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788796892.035203:0:7623:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788796892.035204:0:7623:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788796892.035206:0:7623:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788796892.035210:0:7623:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:1.0:1788796892.035213:0:7623:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788796892.035214:0:7623:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788796892.035215:0:7623:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788796892.035216:0:7623:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788796892.035217:0:7623:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788796892.035219:0:7623:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788796892.035219:0:7623:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788796892.035220:0:7623:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788796892.035222:0:7623:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788796892.035223:0:7623:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788796892.035223:0:7623:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788796892.035246:0:7623:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1788796892.035266:0:7623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb0498ef100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:7623:1875689374500096:0@lo:253: 00000100:00100000:1.0:1788796892.035349:0:7623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788796892.035400:0:7623:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb0452ac240 going to sleep for 11 seconds 00000100:00100000:0.0:1788796892.035953:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374500096 00000100:00100000:0.0:1788796892.035965:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374500096 00000100:00100000:0.0:1788796892.036017:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1788796892.036044:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb04886bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+14:7623:x1875689374500096:12345-0@lo:253: 20000000:01000000:0.0:1788796892.036075:0:5820:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1788796892.036090:0:5820:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:3.0:1788796892.038791:0:7637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb0774e7100 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7637:1875689374500224:0@lo:901: 00000100:00100000:3.0:1788796892.038902:0:7637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796892.038949:0:7637:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb05098f6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788796892.039296:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374500224 00000100:00100000:1.0:1788796892.039304:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374500224 00000100:00100000:1.0:1788796892.039378:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788796892.039386:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0774e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7637:x1875689374500224:12345-0@lo:901: 00000100:00100000:1.0:1788796892.039773:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0774e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7637:x1875689374500224:12345-0@lo:901: Request processed in 387us (870us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796892.039781:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:3.0:1788796892.039913:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1788796892.039960:0:7637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cb0774e7100 x1875689374500224/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1788796908 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788796892.039975:0:7637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb0774e7100 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7637:1875689374500224:0@lo:901: 20000000:01000000:1.0:1788796892.079208:0:5820:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1788796892.079240:0:5820:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:0.0:1788796892.079382:0:5841:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788796892.079389:0:5841:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788796892.079421:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cb040031400/0xca7fc0c411f9345a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796892.079444:0:5841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cb0821f1c00/0xca7fc0c411f933e3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xca7fc0c411f933dc expref: 14 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796892.079451:0:5841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8cb040031400/0xca7fc0c411f9345a lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796892.079490:0:5841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cb0821f1c00/0xca7fc0c411f933e3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xca7fc0c411f933dc expref: 14 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796892.079515:0:5841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cb0821f1c00/0xca7fc0c411f933e3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xca7fc0c411f933dc expref: 14 pid: 5820 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788796892.079531:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb06f60b100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5841:1875689374500352:0@lo:104: 00000100:00100000:0.0:1788796892.079607:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788796892.079680:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb06f48f480 going to sleep for 11 seconds 00000100:00100000:3.0:1788796892.079799:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374500352 00000100:00100000:3.0:1788796892.079828:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374500352 00000100:00100000:3.0:1788796892.079897:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788796892.079911:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb06f609180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+3:5841:x1875689374500352:12345-0@lo:104: 00010000:00010000:3.0:1788796892.079938:0:5810:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.138@tcp lock: ffff8cb041484200/0xca7fc0c411f933dc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xca7fc0c411f933e3 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796892.080014:0:5810:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788796892.080020:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb06f609180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+3:5841:x1875689374500352:12345-0@lo:104: Request processed in 113us (413us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796892.080056:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:2.0:1788796892.080124:0:5814:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788796892.080132:0:5814:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.138@tcp lock: ffff8cb041484200/0xca7fc0c411f933dc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xca7fc0c411f933e3 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796892.080140:0:5814:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb041484200 already unused, calling callback (ffffffffc1adac20) 10000000:00010000:2.0:1788796892.080144:0:5814:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.138@tcp lock: ffff8cb041484200/0xca7fc0c411f933dc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xca7fc0c411f933e3 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796892.080154:0:5814:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.138@tcp lock: ffff8cb041484200/0xca7fc0c411f933dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xca7fc0c411f933e3 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788796892.080163:0:5814:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.138@tcp lock: ffff8cb041484200/0xca7fc0c411f933dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xca7fc0c411f933e3 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788796892.080169:0:5814:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788796892.080210:0:5814:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.138@tcp lock: ffff8cb041484200/0xca7fc0c411f933dc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca7fc0c411f933e3 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796892.080216:0:5814:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788796892.080252:0:5814:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.138@tcp lock: ffff8cb041484200/0xca7fc0c411f933dc lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca7fc0c411f933e3 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796892.080260:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.138@tcp lock: ffff8cb041484200/0xca7fc0c411f933dc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca7fc0c411f933e3 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796892.080280:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788796892.080282:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788796892.080284:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788796892.080297:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb048e28a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:3300:1875689374500480:0@lo:103: 00000100:00100000:2.0:1788796892.080333:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788796892.080375:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374500480 00000100:00100000:2.0:1788796892.080378:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374500480 00010000:00010000:2.0:1788796892.080396:0:5813:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cb0821f1c00/0xca7fc0c411f933e3 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xca7fc0c411f933dc expref: 15 pid: 5820 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788796892.080417:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788796892.080423:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb042edb450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+15:3300:x1875689374500480:12345-0@lo:103: 00010000:00010000:2.0:1788796892.080433:0:5813:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788796892.080437:0:5813:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cb0821f1c00/0xca7fc0c411f933e3 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xca7fc0c411f933dc expref: 15 pid: 5820 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796892.080446:0:5813:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cb0821f1c00/0xca7fc0c411f933e3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xca7fc0c411f933dc expref: 15 pid: 5820 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796892.080462:0:5813:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8cb040031400/0xca7fc0c411f9345a lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796892.080470:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cb040031400/0xca7fc0c411f9345a lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788796892.080491:0:5813:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002791802s 00010000:00010000:2.0:1788796892.080496:0:5813:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cb040031400/0xca7fc0c411f9345a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796892.080515:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cb040031400/0xca7fc0c411f9345a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796892.080521:0:5813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cb040031400/0xca7fc0c411f9345a lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796892.080527:0:5813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cb040031400/0xca7fc0c411f9345a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796892.080531:0:5813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb040031400 already unused, calling callback (ffffffffc14d98b0) 00010000:00010000:2.0:1788796892.080535:0:5813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cb040031400/0xca7fc0c411f9345a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796892.080542:0:5813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cb040031400/0xca7fc0c411f9345a lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796892.080550:0:5813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cb040031400/0xca7fc0c411f9345a lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796892.080559:0:5813:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788796892.080585:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb042edb450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+15:3300:x1875689374500480:12345-0@lo:103: Request processed in 163us (252us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796892.080591:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788796892.080644:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb048e28a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:3300:1875689374500480:0@lo:103: 00010000:00010000:0.0:1788796892.081013:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cb0821f1c00/0xca7fc0c411f933e3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xca7fc0c411f933dc expref: 14 pid: 5820 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788796892.081058:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb06f60b100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5841:1875689374500352:0@lo:104: 00010000:00010000:0.0:1788796892.081083:0:5841:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8cb040031400/0xca7fc0c411f9345a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796892.081092:0:5841:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8cb040031400/0xca7fc0c411f9345a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796892.081098:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cb040031400/0xca7fc0c411f9345a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796892.081105:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cb040031400/0xca7fc0c411f9345a lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788796892.087484:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb04886bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+13:7623:x1875689374500096:12345-0@lo:253: Request processed in 51449us (52126us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796892.087509:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1788796892.087669:0:7623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb0498ef100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:7623:1875689374500096:0@lo:253: 10000000:01000000:3.0:1788796892.087687:0:7623:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1788796892.087690:0:7623:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788796892.087692:0:7623:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788796892.087693:0:7623:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788796892.087694:0:7623:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788796892.087696:0:7623:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788796892.087697:0:7623:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788796892.087699:0:7623:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788796892.087700:0:7623:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788796892.087702:0:7623:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788796892.087703:0:7623:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788796892.087705:0:7623:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1788796892.087719:0:7623:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1788796892.094699:0:7623:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:2.0:1788796892.094867:0:7623:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1788796892.095318:0:7623:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1788796892.095495:0:7623:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1788796892.095734:0:7623:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:2.0:1788796892.095959:0:7623:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:2.0:1788796892.101074:0:7623:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:2.0:1788796892.391710:0:7623:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:2.0:1788796892.391720:0:7623:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:2.0:1788796892.391768:0:7623:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1788796892.391831:0:7623:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.138@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1788796892.391845:0:7623:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=49 00000080:00000004:2.0:1788796892.391873:0:7623:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:1.0:1788796892.981306:0:5815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788796894.005528:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788796894.258286:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788796894.258319:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb0774e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875689374500608:0@lo:13: 00000100:00100000:3.0:1788796894.258413:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796894.258494:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374500608 00000100:00100000:3.0:1788796894.258503:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374500608 00000100:00080000:2.0:1788796894.258563:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788796894.258576:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788796894.258585:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0774e6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1875689374500608:12345-0@lo:13: 00002000:00000024:3.0:1788796894.259360:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788796894.259503:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0774e6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1875689374500608:12345-0@lo:13: Request processed in 918us (1088us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796894.259513:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1788796894.259617:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cb0774e7100 x1875689374500608/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788796910 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788796894.259643:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb0774e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875689374500608:0@lo:13: 00010000:00010000:1.0:1788796895.026294:0:5815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788796896.050208:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788796897.086339:0:5815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788796897.338252:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb048e28380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875689374500992:0@lo:400: 00000100:00100000:2.0:1788796897.338336:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788796897.338409:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788796897.338416:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb048e29180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3300:1875689374501120:0@lo:400: 00000100:00100000:2.0:1788796897.338444:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788796897.338481:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374501120 00000100:00100000:2.0:1788796897.338490:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374501120 00000100:00100000:2.0:1788796897.338545:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788796897.338555:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb048e2b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1875689374501120:12345-0@lo:400: 00000100:00100000:2.0:1788796897.338607:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb048e2b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1875689374501120:12345-0@lo:400: Request processed in 55us (162us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796897.338615:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:2.0:1788796897.338653:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1788796897.338684:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cb048e29180 x1875689374501120/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788796913 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788796897.338699:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb048e29180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3300:1875689374501120:0@lo:400: 00000100:00100000:1.0:1788796897.338934:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb048e29880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875689374500864:0@lo:400: 00000100:00100000:1.0:1788796897.338967:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788796897.338997:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1788796897.339004:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb048e28a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:3303:1875689374500736:0@lo:400: 00000100:00100000:1.0:1788796897.339060:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788796897.339085:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb048e28000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3303:1875689374501248:0@lo:400: 00000100:00100000:1.0:1788796897.339119:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788796897.339158:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374500864 00000100:00100000:1.0:1788796897.339162:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374500864 00000100:00100000:1.0:1788796897.339190:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374501248 00000100:00100000:1.0:1788796897.339192:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374501248 00000100:00100000:1.0:1788796897.339218:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788796897.339224:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0498ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875689374500864:12345-0@lo:400: 00000100:00100000:1.0:1788796897.339263:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0498ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875689374500864:12345-0@lo:400: Request processed in 39us (296us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796897.339282:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788796897.339296:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788796897.339302:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0498edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1875689374501248:12345-0@lo:400: 00000100:00100000:1.0:1788796897.339331:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0498edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1875689374501248:12345-0@lo:400: Request processed in 29us (212us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796897.339337:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:1.0:1788796897.339354:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1788796897.339374:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cb048e28000 x1875689374501248/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788796913 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788796897.339385:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb048e28000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3303:1875689374501248:0@lo:400: 00010000:00080000:1.0:1788796897.339395:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cb048e29880 x1875689374500864/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788796913 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788796897.339403:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb048e29880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875689374500864:0@lo:400: 00000100:00100000:0.0:1788796897.339618:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374500992 00000100:00100000:0.0:1788796897.339623:0:6683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374500992 00000100:00100000:0.0:1788796897.339662:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788796897.339669:0:6683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb048e2aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3300:x1875689374500992:12345-0@lo:400: 00000100:00100000:0.0:1788796897.339713:0:6683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb048e2aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3300:x1875689374500992:12345-0@lo:400: Request processed in 45us (1377us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796897.339720:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788796897.339743:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374500736 00000100:00100000:0.0:1788796897.339747:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374500736 00000100:00100000:0.0:1788796897.339772:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1788796897.339777:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb04886a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+13:3303:x1875689374500736:12345-0@lo:400: 00000100:00100000:0.0:1788796897.339811:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb04886a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+13:3303:x1875689374500736:12345-0@lo:400: Request processed in 33us (750us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796897.339831:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00080000:0.0:1788796897.339863:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788796897.339878:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb048e28a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:3303:1875689374500736:0@lo:400: 00010000:00080000:0.0:1788796897.339903:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cb048e28380 x1875689374500992/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788796913 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788796897.339923:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb048e28380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875689374500992:0@lo:400: 00010000:00010000:3.0:1788796898.098203:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788796899.123219:0:5815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788796899.378584:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb0774e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875689374501376:0@lo:13: 00000100:00100000:3.0:1788796899.378653:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796899.378742:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374501376 00000100:00100000:3.0:1788796899.378750:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374501376 00000100:00100000:3.0:1788796899.378818:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788796899.378828:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0774e7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875689374501376:12345-0@lo:13: 00002000:00000024:3.0:1788796899.378870:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788796899.378916:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0774e7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875689374501376:12345-0@lo:13: Request processed in 89us (263us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796899.378922:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:3.0:1788796899.378941:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788796899.378969:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cb0774e5c00 x1875689374501376/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788796915 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788796899.378987:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb0774e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875689374501376:0@lo:13: 00000001:02000400:2.0:1788796899.799738:0:7980:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg438-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 10000000:01000000:2.0:1788796899.892593:0:5822:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788796899.892600:0:5822:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8cb042fda000 from 30 10000000:01000000:2.0:1788796899.892605:0:5822:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788796899.892649:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.138@tcp lock: ffff8cb041484400/0xca7fc0c411f93461 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796899.892660:0:5822:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.138@tcp lock: ffff8cb041484400/0xca7fc0c411f93461 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796899.892672:0:5822:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.138@tcp lock: ffff8cb041484400/0xca7fc0c411f93461 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788796899.892694:0:5822:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb048e29180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:5822:1875689374501504:0@lo:101: 00000100:00100000:2.0:1788796899.892757:0:5822:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788796899.894213:0:5822:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb043604600 going to sleep for 11 seconds 00000100:00100000:1.0:1788796899.899366:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374501504 00000100:00100000:1.0:1788796899.899384:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374501504 00000100:00100000:1.0:1788796899.899578:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1788796899.899590:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb04886b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+13:5822:x1875689374501504:12345-0@lo:101: 00010000:00010000:1.0:1788796899.899614:0:5820:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788796899.899634:0:5820:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cb0821f0e00/0xca7fc0c411f93468 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xca7fc0c411f93461 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796899.899664:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cb0821f0e00/0xca7fc0c411f93468 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xca7fc0c411f93461 expref: 14 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796899.899676:0:5820:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cb0821f0e00/0xca7fc0c411f93468 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xca7fc0c411f93461 expref: 14 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796899.899700:0:5820:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb0821f0e00, rc 0) 00000100:00100000:1.0:1788796899.899787:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb04886b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+14:5822:x1875689374501504:12345-0@lo:101: Request processed in 198us (7028us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796899.899794:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1788796899.900196:0:5822:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb048e29180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:5822:1875689374501504:0@lo:101: 00010000:00010000:2.0:1788796899.900215:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.138@tcp lock: ffff8cb041484400/0xca7fc0c411f93461 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xca7fc0c411f93468 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796899.900225:0:5822:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.138@tcp lock: ffff8cb041484400/0xca7fc0c411f93461 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xca7fc0c411f93468 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788796899.900292:0:5822:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb048e29180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:5822:1875689374501632:0@lo:501: 00000100:00100000:2.0:1788796899.900335:0:5822:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788796899.900373:0:5822:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb043604600 going to sleep for 11 seconds 00000100:00100000:3.0:1788796899.901068:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374501632 00000100:00100000:3.0:1788796899.901182:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374501632 00000100:00100000:3.0:1788796899.901227:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1788796899.901235:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb048869850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+14:5822:x1875689374501632:12345-0@lo:501: 00000100:00100000:3.0:1788796899.901609:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb048869850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+14:5822:x1875689374501632:12345-0@lo:501: Request processed in 374us (1272us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796899.901629:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1788796899.901677:0:5822:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb048e29180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:5822:1875689374501632:0@lo:501: 00000100:00100000:3.0:1788796899.901715:0:5822:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb0774e5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:5822:1875689374501760:0@lo:503: 00000100:00100000:3.0:1788796899.901759:0:5822:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796899.901798:0:5822:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb069af3d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788796899.901812:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374501760 00000100:00100000:3.0:1788796899.901816:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374501760 00000100:00100000:3.0:1788796899.901841:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1788796899.901849:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb04886b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+14:5822:x1875689374501760:12345-0@lo:503: 00000100:00100000:3.0:1788796899.909267:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb04886b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+14:5822:x1875689374501760:12345-0@lo:503: Request processed in 7412us (7501us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796899.909281:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1788796899.916282:0:5822:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb0774e5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:5822:1875689374501760:0@lo:503: 00000100:00100000:0.0:1788796899.917307:0:7987:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb06f60b100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:7987:1875689374501888:0@lo:502: 00000100:00100000:0.0:1788796899.917391:0:7987:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788796899.917473:0:7987:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb0437760c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788796899.921376:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374501888 00000100:00100000:1.0:1788796899.921393:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374501888 00000100:00100000:0.0:1788796899.922910:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1788796899.922924:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb048869c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+14:7987:x1875689374501888:12345-0@lo:502: 00000100:00100000:0.0:1788796899.923315:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb048869c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+14:7987:x1875689374501888:12345-0@lo:502: Request processed in 394us (5923us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796899.923323:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1788796899.923387:0:7987:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb06f60b100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:7987:1875689374501888:0@lo:502: 00000100:00100000:0.0:1788796899.923454:0:7987:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb06f60b100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:7987:1875689374502016:0@lo:502: 00000100:00100000:0.0:1788796899.923497:0:7987:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788796899.923538:0:7987:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb077d100c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788796899.923701:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374502016 00000100:00100000:1.0:1788796899.923708:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374502016 00000100:00100000:1.0:1788796899.923742:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1788796899.923750:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb04886b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+14:7987:x1875689374502016:12345-0@lo:502: 00000100:00100000:1.0:1788796899.923907:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb04886b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+14:7987:x1875689374502016:12345-0@lo:502: Request processed in 158us (410us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796899.923914:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1788796899.923984:0:7987:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb06f60b100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:7987:1875689374502016:0@lo:502: 00000040:00080000:0.0:1788796899.924005:0:7987:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:1.0:1788796899.924342:0:5822:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:1.0:1788796899.924361:0:5822:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.138@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788796899.924370:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.138@tcp lock: ffff8cb041484400/0xca7fc0c411f93461 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xca7fc0c411f93468 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796899.924381:0:5822:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.138@tcp lock: ffff8cb041484400/0xca7fc0c411f93461 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xca7fc0c411f93468 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788796899.924391:0:5822:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:1.0:1788796899.924393:0:5822:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:1.0:1788796899.924396:0:5822:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1788796899.924420:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.138@tcp lock: ffff8cb0821f0600/0xca7fc0c411f9346f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796899.924429:0:5822:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.138@tcp lock: ffff8cb0821f0600/0xca7fc0c411f9346f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796899.924445:0:5822:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.138@tcp lock: ffff8cb0821f0600/0xca7fc0c411f9346f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788796899.924459:0:5822:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb0498ece00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:5822:1875689374502144:0@lo:101: 00000100:00100000:1.0:1788796899.924492:0:5822:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788796899.924516:0:5822:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb0465d4540 going to sleep for 11 seconds 00000100:00100000:0.0:1788796899.925288:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374502144 00000100:00100000:0.0:1788796899.925297:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374502144 00000100:00100000:0.0:1788796899.925355:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1788796899.925367:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb048868050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+14:5822:x1875689374502144:12345-0@lo:101: 00010000:00010000:0.0:1788796899.925381:0:5819:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788796899.925400:0:5819:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cb040030800/0xca7fc0c411f93476 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xca7fc0c411f9346f expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796899.925445:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cb040030800/0xca7fc0c411f93476 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xca7fc0c411f9346f expref: 15 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796899.925458:0:5819:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cb040030800/0xca7fc0c411f93476 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xca7fc0c411f9346f expref: 15 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796899.925470:0:5819:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb040030800, rc 0) 00000100:00100000:0.0:1788796899.925530:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb048868050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+15:5822:x1875689374502144:12345-0@lo:101: Request processed in 166us (1037us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796899.925537:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1788796899.926279:0:5822:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb0498ece00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:5822:1875689374502144:0@lo:101: 00010000:00010000:1.0:1788796899.926302:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.138@tcp lock: ffff8cb0821f0600/0xca7fc0c411f9346f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xca7fc0c411f93476 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796899.926312:0:5822:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.138@tcp lock: ffff8cb0821f0600/0xca7fc0c411f9346f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xca7fc0c411f93476 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788796899.926379:0:5822:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb0498ece00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:5822:1875689374502272:0@lo:501: 00000100:00100000:1.0:1788796899.926417:0:5822:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788796899.926443:0:5822:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb0465d4540 going to sleep for 11 seconds 00000100:00100000:1.0:1788796899.926464:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374502272 00000100:00100000:1.0:1788796899.926469:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374502272 00000100:00100000:1.0:1788796899.926494:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1788796899.926501:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb04886a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+15:5822:x1875689374502272:12345-0@lo:501: 00000100:00100000:1.0:1788796899.926786:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb04886a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+15:5822:x1875689374502272:12345-0@lo:501: Request processed in 283us (366us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796899.926794:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1788796899.926829:0:5822:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb0498ece00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:5822:1875689374502272:0@lo:501: 00000100:00100000:1.0:1788796899.926858:0:5822:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb0498ece00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:5822:1875689374502400:0@lo:503: 00000100:00100000:1.0:1788796899.926904:0:5822:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788796899.926917:0:5822:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb0465d4540 going to sleep for 11 seconds 00000100:00100000:1.0:1788796899.926929:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374502400 00000100:00100000:1.0:1788796899.926932:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374502400 00000100:00100000:1.0:1788796899.926948:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1788796899.926953:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb04886a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+15:5822:x1875689374502400:12345-0@lo:503: 00000100:00100000:1.0:1788796899.927557:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb04886a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+15:5822:x1875689374502400:12345-0@lo:503: Request processed in 602us (651us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796899.927565:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1788796899.927708:0:5822:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb0498ece00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:5822:1875689374502400:0@lo:503: 00000100:00100000:0.0:1788796899.928476:0:7989:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb06f60b100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:7989:1875689374502528:0@lo:502: 00000100:00100000:0.0:1788796899.928521:0:7989:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788796899.928589:0:7989:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb0437760c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788796899.928691:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374502528 00000100:00100000:3.0:1788796899.928698:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374502528 00000100:00100000:3.0:1788796899.928783:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1788796899.928792:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb060707850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+15:7989:x1875689374502528:12345-0@lo:502: 00000100:00100000:3.0:1788796899.929462:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb060707850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+15:7989:x1875689374502528:12345-0@lo:502: Request processed in 669us (938us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796899.929471:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1788796899.929539:0:7989:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb06f60b100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:7989:1875689374502528:0@lo:502: 00000020:01000000:0.0:1788796899.929566:0:7989:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788796899.929574:0:7989:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788796899.929577:0:7989:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788796899.929581:0:7989:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788796899.929583:0:7989:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1788796899.929600:0:7989:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb06f60b100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:7989:1875689374502656:0@lo:502: 00000100:00100000:0.0:1788796899.929707:0:7989:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788796899.929784:0:7989:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb0464b3e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788796899.929814:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374502656 00000100:00100000:1.0:1788796899.929820:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374502656 00000100:00100000:1.0:1788796899.929881:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1788796899.929889:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb060705c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+15:7989:x1875689374502656:12345-0@lo:502: 00000100:00100000:1.0:1788796899.930074:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb060705c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+15:7989:x1875689374502656:12345-0@lo:502: Request processed in 186us (366us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796899.930080:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1788796899.930465:0:7989:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb06f60b100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:7989:1875689374502656:0@lo:502: 00000020:01000000:0.0:1788796899.930487:0:7989:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788796899.930492:0:7989:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788796899.930493:0:7989:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000040:00080000:0.0:1788796899.930497:0:7989:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000020:01000000:3.0:1788796899.930734:0:5822:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:3.0:1788796899.930757:0:5822:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.138@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1788796899.930778:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.138@tcp lock: ffff8cb0821f0600/0xca7fc0c411f9346f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xca7fc0c411f93476 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796899.930790:0:5822:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.138@tcp lock: ffff8cb0821f0600/0xca7fc0c411f9346f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xca7fc0c411f93476 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788796899.930807:0:5822:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1788796899.930810:0:5822:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8cb042f0b000 from 30 10000000:01000000:3.0:1788796899.930813:0:5822:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788796899.930842:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.138@tcp lock: ffff8cb080437a00/0xca7fc0c411f9347d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796899.930851:0:5822:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.138@tcp lock: ffff8cb080437a00/0xca7fc0c411f9347d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796899.930860:0:5822:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.138@tcp lock: ffff8cb080437a00/0xca7fc0c411f9347d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788796899.930875:0:5822:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb0774e7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:5822:1875689374502784:0@lo:101: 00000100:00100000:3.0:1788796899.930910:0:5822:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796899.930953:0:5822:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb069af3180 going to sleep for 11 seconds 00000100:00100000:0.0:1788796899.931077:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374502784 00000100:00100000:0.0:1788796899.931082:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374502784 00000100:00100000:0.0:1788796899.931131:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1788796899.931139:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb060707050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+15:5822:x1875689374502784:12345-0@lo:101: 00010000:00010000:0.0:1788796899.931149:0:5818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788796899.931162:0:5818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cb040031400/0xca7fc0c411f93484 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xca7fc0c411f9347d expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796899.931190:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cb040031400/0xca7fc0c411f93484 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xca7fc0c411f9347d expref: 16 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796899.931203:0:5818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cb040031400/0xca7fc0c411f93484 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xca7fc0c411f9347d expref: 16 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796899.931214:0:5818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb040031400, rc 0) 00000100:00100000:0.0:1788796899.931253:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb060707050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+16:5822:x1875689374502784:12345-0@lo:101: Request processed in 115us (342us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796899.931259:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1788796899.931290:0:5822:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb0774e7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:5822:1875689374502784:0@lo:101: 00010000:00010000:0.0:1788796899.931302:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.138@tcp lock: ffff8cb080437a00/0xca7fc0c411f9347d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xca7fc0c411f93484 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796899.931312:0:5822:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.138@tcp lock: ffff8cb080437a00/0xca7fc0c411f9347d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xca7fc0c411f93484 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788796899.931352:0:5822:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb06f60b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:5822:1875689374502912:0@lo:501: 00000100:00100000:0.0:1788796899.931377:0:5822:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788796899.931390:0:5822:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb0464b3e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788796899.931402:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374502912 00000100:00100000:0.0:1788796899.931411:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374502912 00000100:00100000:0.0:1788796899.931427:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1788796899.931433:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb060704050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+16:5822:x1875689374502912:12345-0@lo:501: 00000100:00100000:0.0:1788796899.931721:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb060704050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+16:5822:x1875689374502912:12345-0@lo:501: Request processed in 287us (342us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796899.931729:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1788796899.931757:0:5822:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb06f60b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:5822:1875689374502912:0@lo:501: 00000100:00100000:0.0:1788796899.931794:0:5822:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb06f60b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:5822:1875689374503040:0@lo:503: 00000100:00100000:0.0:1788796899.931829:0:5822:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788796899.931842:0:5822:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb0464b3e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788796899.931853:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374503040 00000100:00100000:0.0:1788796899.931856:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374503040 00000100:00100000:0.0:1788796899.931872:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1788796899.931878:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb048869050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+16:5822:x1875689374503040:12345-0@lo:503: 00000100:00100000:0.0:1788796899.932012:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb048869050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+16:5822:x1875689374503040:12345-0@lo:503: Request processed in 133us (183us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796899.932019:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1788796899.932074:0:5822:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb06f60b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:5822:1875689374503040:0@lo:503: 00000100:00100000:0.0:1788796899.932250:0:7990:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb06f60b100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:7990:1875689374503168:0@lo:502: 00000100:00100000:0.0:1788796899.932282:0:7990:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788796899.932301:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374503168 00000100:00100000:0.0:1788796899.932304:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374503168 00000100:00100000:0.0:1788796899.932321:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1788796899.932327:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb060706450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+16:7990:x1875689374503168:12345-0@lo:502: 00000100:00100000:0.0:1788796899.932482:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb060706450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+16:7990:x1875689374503168:12345-0@lo:502: Request processed in 154us (199us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796899.932496:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1788796899.932521:0:7990:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb06f48f900 going to sleep for 11 seconds 00000100:00100000:0.0:1788796899.932531:0:7990:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb06f60b100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:7990:1875689374503168:0@lo:502: 00000100:00100000:0.0:1788796899.932565:0:7990:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb06f60b100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:7990:1875689374503296:0@lo:502: 00000100:00100000:0.0:1788796899.932594:0:7990:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788796899.932611:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374503296 00000100:00100000:0.0:1788796899.932614:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374503296 00000100:00100000:0.0:1788796899.933361:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1788796899.933371:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb060704c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+16:7990:x1875689374503296:12345-0@lo:502: 00000100:00100000:0.0:1788796899.933565:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb060704c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+16:7990:x1875689374503296:12345-0@lo:502: Request processed in 195us (970us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796899.933572:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1788796899.933615:0:7990:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb06f48f900 going to sleep for 11 seconds 00000100:00100000:0.0:1788796899.936863:0:7990:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb06f60b100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:7990:1875689374503296:0@lo:502: 00000040:00080000:0.0:1788796899.936927:0:7990:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:0.0:1788796899.937006:0:5822:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:0.0:1788796899.937024:0:5822:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.138@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788796899.937050:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.138@tcp lock: ffff8cb080437a00/0xca7fc0c411f9347d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xca7fc0c411f93484 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796899.937063:0:5822:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.138@tcp lock: ffff8cb080437a00/0xca7fc0c411f9347d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xca7fc0c411f93484 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788796899.937072:0:5822:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788796899.937075:0:5822:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8cb042f0b000 from 5 10000000:01000000:0.0:1788796899.937077:0:5822:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788796899.937491:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.138@tcp lock: ffff8cb079b80200/0xca7fc0c411f9348b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796899.937738:0:5822:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.138@tcp lock: ffff8cb079b80200/0xca7fc0c411f9348b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796899.937749:0:5822:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.138@tcp lock: ffff8cb079b80200/0xca7fc0c411f9348b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788796899.937782:0:5822:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb06f60b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:5822:1875689374503424:0@lo:101: 00000100:00100000:0.0:1788796899.937850:0:5822:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788796899.937905:0:5822:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb06f48f900 going to sleep for 11 seconds 00000100:00100000:1.0:1788796899.938063:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374503424 00000100:00100000:1.0:1788796899.938071:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374503424 00000100:00100000:0.0:1788796899.938360:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1788796899.938372:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb060706c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+16:5822:x1875689374503424:12345-0@lo:101: 00010000:00010000:0.0:1788796899.938386:0:5818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788796899.938400:0:5818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cb079b80800/0xca7fc0c411f93492 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xca7fc0c411f9348b expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796899.938423:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cb079b80800/0xca7fc0c411f93492 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xca7fc0c411f9348b expref: 17 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796899.938433:0:5818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cb079b80800/0xca7fc0c411f93492 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xca7fc0c411f9348b expref: 17 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796899.938441:0:5818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb079b80800, rc 0) 00000100:00100000:0.0:1788796899.938483:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb060706c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+17:5822:x1875689374503424:12345-0@lo:101: Request processed in 114us (633us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796899.938490:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1788796899.938532:0:5822:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb06f60b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:5822:1875689374503424:0@lo:101: 00010000:00010000:0.0:1788796899.938546:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.138@tcp lock: ffff8cb079b80200/0xca7fc0c411f9348b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xca7fc0c411f93492 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796899.938560:0:5822:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.138@tcp lock: ffff8cb079b80200/0xca7fc0c411f9348b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xca7fc0c411f93492 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788796899.938607:0:5822:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb06f60b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:5822:1875689374503552:0@lo:256: 00000100:00100000:0.0:1788796899.938776:0:5822:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788796899.938805:0:5822:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb06f48f900 going to sleep for 11 seconds 00000100:00100000:2.0:1788796899.938865:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374503552 00000100:00100000:2.0:1788796899.938871:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374503552 00000100:00100000:2.0:1788796899.938906:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1788796899.938914:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb060704450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+17:5822:x1875689374503552:12345-0@lo:256: 20000000:01000000:2.0:1788796899.938927:0:5819:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788796899.938943:0:5819:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788796899.938947:0:5819:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:2.0:1788796899.939516:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb060704450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+17:5822:x1875689374503552:12345-0@lo:256: Request processed in 601us (748us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796899.939524:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1788796899.939611:0:5822:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb06f60b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:5822:1875689374503552:0@lo:256: 10000000:01000000:1.0:1788796899.939733:0:5822:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.138@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788796899.939740:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.138@tcp lock: ffff8cb079b80200/0xca7fc0c411f9348b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xca7fc0c411f93492 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796899.939749:0:5822:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.138@tcp lock: ffff8cb079b80200/0xca7fc0c411f9348b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xca7fc0c411f93492 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788796899.939757:0:5822:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1788796899.939760:0:5822:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:1.0:1788796899.939780:0:5822:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1788796899.939801:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.138@tcp lock: ffff8cb0821f0400/0xca7fc0c411f93499 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796899.939809:0:5822:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.138@tcp lock: ffff8cb0821f0400/0xca7fc0c411f93499 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796899.939818:0:5822:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.138@tcp lock: ffff8cb0821f0400/0xca7fc0c411f93499 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788796899.939832:0:5822:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb0498ece00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:5822:1875689374503680:0@lo:101: 00000100:00100000:1.0:1788796899.939862:0:5822:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788796899.939895:0:5822:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb0465d4c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788796899.939948:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374503680 00000100:00100000:2.0:1788796899.939952:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374503680 00000100:00100000:2.0:1788796899.940021:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1788796899.940053:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb060705450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+17:5822:x1875689374503680:12345-0@lo:101: 00010000:00010000:2.0:1788796899.940062:0:5820:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788796899.940073:0:5820:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cb041484c00/0xca7fc0c411f934a0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xca7fc0c411f93499 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796899.940091:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cb041484c00/0xca7fc0c411f934a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xca7fc0c411f93499 expref: 18 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796899.940101:0:5820:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cb041484c00/0xca7fc0c411f934a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xca7fc0c411f93499 expref: 18 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796899.940108:0:5820:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb041484c00, rc 0) 00000100:00100000:2.0:1788796899.940148:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb060705450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+18:5822:x1875689374503680:12345-0@lo:101: Request processed in 120us (285us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796899.940162:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1788796899.940233:0:5822:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb0498ece00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:5822:1875689374503680:0@lo:101: 00010000:00010000:1.0:1788796899.940245:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.138@tcp lock: ffff8cb0821f0400/0xca7fc0c411f93499 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xca7fc0c411f934a0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796899.940253:0:5822:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.138@tcp lock: ffff8cb0821f0400/0xca7fc0c411f93499 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xca7fc0c411f934a0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788796899.940298:0:5822:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb0498ece00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:5822:1875689374503808:0@lo:501: 00000100:00100000:1.0:1788796899.940322:0:5822:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788796899.940597:0:5822:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb0465d4c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788796899.940709:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374503808 00000100:00100000:0.0:1788796899.940714:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374503808 00000100:00100000:0.0:1788796899.940738:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1788796899.940745:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb060706850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+18:5822:x1875689374503808:12345-0@lo:501: 00000100:00100000:0.0:1788796899.940992:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb060706850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+18:5822:x1875689374503808:12345-0@lo:501: Request processed in 247us (669us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796899.941000:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1788796899.941046:0:5822:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb0498ece00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:5822:1875689374503808:0@lo:501: 00000100:00100000:0.0:1788796899.941075:0:5822:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb06f60a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:5822:1875689374503936:0@lo:503: 00000100:00100000:0.0:1788796899.941125:0:5822:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788796899.941141:0:5822:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb06f48f480 going to sleep for 11 seconds 00000100:00100000:0.0:1788796899.941153:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374503936 00000100:00100000:0.0:1788796899.941157:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374503936 00000100:00100000:0.0:1788796899.941328:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1788796899.941339:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb060707c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+18:5822:x1875689374503936:12345-0@lo:503: 00000100:00100000:0.0:1788796899.941648:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb060707c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+18:5822:x1875689374503936:12345-0@lo:503: Request processed in 311us (535us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796899.941656:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1788796899.941665:0:5822:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb06f60a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:5822:1875689374503936:0@lo:503: 00000100:00100000:0.0:1788796899.941982:0:7992:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb06f609c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:7992:1875689374504064:0@lo:502: 00000100:00100000:0.0:1788796899.942023:0:7992:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788796899.943321:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374504064 00000100:00100000:2.0:1788796899.943332:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374504064 00000100:00100000:2.0:1788796899.943373:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1788796899.943382:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb060704850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+18:7992:x1875689374504064:12345-0@lo:502: 00000100:00100000:0.0:1788796899.943775:0:7992:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb06f48fcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788796899.944019:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb060704850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+18:7992:x1875689374504064:12345-0@lo:502: Request processed in 636us (1993us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796899.944052:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1788796899.944321:0:7992:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb06f609c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:7992:1875689374504064:0@lo:502: 00000020:01000000:1.0:1788796899.944359:0:7992:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788796899.944366:0:7992:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:1.0:1788796899.944374:0:7992:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788796899.944376:0:7992:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1788796899.944382:0:7992:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788796899.944391:0:7992:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.138@tcp to nid 0x20000c0a8cc8a (192.168.204.138@tcp) 00000020:01000000:1.0:1788796899.944415:0:7992:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1788796899.944419:0:7992:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788796899.944436:0:7992:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff8cb049934d40) 00000020:00000080:1.0:1788796899.944458:0:7992:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:1.0:1788796899.944463:0:7992:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788796899.944540:0:7992:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:1.0:1788796899.944545:0:7992:0:(osd_handler.c:1574:osd_obd_connect()) connect #6 00000020:00000080:1.0:1788796899.944552:0:7992:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xca7fc0c411f934ae 00010000:00080000:1.0:1788796899.944579:0:7992:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8caf419b3800@lustre-OST0001-osc-MDT0000: add connection 192.168.204.138@tcp at head 00010000:00010000:1.0:1788796899.944892:0:7992:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-5 is initialized 00000040:01000000:0.0:1788796899.945434:0:7992:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:0.0:1788796899.945448:0:7992:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1788796899.945965:0:7992:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788796899.946312:0:7992:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788796899.946362:0:7992:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:0.0:1788796899.946425:0:7992:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:0.0:1788796899.947012:0:7994:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788796899.947017:0:7994:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:0.0:1788796899.948510:0:7992:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788796899.948523:0:7992:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1788796899.948558:0:7992:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1788796899.948580:0:7992:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xca7fc0c411f934b5 00000100:00080000:0.0:1788796899.948590:0:7992:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788796899.948601:0:7992:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8caf419b3800 using connection 192.168.204.138@tcp/0@lo 00000100:00100000:0.0:1788796899.948641:0:7992:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cb06f609c00 x1875689374504192/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788796899.948670:0:7992:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:0.0:1788796899.948750:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb06f60a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3300:1875689374504320:0@lo:400: 00000100:00100000:0.0:1788796899.948823:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788796899.948855:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374504320 00000100:00100000:1.0:1788796899.948863:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374504320 00000100:00100000:0.0:1788796899.948863:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788796899.948868:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb06f60b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3300:1875689374504448:0@lo:400: 00000100:00100000:0.0:1788796899.948901:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788796899.948904:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788796899.948913:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb06f60bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1875689374504320:12345-0@lo:400: 00000020:01000000:0.0:1788796899.948953:0:7992:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788796899.948958:0:7992:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788796899.948960:0:7992:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1788796899.948963:0:7992:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000100:00100000:1.0:1788796899.948964:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb06f60bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1875689374504320:12345-0@lo:400: Request processed in 53us (141us total) trans 0 rc 0/0 00000020:00000080:0.0:1788796899.948966:0:7992:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000100:00100000:1.0:1788796899.948971:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000020:00000080:0.0:1788796899.948972:0:7992:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788796899.948976:0:7992:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788796899.948978:0:7992:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1788796899.948983:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374504448 00000100:00100000:1.0:1788796899.948985:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374504448 00000100:00100000:0.0:1788796899.949001:0:7992:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb079b90e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:7992:1875689374504704:0@lo:502: 00000100:00100000:1.0:1788796899.949009:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788796899.949016:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb079b93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1875689374504448:12345-0@lo:400: 00000100:00100000:1.0:1788796899.949057:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb079b93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1875689374504448:12345-0@lo:400: Request processed in 43us (156us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796899.949064:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788796899.949068:0:7992:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788796899.949089:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374504704 00000100:00100000:1.0:1788796899.949092:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374504704 00000100:00100000:1.0:1788796899.949113:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1788796899.949215:0:7992:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb06f48f480 going to sleep for 11 seconds 00000100:00100000:1.0:1788796899.949298:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb060706050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+18:7992:x1875689374504704:12345-0@lo:502: 00000100:00100000:2.0:1788796899.949333:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb06f609c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3299:1875689374504192:0@lo:8: 00000100:00100000:2.0:1788796899.949370:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788796899.949432:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374504192 00000100:00100000:2.0:1788796899.949436:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374504192 00000100:00100000:2.0:1788796899.949460:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788796899.949465:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb048e29180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3299:x1875689374504192:12345-0@lo:8: 00010000:00080000:2.0:1788796899.949489:0:6681:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 188 last 0 00000020:00000080:2.0:1788796899.949518:0:6681:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xca7fc0c411f934bc 00002000:00100000:2.0:1788796899.949534:0:6681:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff8cb077ecd800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:2.0:1788796899.949539:0:6681:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00000001:00000004:2.0:1788796899.949545:0:6681:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:1.0:1788796899.949554:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb060706050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+18:7992:x1875689374504704:12345-0@lo:502: Request processed in 258us (497us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796899.949561:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00002000:00100000:2.0:1788796899.949694:0:6681:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00010000:00080000:1.0:1788796899.949702:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cb06f60b100 x1875689374504448/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788796915 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788796899.949721:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb06f60b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3300:1875689374504448:0@lo:400: 00010000:00080000:1.0:1788796899.949737:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cb06f60a300 x1875689374504320/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788796915 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788796899.949745:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb06f60a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3300:1875689374504320:0@lo:400: 00002000:00080000:2.0:1788796899.949868:0:6681:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788796899.949890:0:6681:0:(import.c:65:import_set_state_nolock()) ffff8cb077ecb000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788796899.949931:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb048e29180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3299:x1875689374504192:12345-0@lo:8: Request processed in 464us (559us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796899.949938:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1788796899.949968:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cb06f609c00 x1875689374504192/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788796909 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788796899.949982:0:3299:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788796899.949989:0:3299:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1788796899.949997:0:3299:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1788796899.950002:0:3299:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1788796899.950004:0:3299:0:(import.c:65:import_set_state_nolock()) ffff8caf419b3800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1788796899.950012:0:3299:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1788796899.950016:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb06f609c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3299:1875689374504192:0@lo:8: 00000004:00080000:0.0:1788796899.950347:0:7994:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1788796899.950443:0:7994:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 188956413410ns, next at 0ns, rc = 0 00000100:00100000:0.0:1788796899.950483:0:7992:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb079b90e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:7992:1875689374504704:0@lo:502: 00000020:01000000:0.0:1788796899.950509:0:7992:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788796899.950514:0:7992:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788796899.950516:0:7992:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000040:00080000:0.0:1788796899.950521:0:7992:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000100:00100000:3.0:1788796899.950838:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb06f60b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3302:1875689374504576:0@lo:400: 00000100:00100000:3.0:1788796899.950881:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788796899.950928:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:01000000:3.0:1788796899.950937:0:5822:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:3.0:1788796899.950954:0:5822:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.138@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1788796899.950963:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.138@tcp lock: ffff8cb0821f0400/0xca7fc0c411f93499 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xca7fc0c411f934a0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796899.950974:0:5822:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.138@tcp lock: ffff8cb0821f0400/0xca7fc0c411f93499 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xca7fc0c411f934a0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788796899.950983:0:5822:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1788796899.950991:0:5822:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8cb0494f0000 from 1 10000000:01000000:3.0:1788796899.950994:0:5822:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1788796899.951019:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.138@tcp lock: ffff8cb080436400/0xca7fc0c411f934c3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796899.951052:0:5822:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.138@tcp lock: ffff8cb080436400/0xca7fc0c411f934c3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796899.951071:0:5822:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.138@tcp lock: ffff8cb080436400/0xca7fc0c411f934c3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788796899.951091:0:5822:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb0774e6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:5822:1875689374504832:0@lo:101: 00000100:00100000:3.0:1788796899.951234:0:5822:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796899.951262:0:5822:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb069af3900 going to sleep for 11 seconds 00000100:00100000:3.0:1788796899.951279:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374504832 00000100:00100000:3.0:1788796899.951284:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374504832 00000100:00100000:3.0:1788796899.951314:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1788796899.951321:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb060707450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+18:5822:x1875689374504832:12345-0@lo:101: 00010000:00010000:3.0:1788796899.951331:0:5820:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788796899.951342:0:5820:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cb080436000/0xca7fc0c411f934ca lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xca7fc0c411f934c3 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796899.951361:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cb080436000/0xca7fc0c411f934ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xca7fc0c411f934c3 expref: 19 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796899.951370:0:5820:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cb080436000/0xca7fc0c411f934ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xca7fc0c411f934c3 expref: 19 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796899.951378:0:5820:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb080436000, rc 0) 00000100:00100000:3.0:1788796899.951404:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb060707450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+19:5822:x1875689374504832:12345-0@lo:101: Request processed in 83us (169us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796899.951414:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1788796899.951449:0:5822:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb0774e6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:5822:1875689374504832:0@lo:101: 00010000:00010000:3.0:1788796899.951460:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.138@tcp lock: ffff8cb080436400/0xca7fc0c411f934c3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xca7fc0c411f934ca expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796899.951468:0:5822:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.138@tcp lock: ffff8cb080436400/0xca7fc0c411f934c3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xca7fc0c411f934ca expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788796899.951505:0:5822:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb0774e6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:5822:1875689374504960:0@lo:501: 00000100:00100000:3.0:1788796899.951527:0:5822:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796899.951539:0:5822:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb069af3900 going to sleep for 11 seconds 00000100:00100000:3.0:1788796899.951550:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374504960 00000100:00100000:3.0:1788796899.951554:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374504960 00000100:00100000:3.0:1788796899.951581:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1788796899.951587:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb060705850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+19:5822:x1875689374504960:12345-0@lo:501: 00000100:00100000:3.0:1788796899.951799:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb060705850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+19:5822:x1875689374504960:12345-0@lo:501: Request processed in 211us (270us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788796899.951806:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1788796899.951935:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374504576 00000100:00100000:2.0:1788796899.951940:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374504576 00000100:00100000:2.0:1788796899.951971:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788796899.951977:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0774e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1875689374504576:12345-0@lo:400: 00000100:00100000:2.0:1788796899.952015:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0774e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1875689374504576:12345-0@lo:400: Request processed in 38us (1135us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796899.952021:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788796899.952171:0:5822:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb0774e6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:5822:1875689374504960:0@lo:501: 00000100:00080000:3.0:1788796899.953022:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1788796899.953182:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cb06f60b480 x1875689374504576/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788796915 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788796899.953196:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb06f60b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3302:1875689374504576:0@lo:400: 10000000:01000000:1.0:1788796899.953362:0:5822:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.138@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1788796899.953373:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.138@tcp lock: ffff8cb080436400/0xca7fc0c411f934c3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xca7fc0c411f934ca expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796899.953384:0:5822:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.138@tcp lock: ffff8cb080436400/0xca7fc0c411f934c3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xca7fc0c411f934ca expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788796899.979997:0:7995:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:3.0:1788796899.980052:0:7995:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb0774e6d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7995:1875689374505216:0@lo:7: 00000100:00100000:3.0:1788796899.980144:0:7995:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796899.980180:0:7995:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb069af3d80 going to sleep for 11 seconds 00000004:00080000:3.0:1788796899.980201:0:5848:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000100:00100000:3.0:1788796899.980237:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb0774e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875689374505088:0@lo:13: 00000100:00100000:3.0:1788796899.980263:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796899.980308:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374505088 00000100:00100000:3.0:1788796899.980315:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374505088 00000100:00100000:3.0:1788796899.980367:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788796899.980376:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0774e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3303:x1875689374505088:12345-0@lo:13: 00002000:00000024:3.0:1788796899.980409:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:0.0:1788796899.980411:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374505216 00000100:00100000:0.0:1788796899.980416:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374505216 00000100:00100000:0.0:1788796899.980444:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788796899.980451:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0774e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:7995:x1875689374505216:12345-0@lo:7: 00000100:00100000:3.0:1788796899.980455:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0774e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3303:x1875689374505088:12345-0@lo:13: Request processed in 81us (192us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796899.980461:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:3.0:1788796899.980484:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1788796899.980515:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cb0774e4000 x1875689374505088/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788796915 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788796899.980535:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb0774e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875689374505088:0@lo:13: 00002000:00080000:0.0:1788796899.995983:0:6684:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:0.0:1788796899.995991:0:6684:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:0.0:1788796899.996375:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0774e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7995:x1875689374505216:12345-0@lo:7: Request processed in 15920us (16227us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796899.996386:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1788796899.996436:0:7995:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cb0774e6d80 x1875689374505216/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788796915 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788796899.996452:0:7995:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb0774e6d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7995:1875689374505216:0@lo:7: 00000004:00080000:0.0:1788796899.996465:0:7995:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:0.0:1788796899.996501:0:7995:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb079b90e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7995:1875689374505344:0@lo:5: 00000100:00100000:0.0:1788796899.996534:0:7995:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788796899.996581:0:7995:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb06f48f900 going to sleep for 11 seconds 00000100:00100000:0.0:1788796899.996823:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374505344 00000100:00100000:0.0:1788796899.996831:0:6683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374505344 00000100:00100000:0.0:1788796899.996870:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788796899.996879:0:6683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb079b91f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:7995:x1875689374505344:12345-0@lo:5: 00002000:00080000:0.0:1788796899.996906:0:6683:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:0.0:1788796899.996910:0:6683:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:0.0:1788796899.997479:0:6683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb079b91f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:7995:x1875689374505344:12345-0@lo:5: Request processed in 599us (942us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1788796899.997487:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:0.0:1788796899.997536:0:7995:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cb079b90e00 x1875689374505344/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788796915 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788796899.997549:0:7995:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb079b90e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7995:1875689374505344:0@lo:5: 00000004:00080000:0.0:1788796899.997559:0:7995:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:0.0:1788796899.997587:0:7995:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb079b93100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7995:1875689374505472:0@lo:700: 00000100:00100000:0.0:1788796899.997615:0:7995:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788796899.997708:0:7995:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb06f48f900 going to sleep for 11 seconds 00000100:00100000:0.0:1788796899.997729:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374505472 00000100:00100000:0.0:1788796899.997733:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374505472 00000100:00100000:0.0:1788796899.997779:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788796899.997787:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb079b93800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:7995:x1875689374505472:12345-0@lo:700: 00000100:00100000:0.0:1788796899.997818:0:6690:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb079b91500 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6690:1875689374505600:0@lo:700: 00000100:00100000:0.0:1788796899.997846:0:6690:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788796899.997863:0:6690:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb06f48f000 going to sleep for 11 seconds 00000100:00100000:0.0:1788796899.997893:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374505600 00000100:00100000:0.0:1788796899.997897:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374505600 00000100:00100000:0.0:1788796899.997925:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788796899.997936:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb079b93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6690:x1875689374505600:12345-0@lo:700: 40000000:02000000:0.0:1788796900.041090:0:5832:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost 00000100:00100000:0.0:1788796900.049551:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb079b93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6690:x1875689374505600:12345-0@lo:700: Request processed in 51602us (51691us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796900.049566:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1788796900.049870:0:6690:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cb079b91500 x1875689374505600/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788796915 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788796900.049886:0:6690:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb079b91500 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6690:1875689374505600:0@lo:700: 40000000:02000000:1.0:1788796900.049901:0:6690:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] 00010000:00010000:3.0:1788796900.147478:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788796900.165955:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb079b93800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:7995:x1875689374505472:12345-0@lo:700: Request processed in 168161us (168331us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796900.165970:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000001:00080000:1.0:1788796900.165981:0:7640:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000001:00100000:1.0:1788796900.165993:0:7640:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00080000:0.0:1788796900.166046:0:7995:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cb079b93100 x1875689374505472/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788796915 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788796900.166344:0:7995:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb079b93100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7995:1875689374505472:0@lo:700: 00000004:02000040:1.0:1788796900.237790:0:7995:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 00000100:00100000:1.0:1788796900.244476:0:7995:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb0498ef100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7995:1875689374505728:0@lo:5: 00000100:00100000:1.0:1788796900.244551:0:7995:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788796900.245143:0:7995:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb0465d4180 going to sleep for 11 seconds 00000100:00100000:2.0:1788796900.245780:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374505728 00000100:00100000:2.0:1788796900.245789:0:6683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374505728 00000100:00100000:2.0:1788796900.245888:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788796900.245900:0:6683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0498eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:7995:x1875689374505728:12345-0@lo:5: 00002000:00080000:3.0:1788796900.265997:0:6683:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:3.0:1788796900.266021:0:6683:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:3.0:1788796900.275086:0:6683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0498eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:7995:x1875689374505728:12345-0@lo:5: Request processed in 29177us (30522us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1788796900.275105:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:1.0:1788796900.275203:0:7995:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cb0498ef100 x1875689374505728/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788796916 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788796900.275225:0:7995:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:1.0:1788796900.275337:0:7995:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff8cb0498ef100 x1875689374505728/t4294967298(4294967298) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788796916 ref 3 fl Rpc:RQU/204/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788796900.275524:0:7995:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb0498ef100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7995:1875689374505728:0@lo:5: 00000004:00080000:1.0:1788796900.275541:0:7995:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00010000:00010000:0.0:1788796901.181920:0:5815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788796902.197075:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788796903.219267:0:5815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788796904.243599:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788796904.505705:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788796904.505733:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb0498ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875689374505856:0@lo:13: 00000100:00100000:2.0:1788796904.505804:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788796904.505867:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374505856 00000100:00100000:0.0:1788796904.505876:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374505856 00000100:00100000:0.0:1788796904.505949:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788796904.505958:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb048e28380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1875689374505856:12345-0@lo:13: 00002000:00000024:0.0:1788796904.505989:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788796904.506064:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb048e28380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1875689374505856:12345-0@lo:13: Request processed in 108us (260us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796904.506072:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:1.0:1788796904.506207:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788796904.506407:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cb0498ee300 x1875689374505856/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788796920 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788796904.506426:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb0498ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875689374505856:0@lo:13: 00000100:00100000:3.0:1788796905.013169:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb0774e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:3301:1875689374505984:0@lo:400: 00000100:00100000:3.0:1788796905.013244:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796905.013292:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb0774e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3301:1875689374506496:0@lo:400: 00000100:00100000:3.0:1788796905.013341:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796905.013370:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788796905.013375:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb0774e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3301:1875689374506368:0@lo:400: 00000100:00100000:3.0:1788796905.013395:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796905.013422:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb0774e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875689374506112:0@lo:400: 00000100:00100000:3.0:1788796905.013449:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796905.013465:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb0774e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875689374506624:0@lo:400: 00000100:00100000:3.0:1788796905.013486:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796905.013504:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788796905.013509:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb0774e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875689374506240:0@lo:400: 00000100:00100000:3.0:1788796905.013525:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796905.013556:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374505984 00000100:00100000:3.0:1788796905.013563:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374505984 00000100:00100000:3.0:1788796905.013604:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1788796905.013613:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb060705050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+19:3301:x1875689374505984:12345-0@lo:400: 00000100:00100000:3.0:1788796905.013996:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb060705050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+19:3301:x1875689374505984:12345-0@lo:400: Request processed in 383us (757us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796905.014006:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1788796905.014126:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374506624 00000100:00100000:3.0:1788796905.014131:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374506624 00000100:00100000:3.0:1788796905.014166:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374506240 00000100:00100000:3.0:1788796905.014169:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374506240 00000100:00100000:3.0:1788796905.014183:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788796905.014189:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb06ef1ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3302:x1875689374506624:12345-0@lo:400: 00000100:00100000:3.0:1788796905.014224:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb06ef1ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3302:x1875689374506624:12345-0@lo:400: Request processed in 34us (736us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796905.014278:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788796905.014301:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788796905.014308:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb06ef1df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1875689374506240:12345-0@lo:400: 00000100:00100000:3.0:1788796905.014336:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb06ef1df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1875689374506240:12345-0@lo:400: Request processed in 29us (810us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796905.014340:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788796905.015224:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374506496 00000100:00100000:0.0:1788796905.015254:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374506496 00010000:00080000:3.0:1788796905.015288:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cb0774e6d80 x1875689374506240/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788796921 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788796905.015303:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb0774e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875689374506240:0@lo:400: 00000100:00100000:0.0:1788796905.015423:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374506368 00000100:00100000:0.0:1788796905.015426:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374506368 00000100:00100000:0.0:1788796905.015437:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374506112 00000100:00100000:0.0:1788796905.015439:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374506112 00000100:00100000:0.0:1788796905.015452:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788796905.015458:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb06ef1dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1875689374506496:12345-0@lo:400: 00000100:00100000:0.0:1788796905.015517:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb06ef1dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1875689374506496:12345-0@lo:400: Request processed in 59us (2175us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796905.015522:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788796905.015536:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788796905.016153:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb06ef1e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1875689374506368:12345-0@lo:400: 00000100:00100000:0.0:1788796905.016195:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb06ef1e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1875689374506368:12345-0@lo:400: Request processed in 653us (2797us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796905.016202:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788796905.016217:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788796905.016240:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb06ef1fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875689374506112:12345-0@lo:400: 00000100:00100000:0.0:1788796905.016346:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb06ef1fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875689374506112:12345-0@lo:400: Request processed in 122us (2894us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796905.016352:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788796905.016728:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb079b93100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875689374506752:0@lo:13: 00000100:00100000:3.0:1788796905.016778:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1788796905.016894:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cb0774e4a80 x1875689374506112/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788796921 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788796905.016909:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb0774e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875689374506112:0@lo:400: 00010000:00080000:3.0:1788796905.016920:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cb0774e5c00 x1875689374506624/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788796921 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788796905.016930:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb0774e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875689374506624:0@lo:400: 00010000:00080000:3.0:1788796905.016968:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cb0774e6a00 x1875689374506368/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788796921 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788796905.016978:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb0774e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3301:1875689374506368:0@lo:400: 00000100:00100000:3.0:1788796905.016990:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb0774e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:3301:1875689374505984:0@lo:400: 00010000:00080000:3.0:1788796905.017003:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cb0774e7800 x1875689374506496/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788796921 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788796905.017011:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb0774e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3301:1875689374506496:0@lo:400: 00000100:00100000:0.0:1788796905.017811:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374506752 00000100:00100000:0.0:1788796905.017822:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374506752 00000100:00100000:0.0:1788796905.017881:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788796905.017889:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb06ef1f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3303:x1875689374506752:12345-0@lo:13: 00002000:00000024:0.0:1788796905.017919:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788796905.017971:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb06ef1f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3303:x1875689374506752:12345-0@lo:13: Request processed in 83us (1197us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796905.017977:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:3.0:1788796905.018093:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cb079b93100 x1875689374506752/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788796921 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788796905.018110:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb079b93100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875689374506752:0@lo:13: 00000100:00080000:1.0:1788796905.019114:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788796905.019122:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:1.0:1788796905.040843:0:7640:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00010000:00010000:1.0:1788796905.266188:0:5815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788796905.595436:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1788796905.595473:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351413888 00000100:00100000:1.0:1788796905.595484:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351413888 00000100:00100000:1.0:1788796905.595521:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 113 00000100:00100000:1.0:1788796905.595531:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb051758c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2351:x1875689351413888:12345-192.168.204.38@tcp:250: 00010000:00080000:1.0:1788796905.595560:0:5819:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from b4d9d1a9-601d-459e-8721-8bfc2fdde84f@192.168.204.38@tcp t0 exp 0000000000000000 cur 194 last 0 00000020:00000080:1.0:1788796905.595592:0:5819:0:(genops.c:1384:class_connect()) connect: client b4d9d1a9-601d-459e-8721-8bfc2fdde84f, cookie 0xca7fc0c411f934d1 00000100:00080000:1.0:1788796905.595819:0:5819:0:(import.c:65:import_set_state_nolock()) ffff8cb050170800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788796905.595882:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb051758c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4d9d1a9-601d-459e-8721-8bfc2fdde84f+5:2351:x1875689351413888:12345-192.168.204.38@tcp:250: Request processed in 352us (458us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796905.595889:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 113 00000100:00100000:1.0:1788796905.600204:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1788796905.600296:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351414016 00000100:00100000:3.0:1788796905.600320:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351414016 00000100:00100000:3.0:1788796905.600377:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 114 00000100:00100000:3.0:1788796905.600387:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb051758450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4d9d1a9-601d-459e-8721-8bfc2fdde84f+5:5597:x1875689351414016:12345-192.168.204.38@tcp:101: 00010000:00010000:3.0:1788796905.600404:0:5820:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788796905.600421:0:5820:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cb080437600/0xca7fc0c411f934d8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x7c99e04559ee0ec2 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796905.600449:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cb080437600/0xca7fc0c411f934d8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee0ec2 expref: 6 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796905.600460:0:5820:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cb080437600/0xca7fc0c411f934d8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee0ec2 expref: 6 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796905.600468:0:5820:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb080437600, rc 0) 00000100:00100000:3.0:1788796905.600523:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb051758450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4d9d1a9-601d-459e-8721-8bfc2fdde84f+6:5597:x1875689351414016:12345-192.168.204.38@tcp:101: Request processed in 137us (329us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796905.600530:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 114 00000100:00100000:1.0:1788796905.617767:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1788796905.617950:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351414144 00000100:00100000:2.0:1788796905.617959:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351414144 00000100:00100000:2.0:1788796905.618111:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 115 00000100:00100000:2.0:1788796905.618122:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb05175ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4d9d1a9-601d-459e-8721-8bfc2fdde84f+6:5597:x1875689351414144:12345-192.168.204.38@tcp:501: 00000100:00100000:2.0:1788796905.618354:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb05175ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4d9d1a9-601d-459e-8721-8bfc2fdde84f+6:5597:x1875689351414144:12345-192.168.204.38@tcp:501: Request processed in 233us (607us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788796905.618363:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 115 00000100:00100000:0.0:1788796905.623172:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1788796905.623303:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351414272 00000100:00100000:1.0:1788796905.623318:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351414272 00000100:00100000:1.0:1788796905.623393:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 116 00000100:00100000:1.0:1788796905.623406:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb051759450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4d9d1a9-601d-459e-8721-8bfc2fdde84f+6:5597:x1875689351414272:12345-192.168.204.38@tcp:101: 00010000:00010000:1.0:1788796905.623429:0:5819:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788796905.623448:0:5819:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cb0821f1000/0xca7fc0c411f934df lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x7c99e04559ee0ec9 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796905.623481:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cb0821f1000/0xca7fc0c411f934df lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee0ec9 expref: 7 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796905.623494:0:5819:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cb0821f1000/0xca7fc0c411f934df lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee0ec9 expref: 7 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796905.623504:0:5819:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb0821f1000, rc 0) 00000100:00100000:1.0:1788796905.623609:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb051759450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4d9d1a9-601d-459e-8721-8bfc2fdde84f+7:5597:x1875689351414272:12345-192.168.204.38@tcp:101: Request processed in 207us (446us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796905.623616:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 116 00000100:00100000:2.0:1788796905.626207:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1788796905.626279:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351414400 00000100:00100000:1.0:1788796905.626289:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351414400 00000100:00100000:1.0:1788796905.626341:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 117 00000100:00100000:1.0:1788796905.626351:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb051758850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4d9d1a9-601d-459e-8721-8bfc2fdde84f+7:5597:x1875689351414400:12345-192.168.204.38@tcp:501: 00000100:00100000:1.0:1788796905.626625:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb051758850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4d9d1a9-601d-459e-8721-8bfc2fdde84f+8:5597:x1875689351414400:12345-192.168.204.38@tcp:501: Request processed in 275us (427us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796905.626634:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 117 00000100:00100000:0.0:1788796905.634012:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1788796905.634116:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351414528 00000100:00100000:2.0:1788796905.634127:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351414528 00000100:00100000:2.0:1788796905.634189:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 118 00000100:00100000:2.0:1788796905.634201:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0465dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4d9d1a9-601d-459e-8721-8bfc2fdde84f+8:5597:x1875689351414528:12345-192.168.204.38@tcp:503: 00000100:00100000:2.0:1788796905.634492:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0465dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4d9d1a9-601d-459e-8721-8bfc2fdde84f+8:5597:x1875689351414528:12345-192.168.204.38@tcp:503: Request processed in 292us (489us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796905.634500:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 118 00000100:00100000:2.0:1788796905.642396:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1788796905.642556:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351414656 00000100:00100000:3.0:1788796905.642566:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351414656 00000100:00100000:3.0:1788796905.642619:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 119 00000100:00100000:3.0:1788796905.642630:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0465dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4d9d1a9-601d-459e-8721-8bfc2fdde84f+8:5615:x1875689351414656:12345-192.168.204.38@tcp:502: 00000100:00100000:3.0:1788796905.642961:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0465dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4d9d1a9-601d-459e-8721-8bfc2fdde84f+8:5615:x1875689351414656:12345-192.168.204.38@tcp:502: Request processed in 332us (571us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796905.642982:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 119 00000100:00100000:0.0:1788796905.659423:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1788796905.659467:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351414784 00000100:00100000:0.0:1788796905.659477:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351414784 00000100:00100000:0.0:1788796905.659522:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 120 00000100:00100000:0.0:1788796905.659532:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0465dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4d9d1a9-601d-459e-8721-8bfc2fdde84f+8:5615:x1875689351414784:12345-192.168.204.38@tcp:502: 00000100:00100000:0.0:1788796905.659792:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0465dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4d9d1a9-601d-459e-8721-8bfc2fdde84f+8:5615:x1875689351414784:12345-192.168.204.38@tcp:502: Request processed in 261us (379us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796905.659801:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 120 00000100:00100000:3.0:1788796905.672132:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1788796905.672252:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351414912 00000100:00100000:1.0:1788796905.672277:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351414912 00000100:00100000:1.0:1788796905.672338:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 121 00000100:00100000:1.0:1788796905.672351:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0465dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4d9d1a9-601d-459e-8721-8bfc2fdde84f+8:5597:x1875689351414912:12345-192.168.204.38@tcp:101: 00010000:00010000:1.0:1788796905.672376:0:5818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788796905.672401:0:5818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cb0821f1c00/0xca7fc0c411f934e6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x7c99e04559ee0ef3 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796905.672437:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cb0821f1c00/0xca7fc0c411f934e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee0ef3 expref: 9 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796905.672450:0:5818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cb0821f1c00/0xca7fc0c411f934e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee0ef3 expref: 9 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796905.672461:0:5818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb0821f1c00, rc 0) 00000100:00100000:1.0:1788796905.672519:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0465dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4d9d1a9-601d-459e-8721-8bfc2fdde84f+9:5597:x1875689351414912:12345-192.168.204.38@tcp:101: Request processed in 171us (400us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796905.672527:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 121 00000100:00100000:3.0:1788796905.683994:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1788796905.686614:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351415040 00000100:00100000:0.0:1788796905.686630:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351415040 00000100:00100000:0.0:1788796905.686703:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 122 00000100:00100000:0.0:1788796905.686716:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0465de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4d9d1a9-601d-459e-8721-8bfc2fdde84f+9:5597:x1875689351415040:12345-192.168.204.38@tcp:256: 20000000:01000000:0.0:1788796905.686863:0:5819:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1788796905.686890:0:5819:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1788796905.686895:0:5819:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1788796905.686899:0:5819:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1788796905.686901:0:5819:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:0.0:1788796905.689238:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0465de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4d9d1a9-601d-459e-8721-8bfc2fdde84f+9:5597:x1875689351415040:12345-192.168.204.38@tcp:256: Request processed in 2510us (5245us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796905.689255:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 122 00000100:00100000:0.0:1788796905.696076:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1788796905.696359:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351415168 00000100:00100000:3.0:1788796905.696371:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351415168 00000100:00100000:3.0:1788796905.696434:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 123 00000100:00100000:3.0:1788796905.696444:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0465df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4d9d1a9-601d-459e-8721-8bfc2fdde84f+9:5597:x1875689351415168:12345-192.168.204.38@tcp:101: 00010000:00010000:3.0:1788796905.696461:0:5820:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788796905.696479:0:5820:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cb080437c00/0xca7fc0c411f934ed lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x7c99e04559ee0efa expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796905.696506:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cb080437c00/0xca7fc0c411f934ed lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee0efa expref: 10 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796905.696517:0:5820:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cb080437c00/0xca7fc0c411f934ed lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee0efa expref: 10 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796905.696526:0:5820:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb080437c00, rc 0) 00000100:00100000:3.0:1788796905.696575:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0465df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4d9d1a9-601d-459e-8721-8bfc2fdde84f+10:5597:x1875689351415168:12345-192.168.204.38@tcp:101: Request processed in 132us (510us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796905.696582:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 123 00000100:00100000:0.0:1788796905.707139:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1788796905.707214:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351415296 00000100:00100000:1.0:1788796905.707225:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351415296 00000100:00100000:1.0:1788796905.707280:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 124 00000100:00100000:1.0:1788796905.707290:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0465dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4d9d1a9-601d-459e-8721-8bfc2fdde84f+10:5597:x1875689351415296:12345-192.168.204.38@tcp:501: 00000100:00100000:1.0:1788796905.707563:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0465dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4d9d1a9-601d-459e-8721-8bfc2fdde84f+10:5597:x1875689351415296:12345-192.168.204.38@tcp:501: Request processed in 273us (432us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796905.707570:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 124 00000100:00100000:1.0:1788796905.709699:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1788796905.709886:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351415424 00000100:00100000:0.0:1788796905.709898:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351415424 00000100:00100000:0.0:1788796905.709953:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 125 00000100:00100000:0.0:1788796905.709972:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0465dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4d9d1a9-601d-459e-8721-8bfc2fdde84f+10:5597:x1875689351415424:12345-192.168.204.38@tcp:503: 00000100:00100000:0.0:1788796905.710426:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0465dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4d9d1a9-601d-459e-8721-8bfc2fdde84f+10:5597:x1875689351415424:12345-192.168.204.38@tcp:503: Request processed in 463us (736us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796905.710435:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 125 00000100:00100000:3.0:1788796905.716280:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1788796905.716443:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351415552 00000100:00100000:2.0:1788796905.716454:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351415552 00000100:00100000:2.0:1788796905.716509:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 126 00000100:00100000:2.0:1788796905.716518:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0465df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4d9d1a9-601d-459e-8721-8bfc2fdde84f+10:5621:x1875689351415552:12345-192.168.204.38@tcp:502: 00000100:00100000:2.0:1788796905.716819:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0465df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4d9d1a9-601d-459e-8721-8bfc2fdde84f+10:5621:x1875689351415552:12345-192.168.204.38@tcp:502: Request processed in 301us (546us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796905.716828:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 126 00000100:00100000:3.0:1788796905.719257:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1788796905.719372:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351415680 00000100:00100000:1.0:1788796905.719381:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351415680 00000100:00100000:1.0:1788796905.719427:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 127 00000100:00100000:1.0:1788796905.719448:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0465ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4d9d1a9-601d-459e-8721-8bfc2fdde84f+10:5621:x1875689351415680:12345-192.168.204.38@tcp:502: 00000100:00100000:1.0:1788796905.719665:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0465ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4d9d1a9-601d-459e-8721-8bfc2fdde84f+10:5621:x1875689351415680:12345-192.168.204.38@tcp:502: Request processed in 206us (405us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796905.719673:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 127 00000100:00100000:1.0:1788796905.724238:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1788796905.724362:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351415808 00000100:00100000:0.0:1788796905.724372:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351415808 00000100:00100000:0.0:1788796905.724453:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 4 00000100:00100000:0.0:1788796905.724461:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0498eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2351:x1875689351415808:12345-192.168.204.38@tcp:38: 00010000:00080000:0.0:1788796905.724491:0:5827:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from e6d050bb-169e-4784-be5b-7071799bf3b0@192.168.204.38@tcp t0 exp 0000000000000000 cur 194 last 0 00000020:00000080:0.0:1788796905.724533:0:5827:0:(genops.c:1384:class_connect()) connect: client e6d050bb-169e-4784-be5b-7071799bf3b0, cookie 0xca7fc0c411f934f4 00000004:00100000:0.0:1788796905.724558:0:5827:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:0.0:1788796905.724563:0:5827:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:0.0:1788796905.773253:0:5827:0:(import.c:65:import_set_state_nolock()) ffff8cb042fd7000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788796905.773342:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0498eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6d050bb-169e-4784-be5b-7071799bf3b0+6:2351:x1875689351415808:12345-192.168.204.38@tcp:38: Request processed in 48879us (49111us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796905.773353:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 4 00010000:00010000:2.0:1788796906.293317:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788796906.784790:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1788796906.784830:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1788796906.784912:0:7636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351416064 00000100:00100000:1.0:1788796906.784922:0:7636:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351416064 00000100:00100000:1.0:1788796906.785002:0:7636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351415936 00000100:00100000:1.0:1788796906.785006:0:7636:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351415936 00000100:00100000:1.0:1788796906.785025:0:7636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 5 00000100:00100000:1.0:1788796906.785061:0:7636:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb06ef1f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6d050bb-169e-4784-be5b-7071799bf3b0+7:5597:x1875689351416064:12345-192.168.204.38@tcp:41: 00000004:00000024:1.0:1788796906.785103:0:7636:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:1.0:1788796906.785190:0:7636:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb06ef1f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6d050bb-169e-4784-be5b-7071799bf3b0+7:5597:x1875689351416064:12345-192.168.204.38@tcp:41: Request processed in 123us (401us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796906.785197:0:7636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 5 00000100:00100000:1.0:1788796906.785223:0:7636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 6 00000100:00100000:1.0:1788796906.785230:0:7636:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb06ef1d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6d050bb-169e-4784-be5b-7071799bf3b0+6:0:x1875689351415936:12345-192.168.204.38@tcp:41: 00000004:00000024:1.0:1788796906.785250:0:7636:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:1.0:1788796906.785278:0:7636:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb06ef1d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6d050bb-169e-4784-be5b-7071799bf3b0+6:0:x1875689351415936:12345-192.168.204.38@tcp:41: Request processed in 43us (441us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796906.785284:0:7636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 6 00000100:00080000:3.0:1788796906.785851:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788796906.803136:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1788796906.803271:0:7636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351416192 00000100:00100000:2.0:1788796906.803281:0:7636:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351416192 00000100:00100000:2.0:1788796906.803343:0:7636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 7 00000100:00100000:2.0:1788796906.803367:0:7636:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb06ef1f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6d050bb-169e-4784-be5b-7071799bf3b0+6:5597:x1875689351416192:12345-192.168.204.38@tcp:40: 00000100:00100000:2.0:1788796906.803448:0:7636:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb06ef1f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6d050bb-169e-4784-be5b-7071799bf3b0+6:5597:x1875689351416192:12345-192.168.204.38@tcp:40: Request processed in 83us (321us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796906.803455:0:7636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 7 00000100:00100000:1.0:1788796906.807588:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1788796906.807691:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1788796906.812385:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1788796906.812434:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1788796906.812474:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351416448 00000100:00100000:1.0:1788796906.812520:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351416448 00000100:00100000:1.0:1788796906.812577:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 128 00000100:00100000:1.0:1788796906.812591:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb06cfc5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4d9d1a9-601d-459e-8721-8bfc2fdde84f+10:2353:x1875689351416448:12345-192.168.204.38@tcp:400: 00000100:00100000:1.0:1788796906.812673:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb06cfc5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4d9d1a9-601d-459e-8721-8bfc2fdde84f+10:2353:x1875689351416448:12345-192.168.204.38@tcp:400: Request processed in 86us (238us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796906.812680:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 128 00000100:00100000:2.0:1788796906.816480:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351416704 00000100:00100000:2.0:1788796906.816516:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351416704 00000100:00100000:2.0:1788796906.816590:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 0 00000100:00100000:2.0:1788796906.816601:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0498ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e6d050bb-169e-4784-be5b-7071799bf3b0+6:5597:x1875689351416704:12345-192.168.204.38@tcp:33: 00000100:00100000:3.0:1788796906.817697:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351416320 00000100:00100000:3.0:1788796906.817708:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351416320 00000100:00100000:3.0:1788796906.817750:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351416576 00000100:00100000:3.0:1788796906.817754:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351416576 00000100:00100000:3.0:1788796906.817770:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9 00000100:00100000:3.0:1788796906.817778:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0498ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2351:x1875689351416320:12345-192.168.204.38@tcp:8: 00010000:00080000:3.0:1788796906.817805:0:6684:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from e6d050bb-169e-4784-be5b-7071799bf3b0@192.168.204.38@tcp t0 exp 0000000000000000 cur 195 last 0 00000020:00000080:3.0:1788796906.817841:0:6684:0:(genops.c:1384:class_connect()) connect: client e6d050bb-169e-4784-be5b-7071799bf3b0, cookie 0xca7fc0c411f934fb 00002000:00100000:3.0:1788796906.817854:0:6684:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli e6d050bb-169e-4784-be5b-7071799bf3b0/ffff8caf41991000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788796906.817878:0:6684:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788796906.818665:0:6684:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1788796906.818705:0:6684:0:(import.c:65:import_set_state_nolock()) ffff8caf41990800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788796906.818839:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0498ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e6d050bb-169e-4784-be5b-7071799bf3b0+6:2351:x1875689351416320:12345-192.168.204.38@tcp:8: Request processed in 1059us (11262us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796906.818850:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9 00000100:00100000:3.0:1788796906.818884:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 10 00000100:00100000:3.0:1788796906.818891:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0498ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2351:x1875689351416576:12345-192.168.204.38@tcp:8: 00010000:00080000:3.0:1788796906.818911:0:6684:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from e6d050bb-169e-4784-be5b-7071799bf3b0@192.168.204.38@tcp t0 exp 0000000000000000 cur 195 last 0 00000020:00000080:3.0:1788796906.818934:0:6684:0:(genops.c:1384:class_connect()) connect: client e6d050bb-169e-4784-be5b-7071799bf3b0, cookie 0xca7fc0c411f93502 00002000:00100000:3.0:1788796906.818942:0:6684:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli e6d050bb-169e-4784-be5b-7071799bf3b0/ffff8caf41997000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788796906.818949:0:6684:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788796906.819224:0:6684:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788796906.819246:0:6684:0:(import.c:65:import_set_state_nolock()) ffff8caf41992000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788796906.819284:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0498ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e6d050bb-169e-4784-be5b-7071799bf3b0+6:2351:x1875689351416576:12345-192.168.204.38@tcp:8: Request processed in 381us (11582us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796906.819291:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 10 00000004:00080000:2.0:1788796906.853659:0:5828:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 36974us 00000004:00200000:3.0:1788796906.872395:0:5828:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:3.0:1788796906.872527:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0498ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e6d050bb-169e-4784-be5b-7071799bf3b0+6:5597:x1875689351416704:12345-192.168.204.38@tcp:33: Request processed in 55923us (60150us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796906.872542:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 0 00000100:00100000:1.0:1788796907.150709:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1788796907.150785:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351416832 00000100:00100000:0.0:1788796907.150795:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351416832 00000100:00100000:0.0:1788796907.150863:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 8 00000100:00100000:0.0:1788796907.150874:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0498ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6d050bb-169e-4784-be5b-7071799bf3b0+6:5637:x1875689351416832:12345-192.168.204.38@tcp:101: 00010000:00010000:0.0:1788796907.150895:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788796907.150965:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb079b80e00/0xca7fc0c411f93509 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c99e04559ee0f24 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796907.151080:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb079b80000/0xca7fc0c411f93510 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796907.151095:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb079b80000/0xca7fc0c411f93510 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796907.151130:0:5827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb079b80000/0xca7fc0c411f93510 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788796907.151172:0:5827:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788796907.151176:0:5827:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788796907.151196:0:5827:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cb079b80000/0xca7fc0c411f93510 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796907.151224:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb079b80e00/0xca7fc0c411f93509 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee0f24 expref: 8 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796907.151246:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb079b80000/0xca7fc0c411f93510 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee0f24 expref: 7 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796907.151255:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cb058766b00) 00010000:00010000:0.0:1788796907.151259:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788796907.151262:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb079b80000, rc 0) 00000100:00100000:0.0:1788796907.151348:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0498ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6d050bb-169e-4784-be5b-7071799bf3b0+7:5637:x1875689351416832:12345-192.168.204.38@tcp:101: Request processed in 475us (648us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796907.151355:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 8 00010000:00010000:1.0:1788796907.314318:0:5815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788796908.338345:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788796909.323938:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1788796909.324527:0:7636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351416960 00000100:00100000:2.0:1788796909.324537:0:7636:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351416960 00000100:00100000:2.0:1788796909.324628:0:7636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9 00000100:00100000:2.0:1788796909.324639:0:7636:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0498ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6d050bb-169e-4784-be5b-7071799bf3b0+7:5690:x1875689351416960:12345-192.168.204.38@tcp:41: 00000004:00000024:2.0:1788796909.324686:0:7636:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:2.0:1788796909.324754:0:7636:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0498ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6d050bb-169e-4784-be5b-7071799bf3b0+7:5690:x1875689351416960:12345-192.168.204.38@tcp:41: Request processed in 118us (827us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796909.324762:0:7636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9 00000100:00080000:3.0:1788796909.324830:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788796909.332937:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1788796909.333065:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351417088 00000100:00100000:0.0:1788796909.333078:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351417088 00000100:00100000:0.0:1788796909.333160:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 8 00000100:00100000:0.0:1788796909.333170:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb06ef1ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:e6d050bb-169e-4784-be5b-7071799bf3b0+6:5690:x1875689351417088:12345-192.168.204.38@tcp:13: 00002000:00000024:0.0:1788796909.333208:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788796909.333286:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb06ef1ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:e6d050bb-169e-4784-be5b-7071799bf3b0+6:5690:x1875689351417088:12345-192.168.204.38@tcp:13: Request processed in 117us (364us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796909.333303:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 8 00000100:00080000:3.0:1788796909.333364:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788796909.341865:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1788796909.342271:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351417216 00000100:00100000:0.0:1788796909.342282:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351417216 00000100:00100000:0.0:1788796909.342369:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9 00000100:00100000:0.0:1788796909.342381:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb06f60b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:e6d050bb-169e-4784-be5b-7071799bf3b0+6:5690:x1875689351417216:12345-192.168.204.38@tcp:13: 00002000:00000024:0.0:1788796909.342440:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788796909.342519:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb06f60b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:e6d050bb-169e-4784-be5b-7071799bf3b0+6:5690:x1875689351417216:12345-192.168.204.38@tcp:13: Request processed in 141us (668us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796909.342527:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9 00000100:00080000:3.0:1788796909.342845:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1788796909.362328:0:5815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788796909.619218:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788796909.619254:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb06f609c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875689374506880:0@lo:13: 00000100:00100000:3.0:1788796909.619337:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788796909.619541:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374506880 00000100:00100000:1.0:1788796909.619548:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374506880 00000100:00100000:1.0:1788796909.619618:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788796909.619627:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb06ef1c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1875689374506880:12345-0@lo:13: 00002000:00000024:1.0:1788796909.619650:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788796909.619701:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb06ef1c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1875689374506880:12345-0@lo:13: Request processed in 75us (363us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796909.619709:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:3.0:1788796909.621139:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788796909.621194:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cb06f609c00 x1875689374506880/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788796925 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788796909.621228:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb06f609c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875689374506880:0@lo:13: 00000100:00100000:0.0:1788796910.130590:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788796910.130613:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb079b92a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875689374507008:0@lo:13: 00000100:00100000:0.0:1788796910.130695:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788796910.130847:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374507008 00000100:00100000:0.0:1788796910.130855:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374507008 00000100:00100000:0.0:1788796910.130910:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788796910.130919:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb079b90000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1875689374507008:12345-0@lo:13: 00002000:00000024:0.0:1788796910.130943:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788796910.131319:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb079b90000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1875689374507008:12345-0@lo:13: Request processed in 400us (623us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796910.131328:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:0.0:1788796910.131351:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1788796910.131381:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cb079b92a00 x1875689374507008/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788796926 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788796910.131392:0:3300:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:0.0:1788796910.131422:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb079b92a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875689374507008:0@lo:13: 00000100:00100000:0.0:1788796910.139655:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb06ef1d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:3302:1875689374507136:0@lo:400: 00000100:00100000:0.0:1788796910.139773:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788796910.139865:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374507136 00000100:00100000:1.0:1788796910.139884:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374507136 00000100:00100000:1.0:1788796910.139942:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1788796910.139952:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0585b2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+19:3302:x1875689374507136:12345-0@lo:400: 00000100:00100000:2.0:1788796910.143230:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb06ef1ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875689374507264:0@lo:400: 00000100:00100000:2.0:1788796910.143307:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788796910.143370:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374507264 00000100:00100000:2.0:1788796910.143377:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374507264 00000100:00100000:2.0:1788796910.143427:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788796910.143435:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb048e28a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875689374507264:12345-0@lo:400: 00000100:00100000:2.0:1788796910.143488:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb048e28a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875689374507264:12345-0@lo:400: Request processed in 54us (181us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796910.143504:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788796910.143549:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb06ef1ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875689374507264:0@lo:400: 00000100:00100000:1.0:1788796910.145002:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0585b2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+19:3302:x1875689374507136:12345-0@lo:400: Request processed in 5044us (5222us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796910.145015:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1788796910.148250:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb06ef1d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:3302:1875689374507136:0@lo:400: 00000100:00100000:0.0:1788796910.148992:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb06ef1c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875689374507392:0@lo:400: 00000100:00100000:0.0:1788796910.149272:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796910.149366:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb06ef1e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3301:1875689374507520:0@lo:400: 00000100:00100000:3.0:1788796910.149397:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796910.149451:0:7636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374507520 00000100:00100000:3.0:1788796910.149459:0:7636:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374507520 00000100:00100000:3.0:1788796910.149526:0:7636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788796910.149535:0:7636:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb06ef1c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1875689374507520:12345-0@lo:400: 00000100:00100000:3.0:1788796910.149599:0:7636:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb06ef1c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1875689374507520:12345-0@lo:400: Request processed in 66us (201us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796910.149606:0:7636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788796910.149644:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb06ef1e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3301:1875689374507520:0@lo:400: 00000100:00100000:3.0:1788796910.149693:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788796910.149701:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb06ef1e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3303:1875689374507648:0@lo:400: 00000100:00100000:3.0:1788796910.149736:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796910.149768:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374507648 00000100:00100000:3.0:1788796910.149772:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374507648 00000100:00100000:3.0:1788796910.149797:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788796910.149803:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb06ef1ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1875689374507648:12345-0@lo:400: 00000100:00100000:3.0:1788796910.149835:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb06ef1ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1875689374507648:12345-0@lo:400: Request processed in 33us (111us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796910.149847:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788796910.149874:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb06ef1e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3303:1875689374507648:0@lo:400: 00000100:00080000:0.0:1788796910.150541:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788796910.153629:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374507392 00000100:00100000:2.0:1788796910.153650:0:6683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374507392 00000100:00100000:2.0:1788796910.153942:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788796910.153952:0:6683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb079b92a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3300:x1875689374507392:12345-0@lo:400: 00000100:00100000:2.0:1788796910.154077:0:6683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb079b92a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3300:x1875689374507392:12345-0@lo:400: Request processed in 127us (4806us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796910.154095:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1788796910.154174:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cb06ef1c700 x1875689374507392/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788796926 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788796910.154190:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb06ef1c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875689374507392:0@lo:400: 00010000:00010000:1.0:1788796910.388243:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788796911.256478:0:6713:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of e6d050bb-169e-4784-be5b-7071799bf3b0 00000001:00100000:3.0:1788796911.265364:0:5848:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of e6d050bb-169e-4784-be5b-7071799bf3b0 00000001:00100000:0.0:1788796911.285629:0:7640:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of e6d050bb-169e-4784-be5b-7071799bf3b0 00010000:00010000:1.0:1788796911.410515:0:5815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788796912.037091:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1788796912.037143:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1788796912.037187:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351417600 00000100:00100000:2.0:1788796912.037201:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351417600 00000100:00100000:2.0:1788796912.037279:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 6 00000100:00100000:2.0:1788796912.037292:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb048e29880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e6d050bb-169e-4784-be5b-7071799bf3b0+5:2354:x1875689351417600:12345-192.168.204.38@tcp:400: 00000100:00100000:2.0:1788796912.037382:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb048e29880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e6d050bb-169e-4784-be5b-7071799bf3b0+5:2354:x1875689351417600:12345-192.168.204.38@tcp:400: Request processed in 93us (238us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796912.037390:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 6 00000100:00080000:2.0:1788796912.037413:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788796912.037439:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1788796912.038398:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351417344 00000100:00100000:0.0:1788796912.038412:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351417344 00000100:00100000:0.0:1788796912.038476:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 130 00000100:00100000:0.0:1788796912.038487:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0585b2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4d9d1a9-601d-459e-8721-8bfc2fdde84f+10:2354:x1875689351417344:12345-192.168.204.38@tcp:400: 00000100:00100000:0.0:1788796912.038559:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0585b2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4d9d1a9-601d-459e-8721-8bfc2fdde84f+10:2354:x1875689351417344:12345-192.168.204.38@tcp:400: Request processed in 74us (1477us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796912.038566:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 130 00000100:00100000:3.0:1788796912.039451:0:7636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351417472 00000100:00100000:3.0:1788796912.039460:0:7636:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351417472 00000100:00100000:3.0:1788796912.039517:0:7636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 23 00000100:00100000:3.0:1788796912.039538:0:7636:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb048e28000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6d050bb-169e-4784-be5b-7071799bf3b0+6:2354:x1875689351417472:12345-192.168.204.38@tcp:400: 00000100:00100000:2.0:1788796912.040344:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1788796912.040487:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351417728 00000100:00100000:0.0:1788796912.040493:0:6683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351417728 00000100:00100000:0.0:1788796912.040554:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 7 00000100:00100000:0.0:1788796912.040563:0:6683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb048e2ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e6d050bb-169e-4784-be5b-7071799bf3b0+5:2354:x1875689351417728:12345-192.168.204.38@tcp:400: 00000100:00100000:0.0:1788796912.040612:0:6683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb048e2ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e6d050bb-169e-4784-be5b-7071799bf3b0+5:2354:x1875689351417728:12345-192.168.204.38@tcp:400: Request processed in 51us (275us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796912.040619:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 7 00000100:00100000:3.0:1788796912.040693:0:7636:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb048e28000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6d050bb-169e-4784-be5b-7071799bf3b0+6:2354:x1875689351417472:12345-192.168.204.38@tcp:400: Request processed in 59us (2144us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796912.040701:0:7636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 23 00000100:00080000:3.0:1788796912.040724:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788796912.040729:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788796912.443345:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788796912.472227:0:8293:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:1.0:1788796913.458537:0:5815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788796914.482781:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788796914.738394:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb06f60a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875689374507776:0@lo:13: 00000100:00100000:3.0:1788796914.738489:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788796914.738629:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374507776 00000100:00100000:1.0:1788796914.738638:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374507776 00000100:00100000:1.0:1788796914.738700:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788796914.738712:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb06ef1e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875689374507776:12345-0@lo:13: 00002000:00000024:1.0:1788796914.738750:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788796914.738801:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb06ef1e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875689374507776:12345-0@lo:13: Request processed in 91us (311us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796914.738808:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:3.0:1788796914.738870:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788796914.738897:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cb06f60a300 x1875689374507776/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788796930 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788796914.738914:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb06f60a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875689374507776:0@lo:13: 00000100:00100000:0.0:1788796915.251140:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788796915.251167:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb079b91180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875689374507904:0@lo:13: 00000100:00100000:0.0:1788796915.251251:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788796915.251318:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374507904 00000100:00100000:0.0:1788796915.251326:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374507904 00000100:00100000:0.0:1788796915.251384:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788796915.251393:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb079b90a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1875689374507904:12345-0@lo:13: 00002000:00000024:0.0:1788796915.251446:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788796915.251506:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb079b90a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1875689374507904:12345-0@lo:13: Request processed in 114us (255us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796915.251515:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:0.0:1788796915.251539:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1788796915.251573:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cb079b91180 x1875689374507904/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788796931 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788796915.251608:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb079b91180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875689374507904:0@lo:13: 00000100:00100000:0.0:1788796915.253859:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb079b90380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3300:1875689374508416:0@lo:400: 00000100:00100000:0.0:1788796915.253926:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788796915.253975:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788796915.253982:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb079b91180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:3300:1875689374508032:0@lo:400: 00000100:00100000:0.0:1788796915.254009:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788796915.254064:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb079b92d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3300:1875689374508544:0@lo:400: 00000100:00100000:0.0:1788796915.254087:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788796915.254112:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb079b90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875689374508160:0@lo:400: 00000100:00100000:0.0:1788796915.254134:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788796915.254154:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788796915.254159:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb079b92300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875689374508288:0@lo:400: 00000100:00100000:0.0:1788796915.254182:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788796915.254212:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374508416 00000100:00100000:0.0:1788796915.254235:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374508416 00000100:00100000:0.0:1788796915.254282:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374508544 00000100:00100000:0.0:1788796915.254284:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374508544 00000100:00100000:0.0:1788796915.254298:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374508160 00000100:00100000:0.0:1788796915.254300:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374508160 00000100:00100000:0.0:1788796915.254313:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788796915.254320:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb079b91880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1875689374508416:12345-0@lo:400: 00000100:00100000:0.0:1788796915.254368:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb079b91880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1875689374508416:12345-0@lo:400: Request processed in 49us (441us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796915.254376:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788796915.254392:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788796915.254398:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb079b91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1875689374508544:12345-0@lo:400: 00000100:00100000:0.0:1788796915.254438:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb079b91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1875689374508544:12345-0@lo:400: Request processed in 41us (350us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796915.254444:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788796915.254454:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788796915.254459:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb079b92680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875689374508160:12345-0@lo:400: 00000100:00100000:0.0:1788796915.254499:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb079b92680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875689374508160:12345-0@lo:400: Request processed in 40us (364us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796915.254506:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788796915.254530:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374508288 00000100:00100000:0.0:1788796915.254534:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374508288 00000100:00100000:0.0:1788796915.254555:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788796915.254561:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb079b93100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1875689374508288:12345-0@lo:400: 00000100:00100000:3.0:1788796915.254753:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374508032 00000100:00100000:3.0:1788796915.254757:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374508032 00000100:00100000:3.0:1788796915.254785:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1788796915.254792:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0585b0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+19:3300:x1875689374508032:12345-0@lo:400: 00000100:00100000:3.0:1788796915.254825:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0585b0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+19:3300:x1875689374508032:12345-0@lo:400: Request processed in 34us (815us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796915.254843:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1788796915.255024:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb079b93100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1875689374508288:12345-0@lo:400: Request processed in 462us (840us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796915.255079:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:0.0:1788796915.255104:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788796915.255137:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cb079b92300 x1875689374508288/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788796931 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788796915.255149:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb079b92300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875689374508288:0@lo:400: 00000100:00100000:0.0:1788796915.255159:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb079b90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875689374508160:0@lo:400: 00000100:00100000:0.0:1788796915.255187:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb079b91180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:3300:1875689374508032:0@lo:400: 00000100:00100000:0.0:1788796915.255196:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb079b92d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3300:1875689374508544:0@lo:400: 00000100:00100000:0.0:1788796915.255205:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb079b90380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3300:1875689374508416:0@lo:400: 00010000:00010000:1.0:1788796915.506248:0:5815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788796916.504316:0:8441:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd32d49a70 20000000:00000080:0.0:1788796916.504335:0:8441:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8cb06f0d8000 uarg=0000000000000000 20000000:01000000:0.0:1788796916.504373:0:8441:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:0.0:1788796916.504375:0:8441:0:(mgs_llog.c:6069:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:0.0:1788796916.504377:0:8441:0:(mgs_llog.c:6100:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:0.0:1788796916.504382:0:8441:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:0.0:1788796916.504389:0:8441:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:0.0:1788796916.504405:0:8441:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1788796916.504409:0:8441:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:0.0:1788796916.504737:0:8441:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:0.0:1788796916.504740:0:8441:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1788796916.505937:0:8442:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:0.0:1788796916.506803:0:8441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:0.0:1788796916.506874:0:8441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 120 off9752 00000040:00080000:0.0:1788796916.506912:0:8441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9976 20000000:01000000:0.0:1788796916.506925:0:8441:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1788796916.506928:0:8441:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1788796916.508462:0:8443:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000040:00080000:2.0:1788796916.509277:0:8441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 00000040:00080000:2.0:1788796916.509333:0:8441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 120 off14264 00000040:00080000:2.0:1788796916.509384:0:8441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14488 20000000:01000000:2.0:1788796916.509399:0:8441:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1788796916.509409:0:8441:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1788796916.510208:0:8444:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000040:00080000:2.0:1788796916.510778:0:8441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14880 00000040:00080000:2.0:1788796916.510830:0:8441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 120 off15000 00000040:00080000:2.0:1788796916.510867:0:8441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 224 off15224 20000000:01000000:2.0:1788796916.510880:0:8441:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:2.0:1788796916.510883:0:8441:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1788796916.511739:0:8445:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000040:00080000:2.0:1788796916.512340:0:8441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 224 off10160 00000040:00080000:2.0:1788796916.512400:0:8441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 120 off10280 00000040:00080000:2.0:1788796916.512436:0:8441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 224 off10504 10000000:01000000:2.0:1788796916.512464:0:8441:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1788796916.512484:0:8441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cb041484000/0xca7fc0c411f93517 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796916.512504:0:8441:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cb080437e00/0xca7fc0c411f93414 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xca7fc0c411f9340d expref: 18 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796916.512511:0:8441:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cb0821f0a00/0xca7fc0c411f9343e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xca7fc0c411f93437 expref: 18 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796916.512517:0:8441:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cb0821f0e00/0xca7fc0c411f93468 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xca7fc0c411f93461 expref: 18 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796916.512523:0:8441:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cb040030800/0xca7fc0c411f93476 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xca7fc0c411f9346f expref: 18 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796916.512529:0:8441:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cb040031400/0xca7fc0c411f93484 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xca7fc0c411f9347d expref: 18 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796916.512535:0:8441:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cb041484c00/0xca7fc0c411f934a0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xca7fc0c411f93499 expref: 18 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796916.512541:0:8441:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cb080436000/0xca7fc0c411f934ca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xca7fc0c411f934c3 expref: 18 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796916.512559:0:8441:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cb080437600/0xca7fc0c411f934d8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee0ec2 expref: 9 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796916.512566:0:8441:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cb0821f1000/0xca7fc0c411f934df lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee0ec9 expref: 9 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796916.512574:0:8441:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8cb041484000/0xca7fc0c411f93517 lrc: 12/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796916.512617:0:8441:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cb0821f1000/0xca7fc0c411f934df lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee0ec9 expref: 9 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796916.512634:0:8441:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8cb0821f1000/0xca7fc0c411f934df lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee0ec9 expref: 9 pid: 5819 timeout: 305 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788796916.512648:0:8441:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb048e29c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8441:1875689374508672:192.168.204.38@tcp:104: 00010000:00010000:2.0:1788796916.512892:0:8441:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cb080437600/0xca7fc0c411f934d8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee0ec2 expref: 9 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796916.512901:0:8441:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8cb080437600/0xca7fc0c411f934d8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee0ec2 expref: 9 pid: 5820 timeout: 305 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788796916.512910:0:8441:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb048e2a680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8441:1875689374508800:192.168.204.38@tcp:104: 00010000:00010000:2.0:1788796916.512953:0:8441:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cb080436000/0xca7fc0c411f934ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xca7fc0c411f934c3 expref: 18 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796916.512963:0:8441:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cb080436000/0xca7fc0c411f934ca lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xca7fc0c411f934c3 expref: 18 pid: 5820 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788796916.512985:0:8441:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb048e2bb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8441:1875689374508928:0@lo:104: 00000100:00100000:2.0:1788796916.513025:0:8441:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788796916.513096:0:8441:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cb041484c00/0xca7fc0c411f934a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xca7fc0c411f93499 expref: 18 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796916.513105:0:8441:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cb041484c00/0xca7fc0c411f934a0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xca7fc0c411f93499 expref: 18 pid: 5820 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788796916.513114:0:8441:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb048e29f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8441:1875689374509056:0@lo:104: 00000100:00100000:2.0:1788796916.513138:0:8441:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788796916.513172:0:5809:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1788796916.513184:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374508928 00000100:00100000:2.0:1788796916.513191:0:5809:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374508928 00000100:00100000:2.0:1788796916.513233:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374509056 00000100:00100000:2.0:1788796916.513236:0:5809:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374509056 00000100:00100000:2.0:1788796916.513253:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788796916.513262:0:5809:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb048e29500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+4:8441:x1875689374508928:12345-0@lo:104: 00010000:00010000:2.0:1788796916.513276:0:5809:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.138@tcp lock: ffff8cb080436400/0xca7fc0c411f934c3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xca7fc0c411f934ca expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796916.513325:0:5809:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788796916.513331:0:5809:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb048e29500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+4:8441:x1875689374508928:12345-0@lo:104: Request processed in 70us (306us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796916.513338:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788796916.513355:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788796916.513361:0:5809:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0796e1050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+3:8441:x1875689374509056:12345-0@lo:104: 00010000:00010000:2.0:1788796916.513369:0:5809:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.138@tcp lock: ffff8cb0821f0400/0xca7fc0c411f93499 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xca7fc0c411f934a0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796916.513409:0:5809:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788796916.513414:0:5809:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0796e1050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+3:8441:x1875689374509056:12345-0@lo:104: Request processed in 54us (276us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796916.513421:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00010000:2.0:1788796916.513480:0:5814:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788796916.513486:0:5814:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.138@tcp lock: ffff8cb080436400/0xca7fc0c411f934c3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xca7fc0c411f934ca expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796916.513492:0:5814:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb080436400 already unused, calling callback (ffffffffc1adac20) 10000000:00010000:2.0:1788796916.513496:0:5814:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.138@tcp lock: ffff8cb080436400/0xca7fc0c411f934c3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0xca7fc0c411f934ca expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796916.513504:0:5814:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.138@tcp lock: ffff8cb080436400/0xca7fc0c411f934c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0xca7fc0c411f934ca expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788796916.513511:0:5814:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.138@tcp lock: ffff8cb080436400/0xca7fc0c411f934c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xca7fc0c411f934ca expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788796916.513517:0:5814:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788796916.513543:0:5814:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.138@tcp lock: ffff8cb080436400/0xca7fc0c411f934c3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca7fc0c411f934ca expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796916.513549:0:5814:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788796916.513562:0:5814:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.138@tcp lock: ffff8cb080436400/0xca7fc0c411f934c3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca7fc0c411f934ca expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796916.513569:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.138@tcp lock: ffff8cb080436400/0xca7fc0c411f934c3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca7fc0c411f934ca expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796916.513594:0:5814:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788796916.513597:0:5814:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.138@tcp lock: ffff8cb0821f0400/0xca7fc0c411f93499 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xca7fc0c411f934a0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796916.513603:0:5814:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb0821f0400 already unused, calling callback (ffffffffc1adac20) 10000000:00010000:2.0:1788796916.513606:0:5814:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.138@tcp lock: ffff8cb0821f0400/0xca7fc0c411f93499 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0xca7fc0c411f934a0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796916.513612:0:5814:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.138@tcp lock: ffff8cb0821f0400/0xca7fc0c411f93499 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0xca7fc0c411f934a0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788796916.513618:0:5814:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.138@tcp lock: ffff8cb0821f0400/0xca7fc0c411f93499 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0xca7fc0c411f934a0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788796916.513623:0:5814:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788796916.513653:0:5814:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.138@tcp lock: ffff8cb0821f0400/0xca7fc0c411f93499 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca7fc0c411f934a0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796916.513659:0:5814:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788796916.513664:0:5814:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.138@tcp lock: ffff8cb0821f0400/0xca7fc0c411f93499 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca7fc0c411f934a0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796916.513671:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.138@tcp lock: ffff8cb0821f0400/0xca7fc0c411f93499 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca7fc0c411f934a0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796916.513681:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788796916.513682:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788796916.513684:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788796916.513862:0:8441:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cb040031400/0xca7fc0c411f93484 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xca7fc0c411f9347d expref: 18 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796916.513879:0:8441:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cb040031400/0xca7fc0c411f93484 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xca7fc0c411f9347d expref: 18 pid: 5818 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788796916.513889:0:8441:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb077979c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8441:1875689374509440:0@lo:104: 00000100:00100000:2.0:1788796916.513919:0:8441:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788796916.513941:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374509440 00000100:00100000:2.0:1788796916.513947:0:5809:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374509440 00000100:00100000:2.0:1788796916.513965:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788796916.513971:0:5809:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb07797a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+3:8441:x1875689374509440:12345-0@lo:104: 00010000:00010000:2.0:1788796916.513979:0:5809:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.138@tcp lock: ffff8cb080437a00/0xca7fc0c411f9347d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xca7fc0c411f93484 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796916.514011:0:5809:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788796916.514016:0:5809:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb07797a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+3:8441:x1875689374509440:12345-0@lo:104: Request processed in 46us (98us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796916.514022:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788796916.514169:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb048e29500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:3302:1875689374509184:0@lo:103: 00000100:00100000:0.0:1788796916.514200:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788796916.514235:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788796916.514248:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb077979880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:3302:1875689374509312:0@lo:103: 00000100:00100000:0.0:1788796916.514267:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788796916.514294:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374509184 00000100:00100000:0.0:1788796916.514298:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374509184 00010000:00010000:0.0:1788796916.514314:0:5812:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cb080436000/0xca7fc0c411f934ca lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xca7fc0c411f934c3 expref: 19 pid: 5820 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788796916.514332:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374509312 00000100:00100000:0.0:1788796916.514335:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374509312 00010000:00010000:0.0:1788796916.514345:0:5812:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cb041484c00/0xca7fc0c411f934a0 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xca7fc0c411f93499 expref: 20 pid: 5820 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788796916.514360:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788796916.514366:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb079b90380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+20:3302:x1875689374509184:12345-0@lo:103: 00010000:00010000:0.0:1788796916.514376:0:5812:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788796916.514380:0:5812:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cb080436000/0xca7fc0c411f934ca lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xca7fc0c411f934c3 expref: 20 pid: 5820 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796916.514389:0:5812:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cb080436000/0xca7fc0c411f934ca lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xca7fc0c411f934c3 expref: 20 pid: 5820 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796916.514404:0:5812:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788796916.514428:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb079b90380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+20:3302:x1875689374509184:12345-0@lo:103: Request processed in 63us (228us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796916.514433:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788796916.514459:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788796916.514466:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb079b92d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+19:3302:x1875689374509312:12345-0@lo:103: 00010000:00010000:0.0:1788796916.514474:0:5812:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788796916.514478:0:5812:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cb041484c00/0xca7fc0c411f934a0 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xca7fc0c411f93499 expref: 19 pid: 5820 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796916.514491:0:5812:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cb041484c00/0xca7fc0c411f934a0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xca7fc0c411f93499 expref: 19 pid: 5820 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796916.514501:0:5812:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788796916.514523:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb079b92d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+19:3302:x1875689374509312:12345-0@lo:103: Request processed in 58us (255us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796916.514529:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788796916.514576:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb077979880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:3302:1875689374509312:0@lo:103: 00000100:00100000:0.0:1788796916.514585:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb048e29500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:3302:1875689374509184:0@lo:103: 00010000:00010000:2.0:1788796916.514657:0:5814:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788796916.514663:0:5814:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.138@tcp lock: ffff8cb080437a00/0xca7fc0c411f9347d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xca7fc0c411f93484 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796916.514670:0:5814:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb080437a00 already unused, calling callback (ffffffffc1adac20) 10000000:00010000:2.0:1788796916.514674:0:5814:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.138@tcp lock: ffff8cb080437a00/0xca7fc0c411f9347d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xca7fc0c411f93484 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796916.514681:0:5814:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.138@tcp lock: ffff8cb080437a00/0xca7fc0c411f9347d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xca7fc0c411f93484 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788796916.514688:0:5814:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.138@tcp lock: ffff8cb080437a00/0xca7fc0c411f9347d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xca7fc0c411f93484 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788796916.514843:0:5814:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788796916.514864:0:5814:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.138@tcp lock: ffff8cb080437a00/0xca7fc0c411f9347d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca7fc0c411f93484 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796916.514870:0:5814:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1788796916.514922:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:2.0:1788796916.514981:0:5814:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.138@tcp lock: ffff8cb080437a00/0xca7fc0c411f9347d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca7fc0c411f93484 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796916.514988:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.138@tcp lock: ffff8cb080437a00/0xca7fc0c411f9347d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca7fc0c411f93484 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796916.515000:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788796916.515002:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788796916.515003:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788796916.515081:0:8441:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cb040030800/0xca7fc0c411f93476 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xca7fc0c411f9346f expref: 18 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796916.515090:0:8441:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cb040030800/0xca7fc0c411f93476 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xca7fc0c411f9346f expref: 18 pid: 5819 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788796916.515099:0:8441:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb077978e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8441:1875689374509696:0@lo:104: 00000100:00100000:2.0:1788796916.515127:0:8441:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788796916.515154:0:8441:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cb0821f0e00/0xca7fc0c411f93468 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xca7fc0c411f93461 expref: 18 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796916.515161:0:8441:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cb0821f0e00/0xca7fc0c411f93468 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xca7fc0c411f93461 expref: 18 pid: 5820 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788796916.515169:0:8441:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb07797b100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8441:1875689374509824:0@lo:104: 00000100:00100000:2.0:1788796916.515198:0:8441:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788796916.515219:0:8441:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cb0821f0a00/0xca7fc0c411f9343e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xca7fc0c411f93437 expref: 18 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796916.515227:0:8441:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cb0821f0a00/0xca7fc0c411f9343e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xca7fc0c411f93437 expref: 18 pid: 5820 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788796916.515236:0:8441:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb077979500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8441:1875689374509952:0@lo:104: 00000100:00100000:2.0:1788796916.515255:0:8441:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788796916.515277:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374509696 00000100:00100000:2.0:1788796916.515282:0:5809:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374509696 00000100:00100000:2.0:1788796916.515303:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374509824 00000100:00100000:2.0:1788796916.515306:0:5809:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374509824 00000100:00100000:2.0:1788796916.515315:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374509952 00000100:00100000:2.0:1788796916.515318:0:5809:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374509952 00000100:00100000:2.0:1788796916.515330:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788796916.515337:0:5809:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb077979f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+5:8441:x1875689374509696:12345-0@lo:104: 00010000:00010000:2.0:1788796916.515346:0:5809:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.138@tcp lock: ffff8cb0821f0600/0xca7fc0c411f9346f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xca7fc0c411f93476 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796916.515381:0:5809:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788796916.515387:0:5809:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb077979f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+5:8441:x1875689374509696:12345-0@lo:104: Request processed in 51us (259us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796916.515393:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788796916.515407:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788796916.515413:0:5809:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb07797b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+4:8441:x1875689374509824:12345-0@lo:104: 00010000:00010000:2.0:1788796916.515420:0:5809:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.138@tcp lock: ffff8cb041484400/0xca7fc0c411f93461 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xca7fc0c411f93468 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796916.515467:0:5809:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788796916.515472:0:5809:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb07797b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+4:8441:x1875689374509824:12345-0@lo:104: Request processed in 60us (274us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796916.515477:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788796916.515490:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788796916.515495:0:5809:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb07797b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+3:8441:x1875689374509952:12345-0@lo:104: 00010000:00010000:2.0:1788796916.515501:0:5809:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.138@tcp lock: ffff8cb040030000/0xca7fc0c411f93437 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xca7fc0c411f9343e expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796916.515524:0:5809:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1788796916.515528:0:5809:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb07797b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+3:8441:x1875689374509952:12345-0@lo:104: Request processed in 34us (273us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796916.515533:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00010000:2.0:1788796916.515547:0:5814:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788796916.515550:0:5814:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.138@tcp lock: ffff8cb0821f0600/0xca7fc0c411f9346f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xca7fc0c411f93476 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796916.515557:0:5814:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb0821f0600 already unused, calling callback (ffffffffc1adac20) 10000000:00010000:2.0:1788796916.515560:0:5814:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.138@tcp lock: ffff8cb0821f0600/0xca7fc0c411f9346f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xca7fc0c411f93476 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796916.515568:0:5814:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.138@tcp lock: ffff8cb0821f0600/0xca7fc0c411f9346f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xca7fc0c411f93476 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788796916.515575:0:5814:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.138@tcp lock: ffff8cb0821f0600/0xca7fc0c411f9346f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xca7fc0c411f93476 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788796916.515581:0:5814:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788796916.515603:0:5814:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.138@tcp lock: ffff8cb0821f0600/0xca7fc0c411f9346f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca7fc0c411f93476 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796916.515610:0:5814:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788796916.516171:0:5815:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000100:00100000:3.0:1788796916.516920:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb07797aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:3301:1875689374510080:0@lo:103: 00000100:00100000:3.0:1788796916.516978:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796916.517015:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb07797bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:3301:1875689374509568:0@lo:103: 00000100:00100000:3.0:1788796916.517056:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796916.517088:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374510080 00000100:00100000:3.0:1788796916.517094:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374510080 00010000:00010000:3.0:1788796916.517119:0:5813:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cb040030800/0xca7fc0c411f93476 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xca7fc0c411f9346f expref: 19 pid: 5819 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788796916.517143:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374509568 00000100:00100000:3.0:1788796916.517145:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374509568 00010000:00010000:3.0:1788796916.517155:0:5813:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cb040031400/0xca7fc0c411f93484 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xca7fc0c411f9347d expref: 20 pid: 5818 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788796916.517174:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788796916.517181:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb06ef1d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+20:3301:x1875689374510080:12345-0@lo:103: 00010000:00010000:3.0:1788796916.517192:0:5813:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788796916.517197:0:5813:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cb040030800/0xca7fc0c411f93476 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xca7fc0c411f9346f expref: 20 pid: 5819 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796916.517205:0:5813:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cb040030800/0xca7fc0c411f93476 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xca7fc0c411f9346f expref: 20 pid: 5819 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796916.517221:0:5813:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788796916.517248:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb06ef1d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+20:3301:x1875689374510080:12345-0@lo:103: Request processed in 68us (269us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796916.517253:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788796916.517276:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788796916.517281:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb06ef1c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+19:3301:x1875689374509568:12345-0@lo:103: 00010000:00010000:3.0:1788796916.517288:0:5813:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788796916.517292:0:5813:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cb040031400/0xca7fc0c411f93484 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xca7fc0c411f9347d expref: 19 pid: 5818 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796916.517299:0:5813:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cb040031400/0xca7fc0c411f93484 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xca7fc0c411f9347d expref: 19 pid: 5818 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796916.517308:0:5813:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788796916.517328:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb06ef1c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+19:3301:x1875689374509568:12345-0@lo:103: Request processed in 48us (271us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796916.517333:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788796916.517366:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb07797aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:3301:1875689374510080:0@lo:103: 00000100:00100000:3.0:1788796916.517373:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb07797bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:3301:1875689374509568:0@lo:103: 00010000:00010000:2.0:1788796916.518212:0:5814:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.138@tcp lock: ffff8cb0821f0600/0xca7fc0c411f9346f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca7fc0c411f93476 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796916.518222:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.138@tcp lock: ffff8cb0821f0600/0xca7fc0c411f9346f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca7fc0c411f93476 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796916.518237:0:5814:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788796916.518241:0:5814:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.138@tcp lock: ffff8cb040030000/0xca7fc0c411f93437 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xca7fc0c411f9343e expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796916.518247:0:5814:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb040030000 already unused, calling callback (ffffffffc1adac20) 10000000:00010000:2.0:1788796916.518250:0:5814:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.138@tcp lock: ffff8cb040030000/0xca7fc0c411f93437 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xca7fc0c411f9343e expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796916.518258:0:5814:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.138@tcp lock: ffff8cb040030000/0xca7fc0c411f93437 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xca7fc0c411f9343e expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788796916.518264:0:5814:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.138@tcp lock: ffff8cb040030000/0xca7fc0c411f93437 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xca7fc0c411f9343e expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788796916.518269:0:5814:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788796916.518295:0:5814:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.138@tcp lock: ffff8cb040030000/0xca7fc0c411f93437 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca7fc0c411f9343e expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796916.518302:0:5814:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788796916.518319:0:5814:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.138@tcp lock: ffff8cb040030000/0xca7fc0c411f93437 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca7fc0c411f9343e expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796916.518338:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.138@tcp lock: ffff8cb040030000/0xca7fc0c411f93437 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca7fc0c411f9343e expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796916.518348:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788796916.518349:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788796916.518351:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788796916.518373:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788796916.518386:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb077978000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:3303:1875689374510336:0@lo:103: 00000100:00100000:2.0:1788796916.518425:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788796916.518477:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374510336 00000100:00100000:2.0:1788796916.518483:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374510336 00010000:00010000:2.0:1788796916.518503:0:5813:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cb0821f0a00/0xca7fc0c411f9343e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xca7fc0c411f93437 expref: 19 pid: 5820 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788796916.518527:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788796916.518534:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb077979180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+19:3303:x1875689374510336:12345-0@lo:103: 00010000:00010000:2.0:1788796916.518542:0:5813:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788796916.518545:0:5813:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cb0821f0a00/0xca7fc0c411f9343e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xca7fc0c411f93437 expref: 19 pid: 5820 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796916.518592:0:8441:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cb080437e00/0xca7fc0c411f93414 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xca7fc0c411f9340d expref: 19 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796916.518605:0:8441:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cb080437e00/0xca7fc0c411f93414 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xca7fc0c411f9340d expref: 19 pid: 5820 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788796916.518617:0:8441:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb06ef1d180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8441:1875689374510208:0@lo:104: 00000100:00100000:3.0:1788796916.518663:0:8441:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796916.518682:0:8441:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb046bf09c0 going to sleep for 11 seconds 00010000:00010000:3.0:1788796916.518714:0:8441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cb080436000/0xca7fc0c411f934ca lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xca7fc0c411f934c3 expref: 19 pid: 5820 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788796916.518725:0:8441:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb048e2bb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8441:1875689374508928:0@lo:104: 00010000:00010000:3.0:1788796916.518748:0:8441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cb041484c00/0xca7fc0c411f934a0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xca7fc0c411f93499 expref: 18 pid: 5820 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788796916.518764:0:8441:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb048e29f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8441:1875689374509056:0@lo:104: 00010000:00010000:3.0:1788796916.518774:0:8441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cb040031400/0xca7fc0c411f93484 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xca7fc0c411f9347d expref: 17 pid: 5818 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788796916.518783:0:8441:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb077979c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8441:1875689374509440:0@lo:104: 00010000:00010000:3.0:1788796916.518792:0:8441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cb040030800/0xca7fc0c411f93476 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xca7fc0c411f9346f expref: 16 pid: 5819 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788796916.518806:0:8441:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb077978e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8441:1875689374509696:0@lo:104: 00000100:00100000:3.0:1788796916.518815:0:8441:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb07797b100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8441:1875689374509824:0@lo:104: 00000100:00100000:3.0:1788796916.518823:0:8441:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb077979500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8441:1875689374509952:0@lo:104: 00010000:00010000:2.0:1788796916.519193:0:5813:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cb0821f0a00/0xca7fc0c411f9343e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xca7fc0c411f93437 expref: 15 pid: 5820 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796916.519210:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cb0821f0a00/0xca7fc0c411f9343e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xca7fc0c411f93437 expref: 15 pid: 5820 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796916.519223:0:5813:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788796916.519597:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1788796916.519669:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00010000:00010000:1.0:1788796916.519759:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788796916.519770:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.138@tcp lock: ffff8cb041484400/0xca7fc0c411f93461 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xca7fc0c411f93468 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796916.519779:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb041484400 already unused, calling callback (ffffffffc1adac20) 10000000:00010000:1.0:1788796916.519783:0:5815:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.138@tcp lock: ffff8cb041484400/0xca7fc0c411f93461 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xca7fc0c411f93468 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796916.519794:0:5815:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.138@tcp lock: ffff8cb041484400/0xca7fc0c411f93461 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xca7fc0c411f93468 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788796916.519803:0:5815:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.138@tcp lock: ffff8cb041484400/0xca7fc0c411f93461 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xca7fc0c411f93468 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788796916.519820:0:5815:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788796916.519863:0:5815:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.138@tcp lock: ffff8cb041484400/0xca7fc0c411f93461 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca7fc0c411f93468 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796916.519869:0:5815:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788796916.520067:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb077979180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+14:3303:x1875689374510336:12345-0@lo:103: Request processed in 1531us (1639us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796916.520085:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788796916.520112:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351417856 00000100:00100000:2.0:1788796916.520117:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351417856 00010000:00010000:2.0:1788796916.520137:0:5813:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cb0821f1000/0xca7fc0c411f934df lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee0ec9 expref: 10 pid: 5819 timeout: 305 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788796916.520150:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351417984 00000100:00100000:2.0:1788796916.520152:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351417984 00010000:00010000:2.0:1788796916.520161:0:5813:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cb080437600/0xca7fc0c411f934d8 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee0ec2 expref: 11 pid: 5820 timeout: 305 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788796916.520173:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 17 00000100:00100000:2.0:1788796916.520180:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb06f60b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b4d9d1a9-601d-459e-8721-8bfc2fdde84f+11:2354:x1875689351417856:12345-192.168.204.38@tcp:103: 00010000:00010000:2.0:1788796916.520191:0:5813:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788796916.520196:0:5813:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cb0821f1000/0xca7fc0c411f934df lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee0ec9 expref: 11 pid: 5819 timeout: 305 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796916.520206:0:5813:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cb0821f1000/0xca7fc0c411f934df lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee0ec9 expref: 11 pid: 5819 timeout: 305 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796916.520218:0:5813:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788796916.520261:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb06f60b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b4d9d1a9-601d-459e-8721-8bfc2fdde84f+11:2354:x1875689351417856:12345-192.168.204.38@tcp:103: Request processed in 80us (666us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796916.520267:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 17 00000100:00100000:2.0:1788796916.520278:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 18 00000100:00100000:2.0:1788796916.520285:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb042ed9850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b4d9d1a9-601d-459e-8721-8bfc2fdde84f+10:2355:x1875689351417984:12345-192.168.204.38@tcp:103: 00010000:00010000:2.0:1788796916.520291:0:5813:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788796916.520302:0:5813:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cb080437600/0xca7fc0c411f934d8 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee0ec2 expref: 10 pid: 5820 timeout: 305 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796916.520311:0:5813:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cb080437600/0xca7fc0c411f934d8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee0ec2 expref: 10 pid: 5820 timeout: 305 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796916.520320:0:5813:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788796916.520338:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb042ed9850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b4d9d1a9-601d-459e-8721-8bfc2fdde84f+10:2355:x1875689351417984:12345-192.168.204.38@tcp:103: Request processed in 54us (669us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796916.520345:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 18 00000100:00100000:2.0:1788796916.520487:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374510208 00000100:00100000:2.0:1788796916.520491:0:5809:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374510208 00000100:00100000:2.0:1788796916.520518:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788796916.520523:0:5809:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb06ef1ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+3:8441:x1875689374510208:12345-0@lo:104: 00010000:00010000:2.0:1788796916.520534:0:5809:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.138@tcp lock: ffff8cb040030c00/0xca7fc0c411f9340d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xca7fc0c411f93414 expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796916.520573:0:5809:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788796916.520579:0:5809:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb06ef1ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+3:8441:x1875689374510208:12345-0@lo:104: Request processed in 55us (1915us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796916.520585:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:2.0:1788796916.520603:0:5814:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788796916.520608:0:5814:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.138@tcp lock: ffff8cb040030c00/0xca7fc0c411f9340d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xca7fc0c411f93414 expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796916.520615:0:5814:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb040030c00 already unused, calling callback (ffffffffc1adac20) 10000000:00010000:2.0:1788796916.520618:0:5814:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.138@tcp lock: ffff8cb040030c00/0xca7fc0c411f9340d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xca7fc0c411f93414 expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796916.520626:0:5814:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.138@tcp lock: ffff8cb040030c00/0xca7fc0c411f9340d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xca7fc0c411f93414 expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788796916.520640:0:5814:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.138@tcp lock: ffff8cb040030c00/0xca7fc0c411f9340d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xca7fc0c411f93414 expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788796916.520645:0:5814:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788796916.520664:0:5814:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.138@tcp lock: ffff8cb040030c00/0xca7fc0c411f9340d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca7fc0c411f93414 expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796916.520670:0:5814:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788796916.520682:0:5814:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.138@tcp lock: ffff8cb040030c00/0xca7fc0c411f9340d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca7fc0c411f93414 expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796916.520688:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.138@tcp lock: ffff8cb040030c00/0xca7fc0c411f9340d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca7fc0c411f93414 expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796916.520838:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788796916.520839:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788796916.520841:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788796916.520859:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb077979180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:3300:1875689374510592:0@lo:103: 00000100:00100000:2.0:1788796916.520890:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788796916.520922:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374510592 00000100:00100000:2.0:1788796916.520925:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374510592 00010000:00010000:2.0:1788796916.520939:0:5813:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cb080437e00/0xca7fc0c411f93414 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xca7fc0c411f9340d expref: 14 pid: 5820 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796916.521062:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.138@tcp lock: ffff8cb041484400/0xca7fc0c411f93461 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca7fc0c411f93468 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796916.521071:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.138@tcp lock: ffff8cb041484400/0xca7fc0c411f93461 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca7fc0c411f93468 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796916.521085:0:5815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788796916.521087:0:5815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788796916.521088:0:5815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788796916.521095:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788796916.521097:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788796916.521375:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788796916.521383:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb077978a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+14:3300:x1875689374510592:12345-0@lo:103: 00010000:00010000:2.0:1788796916.521391:0:5813:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788796916.521396:0:5813:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cb080437e00/0xca7fc0c411f93414 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xca7fc0c411f9340d expref: 14 pid: 5820 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796916.521410:0:5813:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cb080437e00/0xca7fc0c411f93414 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xca7fc0c411f9340d expref: 14 pid: 5820 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796916.521421:0:5813:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788796916.521464:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb077978a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+14:3300:x1875689374510592:12345-0@lo:103: Request processed in 83us (573us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796916.521470:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788796916.521501:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb077979180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:3300:1875689374510592:0@lo:103: 00000100:00100000:2.0:1788796916.521517:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788796916.521525:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb06f60a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:3302:1875689374510464:0@lo:103: 00000100:00100000:2.0:1788796916.521548:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788796916.521569:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374510464 00000100:00100000:2.0:1788796916.521572:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374510464 00010000:00010000:2.0:1788796916.521585:0:5813:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cb0821f0e00/0xca7fc0c411f93468 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xca7fc0c411f93461 expref: 14 pid: 5820 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788796916.521599:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788796916.521604:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb077979180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+14:3302:x1875689374510464:12345-0@lo:103: 00010000:00010000:2.0:1788796916.521610:0:5813:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788796916.521613:0:5813:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cb0821f0e00/0xca7fc0c411f93468 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xca7fc0c411f93461 expref: 14 pid: 5820 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796916.521621:0:5813:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cb0821f0e00/0xca7fc0c411f93468 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xca7fc0c411f93461 expref: 14 pid: 5820 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796916.521631:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cb0821f0e00/0xca7fc0c411f93468 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xca7fc0c411f93461 expref: 14 pid: 5820 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796916.521655:0:5813:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8cb041484000/0xca7fc0c411f93517 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796916.521663:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cb041484000/0xca7fc0c411f93517 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796916.521677:0:5813:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cb041484000/0xca7fc0c411f93517 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796916.521684:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cb041484000/0xca7fc0c411f93517 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796916.521691:0:5813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cb041484000/0xca7fc0c411f93517 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796916.522346:0:5813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cb041484000/0xca7fc0c411f93517 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796916.522352:0:5813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb041484000 already unused, calling callback (ffffffffc14d98b0) 00010000:00010000:2.0:1788796916.522357:0:5813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cb041484000/0xca7fc0c411f93517 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796916.522365:0:5813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cb041484000/0xca7fc0c411f93517 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796916.522376:0:5813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cb041484000/0xca7fc0c411f93517 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796916.522386:0:5813:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788796916.522628:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb077979180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+13:3302:x1875689374510464:12345-0@lo:103: Request processed in 1022us (1078us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796916.522647:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788796916.522733:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb077978000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:3303:1875689374510336:0@lo:103: 00010000:00010000:3.0:1788796916.522881:0:8441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cb0821f1000/0xca7fc0c411f934df lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee0ec9 expref: 9 pid: 5819 timeout: 305 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788796916.522892:0:8441:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb048e29c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8441:1875689374508672:192.168.204.38@tcp:104: 00010000:00010000:3.0:1788796916.522902:0:8441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cb080437600/0xca7fc0c411f934d8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee0ec2 expref: 8 pid: 5820 timeout: 305 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788796916.522909:0:8441:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb048e2a680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8441:1875689374508800:192.168.204.38@tcp:104: 00010000:00010000:3.0:1788796916.522920:0:8441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cb080437e00/0xca7fc0c411f93414 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xca7fc0c411f9340d expref: 12 pid: 5820 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788796916.522927:0:8441:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb06ef1d180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8441:1875689374510208:0@lo:104: 00010000:00010000:3.0:1788796916.522975:0:8441:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8cb041484000/0xca7fc0c411f93517 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796916.522985:0:8441:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8cb041484000/0xca7fc0c411f93517 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796916.522991:0:8441:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cb041484000/0xca7fc0c411f93517 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796916.522997:0:8441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cb041484000/0xca7fc0c411f93517 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788796916.524557:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb06f60a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:3302:1875689374510464:0@lo:103: 00010000:00010000:2.0:1788796916.530318:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788796917.139230:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1788796917.139485:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351418240 00000100:00100000:0.0:1788796917.139496:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351418240 00000100:00100000:0.0:1788796917.139582:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 27 00000100:00100000:0.0:1788796917.140196:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb06f609f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6d050bb-169e-4784-be5b-7071799bf3b0+6:2355:x1875689351418240:12345-192.168.204.38@tcp:400: 00000100:00100000:0.0:1788796917.140290:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb06f609f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6d050bb-169e-4784-be5b-7071799bf3b0+6:2355:x1875689351418240:12345-192.168.204.38@tcp:400: Request processed in 103us (1082us total) trans 0 rc 0/0 00000100:00080000:2.0:1788796917.140941:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788796917.144873:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 27 00000100:00100000:2.0:1788796917.146067:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1788796917.146102:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1788796917.146127:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1788796917.146194:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351418368 00000100:00100000:0.0:1788796917.146203:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351418368 00000100:00100000:0.0:1788796917.146265:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351418496 00000100:00100000:0.0:1788796917.146269:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351418496 00000100:00100000:0.0:1788796917.146291:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9 00000100:00100000:0.0:1788796917.146302:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb077978700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e6d050bb-169e-4784-be5b-7071799bf3b0+5:2354:x1875689351418368:12345-192.168.204.38@tcp:400: 00000100:00100000:0.0:1788796917.146381:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb077978700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e6d050bb-169e-4784-be5b-7071799bf3b0+5:2354:x1875689351418368:12345-192.168.204.38@tcp:400: Request processed in 81us (278us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796917.146403:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9 00000100:00100000:0.0:1788796917.146418:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 10 00000100:00100000:0.0:1788796917.146424:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb07797a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e6d050bb-169e-4784-be5b-7071799bf3b0+5:2355:x1875689351418496:12345-192.168.204.38@tcp:400: 00000100:00100000:0.0:1788796917.146459:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb07797a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e6d050bb-169e-4784-be5b-7071799bf3b0+5:2355:x1875689351418496:12345-192.168.204.38@tcp:400: Request processed in 35us (331us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796917.146465:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 10 00000100:00080000:2.0:1788796917.146539:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788796917.146544:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788796917.146662:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351418112 00000100:00100000:1.0:1788796917.146668:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351418112 00000100:00100000:1.0:1788796917.146847:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 132 00000100:00100000:1.0:1788796917.146855:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0585b2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4d9d1a9-601d-459e-8721-8bfc2fdde84f+8:2354:x1875689351418112:12345-192.168.204.38@tcp:400: 00000100:00100000:1.0:1788796917.146884:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0585b2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4d9d1a9-601d-459e-8721-8bfc2fdde84f+8:2354:x1875689351418112:12345-192.168.204.38@tcp:400: Request processed in 31us (823us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796917.146890:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 132 00010000:00010000:1.0:1788796917.554373:0:5815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788796918.258355:0:5822:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788796918.258366:0:5822:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8cb042fd2800 from 39 10000000:01000000:2.0:1788796918.258373:0:5822:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788796918.258443:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.138@tcp lock: ffff8cb041484e00/0xca7fc0c411f9351e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796918.258459:0:5822:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.138@tcp lock: ffff8cb041484e00/0xca7fc0c411f9351e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796918.258473:0:5822:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.138@tcp lock: ffff8cb041484e00/0xca7fc0c411f9351e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788796918.258504:0:5822:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb077978380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:5822:1875689374510720:0@lo:101: 00000100:00100000:2.0:1788796918.258608:0:5822:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788796918.258715:0:5822:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb046bf0180 going to sleep for 11 seconds 00000100:00100000:0.0:1788796918.259080:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374510720 00000100:00100000:0.0:1788796918.259090:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374510720 00000100:00100000:0.0:1788796918.259168:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1788796918.259179:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0585b0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+12:5822:x1875689374510720:12345-0@lo:101: 00010000:00010000:0.0:1788796918.259198:0:5819:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788796918.259221:0:5819:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cb079b81c00/0xca7fc0c411f93525 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xca7fc0c411f9351e expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796918.259251:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cb079b81c00/0xca7fc0c411f93525 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xca7fc0c411f9351e expref: 13 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796918.259264:0:5819:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cb079b81c00/0xca7fc0c411f93525 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xca7fc0c411f9351e expref: 13 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796918.259274:0:5819:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb079b81c00, rc 0) 00000100:00100000:0.0:1788796918.259337:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0585b0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+13:5822:x1875689374510720:12345-0@lo:101: Request processed in 160us (729us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796918.259344:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1788796918.259507:0:5822:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb077978380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:5822:1875689374510720:0@lo:101: 00010000:00010000:2.0:1788796918.259524:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.138@tcp lock: ffff8cb041484e00/0xca7fc0c411f9351e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xca7fc0c411f93525 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796918.259543:0:5822:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.138@tcp lock: ffff8cb041484e00/0xca7fc0c411f9351e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xca7fc0c411f93525 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788796918.259624:0:5822:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb077978380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:5822:1875689374510848:0@lo:501: 00000100:00100000:2.0:1788796918.259671:0:5822:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788796918.259704:0:5822:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb046bf0180 going to sleep for 11 seconds 00000100:00100000:3.0:1788796918.259717:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374510848 00000100:00100000:3.0:1788796918.259722:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374510848 00000100:00100000:3.0:1788796918.259756:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1788796918.259764:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0585b1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+13:5822:x1875689374510848:12345-0@lo:501: 00000100:00100000:3.0:1788796918.260117:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0585b1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+13:5822:x1875689374510848:12345-0@lo:501: Request processed in 353us (457us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796918.260124:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1788796918.260212:0:5822:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb077978380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:5822:1875689374510848:0@lo:501: 00000100:00100000:2.0:1788796918.260242:0:5822:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb077978380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:5822:1875689374510976:0@lo:503: 00000100:00100000:2.0:1788796918.260281:0:5822:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788796918.260310:0:5822:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb046bf0180 going to sleep for 11 seconds 00000100:00100000:1.0:1788796918.260437:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374510976 00000100:00100000:1.0:1788796918.260443:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374510976 00000100:00100000:1.0:1788796918.260481:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1788796918.260496:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0585b0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+13:5822:x1875689374510976:12345-0@lo:503: 00000100:00100000:1.0:1788796918.260674:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0585b0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+13:5822:x1875689374510976:12345-0@lo:503: Request processed in 180us (392us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796918.260681:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1788796918.260888:0:5822:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb077978380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:5822:1875689374510976:0@lo:503: 00000100:00100000:2.0:1788796918.261389:0:8458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb077978380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:8458:1875689374511104:0@lo:502: 00000100:00100000:2.0:1788796918.261440:0:8458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796918.261470:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374511104 00000100:00100000:2.0:1788796918.261472:0:8458:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb046bf0b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788796918.261476:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374511104 00000100:00100000:3.0:1788796918.261510:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1788796918.261519:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0585b3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+13:8458:x1875689374511104:12345-0@lo:502: 00000100:00100000:3.0:1788796918.261731:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0585b3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+13:8458:x1875689374511104:12345-0@lo:502: Request processed in 213us (289us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796918.261739:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1788796918.261905:0:8458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb077978380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:8458:1875689374511104:0@lo:502: 00000100:00100000:2.0:1788796918.261948:0:8458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb077978380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:8458:1875689374511232:0@lo:502: 00000100:00100000:2.0:1788796918.261984:0:8458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788796918.262007:0:8458:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb046bf0b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788796918.262062:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374511232 00000100:00100000:3.0:1788796918.262067:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374511232 00000100:00100000:1.0:1788796918.262192:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1788796918.262202:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0585b2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+13:8458:x1875689374511232:12345-0@lo:502: 00000100:00100000:1.0:1788796918.262360:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0585b2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+13:8458:x1875689374511232:12345-0@lo:502: Request processed in 161us (375us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796918.262368:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1788796918.262471:0:8458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb077978380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:8458:1875689374511232:0@lo:502: 00000040:00080000:2.0:1788796918.262490:0:8458:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:0.0:1788796918.267259:0:5822:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:0.0:1788796918.267316:0:5822:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.138@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788796918.267332:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.138@tcp lock: ffff8cb041484e00/0xca7fc0c411f9351e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xca7fc0c411f93525 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796918.267370:0:5822:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.138@tcp lock: ffff8cb041484e00/0xca7fc0c411f9351e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xca7fc0c411f93525 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788796918.267383:0:5822:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:0.0:1788796918.267386:0:5822:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:0.0:1788796918.267389:0:5822:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1788796918.267448:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.138@tcp lock: ffff8cb079b81200/0xca7fc0c411f9352c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796918.267456:0:5822:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.138@tcp lock: ffff8cb079b81200/0xca7fc0c411f9352c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796918.267468:0:5822:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.138@tcp lock: ffff8cb079b81200/0xca7fc0c411f9352c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788796918.267496:0:5822:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb079b91180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:5822:1875689374511360:0@lo:101: 00000100:00100000:0.0:1788796918.267579:0:5822:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788796918.267646:0:5822:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb04887ecc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788796918.267772:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374511360 00000100:00100000:2.0:1788796918.267782:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374511360 00000100:00100000:2.0:1788796918.267840:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1788796918.267851:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0585b3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+13:5822:x1875689374511360:12345-0@lo:101: 00010000:00010000:2.0:1788796918.267865:0:5819:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788796918.267879:0:5819:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cb041484200/0xca7fc0c411f93533 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xca7fc0c411f9352c expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796918.267911:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cb041484200/0xca7fc0c411f93533 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xca7fc0c411f9352c expref: 14 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796918.267921:0:5819:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cb041484200/0xca7fc0c411f93533 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xca7fc0c411f9352c expref: 14 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796918.267929:0:5819:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb041484200, rc 0) 00000100:00100000:2.0:1788796918.267981:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0585b3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+14:5822:x1875689374511360:12345-0@lo:101: Request processed in 133us (403us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796918.267989:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1788796918.268282:0:5822:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb079b91180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:5822:1875689374511360:0@lo:101: 00010000:00010000:0.0:1788796918.268301:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.138@tcp lock: ffff8cb079b81200/0xca7fc0c411f9352c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xca7fc0c411f93533 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796918.268311:0:5822:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.138@tcp lock: ffff8cb079b81200/0xca7fc0c411f9352c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xca7fc0c411f93533 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788796918.268370:0:5822:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb079b91180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:5822:1875689374511488:0@lo:501: 00000100:00100000:0.0:1788796918.268399:0:5822:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788796918.268525:0:5822:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb04887ecc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788796918.268906:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374511488 00000100:00100000:3.0:1788796918.268919:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374511488 00000100:00100000:3.0:1788796918.268960:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1788796918.268971:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0585b1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+14:5822:x1875689374511488:12345-0@lo:501: 00000100:00100000:3.0:1788796918.269469:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0585b1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+14:5822:x1875689374511488:12345-0@lo:501: Request processed in 499us (1067us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796918.269479:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1788796918.269574:0:5822:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb079b91180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:5822:1875689374511488:0@lo:501: 00000100:00100000:0.0:1788796918.269614:0:5822:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb079b91180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:5822:1875689374511616:0@lo:503: 00000100:00100000:0.0:1788796918.269654:0:5822:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788796918.269697:0:5822:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb04887ecc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788796918.269873:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374511616 00000100:00100000:2.0:1788796918.269878:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374511616 00000100:00100000:2.0:1788796918.269917:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1788796918.269925:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0585b1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+14:5822:x1875689374511616:12345-0@lo:503: 00000100:00100000:2.0:1788796918.270115:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0585b1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+14:5822:x1875689374511616:12345-0@lo:503: Request processed in 190us (459us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796918.270122:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1788796918.270270:0:5822:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb079b91180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:5822:1875689374511616:0@lo:503: 00000100:00100000:0.0:1788796918.271562:0:8459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb079b91180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:8459:1875689374511744:0@lo:502: 00000100:00100000:0.0:1788796918.271628:0:8459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788796918.271680:0:8459:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb04887e9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788796918.271726:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374511744 00000100:00100000:2.0:1788796918.271733:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374511744 00000100:00100000:2.0:1788796918.271782:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1788796918.271790:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0585b3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+14:8459:x1875689374511744:12345-0@lo:502: 00000100:00100000:2.0:1788796918.271982:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0585b3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+14:8459:x1875689374511744:12345-0@lo:502: Request processed in 193us (354us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796918.271989:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1788796918.272270:0:8459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb079b91180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:8459:1875689374511744:0@lo:502: 00000020:01000000:0.0:1788796918.272304:0:8459:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788796918.272316:0:8459:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788796918.272318:0:8459:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1788796918.272328:0:8459:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1788796918.272351:0:8459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb079b91180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:8459:1875689374511872:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788796918.272389:0:8459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788796918.272432:0:8459:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb04887e9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788796918.272498:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374511872 00000100:00100000:3.0:1788796918.272503:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374511872 00000100:00100000:3.0:1788796918.272527:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1788796918.272533:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0585b1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+14:8459:x1875689374511872:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788796918.272681:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0585b1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+14:8459:x1875689374511872:12345-0@lo:502:llog_process_th.0 Request processed in 147us (292us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796918.272688:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1788796918.272782:0:8459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb079b91180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:8459:1875689374511872:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788796918.272800:0:8459:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788796918.272805:0:8459:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788796918.272807:0:8459:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1788796918.272810:0:8459:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:3.0:1788796918.273107:0:5822:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:3.0:1788796918.273146:0:5822:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.138@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1788796918.273158:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.138@tcp lock: ffff8cb079b81200/0xca7fc0c411f9352c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xca7fc0c411f93533 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796918.273172:0:5822:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.138@tcp lock: ffff8cb079b81200/0xca7fc0c411f9352c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xca7fc0c411f93533 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788796918.273183:0:5822:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1788796918.273186:0:5822:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8cb042fda000 from 39 10000000:01000000:3.0:1788796918.273189:0:5822:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788796918.273220:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.138@tcp lock: ffff8cb080437200/0xca7fc0c411f9353a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796918.273228:0:5822:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.138@tcp lock: ffff8cb080437200/0xca7fc0c411f9353a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796918.273250:0:5822:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.138@tcp lock: ffff8cb080437200/0xca7fc0c411f9353a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788796918.273266:0:5822:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb06ef1d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:5822:1875689374512000:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788796918.273299:0:5822:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796918.273327:0:5822:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb069af3480 going to sleep for 11 seconds 00000100:00100000:0.0:1788796918.273425:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374512000 00000100:00100000:0.0:1788796918.273431:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374512000 00000100:00100000:0.0:1788796918.273456:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1788796918.273463:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0585b3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+14:5822:x1875689374512000:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788796918.273482:0:5818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788796918.273498:0:5818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cb079b80600/0xca7fc0c411f93541 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xca7fc0c411f9353a expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796918.273526:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cb079b80600/0xca7fc0c411f93541 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xca7fc0c411f9353a expref: 15 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796918.273537:0:5818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cb079b80600/0xca7fc0c411f93541 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xca7fc0c411f9353a expref: 15 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796918.273545:0:5818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb079b80600, rc 0) 00000100:00100000:0.0:1788796918.273579:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0585b3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+15:5822:x1875689374512000:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 116us (280us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796918.273585:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1788796918.273663:0:5822:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb06ef1d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:5822:1875689374512000:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788796918.273677:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.138@tcp lock: ffff8cb080437200/0xca7fc0c411f9353a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xca7fc0c411f93541 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796918.273687:0:5822:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.138@tcp lock: ffff8cb080437200/0xca7fc0c411f9353a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xca7fc0c411f93541 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788796918.273753:0:5822:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb06ef1d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:5822:1875689374512128:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788796918.273781:0:5822:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796918.273801:0:5822:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb069af3480 going to sleep for 11 seconds 00000100:00100000:0.0:1788796918.273962:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374512128 00000100:00100000:0.0:1788796918.273967:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374512128 00000100:00100000:0.0:1788796918.273984:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1788796918.273989:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0585b0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+15:5822:x1875689374512128:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788796918.274261:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0585b0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+15:5822:x1875689374512128:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 271us (479us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796918.274269:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1788796918.274899:0:5822:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb06ef1d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:5822:1875689374512128:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788796918.274945:0:5822:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb06ef1d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:5822:1875689374512256:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788796918.274989:0:5822:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796918.275068:0:5822:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb069af3480 going to sleep for 11 seconds 00000100:00100000:0.0:1788796918.275258:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374512256 00000100:00100000:0.0:1788796918.275265:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374512256 00000100:00100000:0.0:1788796918.275297:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1788796918.275305:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb04886ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+15:5822:x1875689374512256:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788796918.275487:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb04886ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+15:5822:x1875689374512256:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 181us (497us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796918.275503:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1788796918.276279:0:5822:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb06ef1d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:5822:1875689374512256:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788796918.277115:0:8460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb06f608380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:8460:1875689374512384:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788796918.277213:0:8460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788796918.277261:0:8460:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb042fe3540 going to sleep for 11 seconds 00000100:00100000:2.0:1788796918.277372:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374512384 00000100:00100000:2.0:1788796918.277380:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374512384 00000100:00100000:2.0:1788796918.277444:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1788796918.277463:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb048868450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+15:8460:x1875689374512384:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788796918.277714:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb048868450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+15:8460:x1875689374512384:12345-0@lo:502:llog_process_th.0 Request processed in 253us (499us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796918.277722:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1788796918.278328:0:8460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb06f608380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:8460:1875689374512384:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788796918.278377:0:8460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb06f608380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:8460:1875689374512512:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788796918.278421:0:8460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788796918.278455:0:8460:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb048fd9000 going to sleep for 11 seconds 00000100:00100000:2.0:1788796918.278498:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374512512 00000100:00100000:2.0:1788796918.278502:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374512512 00000100:00100000:0.0:1788796918.278598:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1788796918.278607:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb048869450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+15:8460:x1875689374512512:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788796918.278884:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb048869450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+15:8460:x1875689374512512:12345-0@lo:502:llog_process_th.0 Request processed in 279us (462us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796918.278892:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1788796918.279007:0:8460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb06f608380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:8460:1875689374512512:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1788796918.279065:0:8460:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:3.0:1788796918.279273:0:5822:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:3.0:1788796918.279293:0:5822:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.138@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788796918.279304:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.138@tcp lock: ffff8cb080437200/0xca7fc0c411f9353a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xca7fc0c411f93541 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796918.279326:0:5822:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.138@tcp lock: ffff8cb080437200/0xca7fc0c411f9353a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xca7fc0c411f93541 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788796918.279337:0:5822:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:3.0:1788796918.279339:0:5822:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:3.0:1788796918.279342:0:5822:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1788796918.279368:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.138@tcp lock: ffff8cb080437000/0xca7fc0c411f93548 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796918.279376:0:5822:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.138@tcp lock: ffff8cb080437000/0xca7fc0c411f93548 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796918.279385:0:5822:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.138@tcp lock: ffff8cb080437000/0xca7fc0c411f93548 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788796918.279400:0:5822:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb06ef1d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:5822:1875689374512640:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788796918.279444:0:5822:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796918.279479:0:5822:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb069af3480 going to sleep for 11 seconds 00000100:00100000:0.0:1788796918.279524:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374512640 00000100:00100000:0.0:1788796918.279529:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374512640 00000100:00100000:0.0:1788796918.279568:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1788796918.279574:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb048868c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+15:5822:x1875689374512640:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788796918.279583:0:5819:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788796918.279596:0:5819:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cb079b81600/0xca7fc0c411f9354f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xca7fc0c411f93548 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796918.279618:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cb079b81600/0xca7fc0c411f9354f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xca7fc0c411f93548 expref: 16 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796918.279628:0:5819:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cb079b81600/0xca7fc0c411f9354f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xca7fc0c411f93548 expref: 16 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796918.279637:0:5819:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb079b81600, rc 0) 00000100:00100000:0.0:1788796918.279681:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb048868c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+16:5822:x1875689374512640:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 106us (236us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796918.279686:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1788796918.280059:0:5822:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb06ef1d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:5822:1875689374512640:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788796918.280073:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.138@tcp lock: ffff8cb080437000/0xca7fc0c411f93548 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xca7fc0c411f9354f expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796918.280082:0:5822:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.138@tcp lock: ffff8cb080437000/0xca7fc0c411f93548 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xca7fc0c411f9354f expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788796918.280139:0:5822:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb06f608380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:5822:1875689374512768:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788796918.280167:0:5822:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788796918.280181:0:5822:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb042fe3540 going to sleep for 11 seconds 00000100:00100000:0.0:1788796918.280558:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374512768 00000100:00100000:0.0:1788796918.280563:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374512768 00000100:00100000:0.0:1788796918.280606:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1788796918.280622:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb048868850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+16:5822:x1875689374512768:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788796918.280919:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb048868850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+16:5822:x1875689374512768:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 298us (750us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796918.280926:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1788796918.281168:0:5822:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb06f608380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:5822:1875689374512768:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788796918.281207:0:5822:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb06f608380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:5822:1875689374512896:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788796918.281249:0:5822:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788796918.281273:0:5822:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb042fe3540 going to sleep for 11 seconds 00000100:00100000:3.0:1788796918.282071:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374512896 00000100:00100000:3.0:1788796918.282083:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374512896 00000100:00100000:3.0:1788796918.282132:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1788796918.282141:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb04886bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+16:5822:x1875689374512896:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788796918.282366:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb04886bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+16:5822:x1875689374512896:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 226us (1116us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796918.282374:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1788796918.282672:0:5822:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb06f608380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:5822:1875689374512896:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788796918.283336:0:8461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb06f608380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:8461:1875689374513024:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788796918.283393:0:8461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788796918.283438:0:8461:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb042fe3540 going to sleep for 11 seconds 00000100:00100000:2.0:1788796918.283916:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374513024 00000100:00100000:2.0:1788796918.283925:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374513024 00000100:00100000:2.0:1788796918.283975:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1788796918.283985:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb04886a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+16:8461:x1875689374513024:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788796918.284228:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb04886a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+16:8461:x1875689374513024:12345-0@lo:502:llog_process_th.0 Request processed in 244us (834us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796918.284235:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1788796918.284356:0:8461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb06f608380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:8461:1875689374513024:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788796918.284386:0:8461:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788796918.284395:0:8461:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788796918.284397:0:8461:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788796918.284404:0:8461:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1788796918.284441:0:8461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb06f608380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:8461:1875689374513152:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788796918.284481:0:8461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788796918.284511:0:8461:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb045529780 going to sleep for 11 seconds 00000100:00100000:0.0:1788796918.284567:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374513152 00000100:00100000:0.0:1788796918.284572:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374513152 00000100:00100000:0.0:1788796918.284603:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1788796918.284610:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb04886b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+16:8461:x1875689374513152:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788796918.284861:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb04886b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+16:8461:x1875689374513152:12345-0@lo:502:llog_process_th.0 Request processed in 130us (259us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796918.284869:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1788796918.285001:0:8461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb06f608380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:8461:1875689374513152:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788796918.285020:0:8461:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788796918.285024:0:8461:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788796918.285047:0:8461:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788796918.285059:0:8461:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 14 count 14 00000020:01000000:0.0:1788796918.285232:0:5822:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:0.0:1788796918.285249:0:5822:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.138@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1788796918.285259:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.138@tcp lock: ffff8cb080437000/0xca7fc0c411f93548 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xca7fc0c411f9354f expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796918.285271:0:5822:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.138@tcp lock: ffff8cb080437000/0xca7fc0c411f93548 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xca7fc0c411f9354f expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788796918.285281:0:5822:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788796918.285285:0:5822:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8cb042f0b000 from 39 10000000:01000000:0.0:1788796918.285289:0:5822:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788796918.285314:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.138@tcp lock: ffff8cb079b80400/0xca7fc0c411f93556 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796918.285322:0:5822:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.138@tcp lock: ffff8cb079b80400/0xca7fc0c411f93556 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796918.285331:0:5822:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.138@tcp lock: ffff8cb079b80400/0xca7fc0c411f93556 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788796918.285353:0:5822:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb079b91180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:5822:1875689374513280:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788796918.285386:0:5822:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788796918.285428:0:5822:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb05098f240 going to sleep for 11 seconds 00000100:00100000:1.0:1788796918.285476:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374513280 00000100:00100000:1.0:1788796918.285482:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374513280 00000100:00100000:1.0:1788796918.285506:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1788796918.285513:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb048869850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+16:5822:x1875689374513280:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788796918.285522:0:5819:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788796918.285545:0:5819:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cb0821f0000/0xca7fc0c411f9355d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xca7fc0c411f93556 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796918.285569:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cb0821f0000/0xca7fc0c411f9355d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xca7fc0c411f93556 expref: 17 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796918.285578:0:5819:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cb0821f0000/0xca7fc0c411f9355d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xca7fc0c411f93556 expref: 17 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796918.285587:0:5819:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb0821f0000, rc 0) 00000100:00100000:1.0:1788796918.285626:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb048869850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+17:5822:x1875689374513280:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 113us (240us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796918.285632:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1788796918.286057:0:5822:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb079b91180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:5822:1875689374513280:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788796918.286073:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.138@tcp lock: ffff8cb079b80400/0xca7fc0c411f93556 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xca7fc0c411f9355d expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796918.286083:0:5822:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.138@tcp lock: ffff8cb079b80400/0xca7fc0c411f93556 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xca7fc0c411f9355d expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788796918.286140:0:5822:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb079b91180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:5822:1875689374513408:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788796918.286169:0:5822:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788796918.286188:0:5822:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb05098f240 going to sleep for 11 seconds 00000100:00100000:3.0:1788796918.286323:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374513408 00000100:00100000:3.0:1788796918.286328:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374513408 00000100:00100000:3.0:1788796918.286361:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1788796918.286378:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb04886b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+17:5822:x1875689374513408:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788796918.286670:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb04886b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+17:5822:x1875689374513408:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 291us (498us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796918.286678:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1788796918.287326:0:5822:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb079b91180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:5822:1875689374513408:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788796918.287377:0:5822:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb079b91180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:5822:1875689374513536:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788796918.287444:0:5822:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788796918.287487:0:5822:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb05098f240 going to sleep for 11 seconds 00000100:00100000:1.0:1788796918.287613:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374513536 00000100:00100000:1.0:1788796918.287620:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374513536 00000100:00100000:1.0:1788796918.287671:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1788796918.287681:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb048869c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+17:5822:x1875689374513536:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788796918.287986:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb048869c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+17:5822:x1875689374513536:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 306us (541us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796918.287993:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1788796918.288191:0:5822:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb079b91180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:5822:1875689374513536:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788796918.288946:0:8462:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb077978380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:8462:1875689374513664:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788796918.289005:0:8462:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788796918.289072:0:8462:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb046bf0540 going to sleep for 11 seconds 00000100:00100000:1.0:1788796918.289356:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374513664 00000100:00100000:1.0:1788796918.289362:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374513664 00000100:00100000:1.0:1788796918.289456:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1788796918.289473:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb04886b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+17:8462:x1875689374513664:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788796918.289714:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb04886b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+17:8462:x1875689374513664:12345-0@lo:502:llog_process_th.0 Request processed in 242us (707us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796918.289721:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1788796918.289856:0:8462:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb077978380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:8462:1875689374513664:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788796918.289904:0:8462:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb077978380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:8462:1875689374513792:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788796918.289940:0:8462:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788796918.292197:0:8462:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb045267600 going to sleep for 11 seconds 00000100:00100000:3.0:1788796918.292576:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374513792 00000100:00100000:3.0:1788796918.292587:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374513792 00000100:00100000:3.0:1788796918.292639:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1788796918.292650:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb048868050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+17:8462:x1875689374513792:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788796918.294267:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb048868050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+17:8462:x1875689374513792:12345-0@lo:502:llog_process_th.0 Request processed in 1610us (4318us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796918.294279:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1788796918.294442:0:8462:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb077978380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:8462:1875689374513792:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1788796918.294478:0:8462:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:3.0:1788796918.294956:0:5822:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:3.0:1788796918.294976:0:5822:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.138@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788796918.294986:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.138@tcp lock: ffff8cb079b80400/0xca7fc0c411f93556 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xca7fc0c411f9355d expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796918.294998:0:5822:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.138@tcp lock: ffff8cb079b80400/0xca7fc0c411f93556 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xca7fc0c411f9355d expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788796918.295008:0:5822:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1788796918.295011:0:5822:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:3.0:1788796918.295013:0:5822:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1788796918.295077:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.138@tcp lock: ffff8cb080437800/0xca7fc0c411f93564 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796918.295085:0:5822:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.138@tcp lock: ffff8cb080437800/0xca7fc0c411f93564 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796918.295095:0:5822:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.138@tcp lock: ffff8cb080437800/0xca7fc0c411f93564 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788796918.295124:0:5822:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb06ef1d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:5822:1875689374513920:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788796918.295162:0:5822:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796918.295194:0:5822:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb069af3c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788796918.295208:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374513920 00000100:00100000:3.0:1788796918.295213:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374513920 00000100:00100000:3.0:1788796918.295240:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1788796918.295246:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb04886a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+17:5822:x1875689374513920:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788796918.295258:0:5818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788796918.295269:0:5818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cb080437400/0xca7fc0c411f9356b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xca7fc0c411f93564 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796918.295289:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cb080437400/0xca7fc0c411f9356b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xca7fc0c411f93564 expref: 18 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796918.295299:0:5818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cb080437400/0xca7fc0c411f9356b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xca7fc0c411f93564 expref: 18 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796918.295307:0:5818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb080437400, rc 0) 00000100:00100000:3.0:1788796918.295333:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb04886a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+18:5822:x1875689374513920:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 86us (170us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796918.295338:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1788796918.295364:0:5822:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb06ef1d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:5822:1875689374513920:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788796918.295374:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.138@tcp lock: ffff8cb080437800/0xca7fc0c411f93564 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xca7fc0c411f9356b expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796918.295382:0:5822:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.138@tcp lock: ffff8cb080437800/0xca7fc0c411f93564 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xca7fc0c411f9356b expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788796918.295440:0:5822:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb06ef1d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:5822:1875689374514048:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788796918.295461:0:5822:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796918.295472:0:5822:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb069af3c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788796918.295481:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374514048 00000100:00100000:3.0:1788796918.295484:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374514048 00000100:00100000:3.0:1788796918.295497:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1788796918.295502:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb04886a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+18:5822:x1875689374514048:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788796918.296238:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb04886a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+18:5822:x1875689374514048:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 729us (770us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796918.296248:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1788796918.296293:0:5822:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb06ef1d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:5822:1875689374514048:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788796918.296329:0:5822:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb06ef1d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:5822:1875689374514176:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788796918.296363:0:5822:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796918.296376:0:5822:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb069af3c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788796918.296390:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374514176 00000100:00100000:3.0:1788796918.296394:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374514176 00000100:00100000:3.0:1788796918.296426:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1788796918.296433:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb060707850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+18:5822:x1875689374514176:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788796918.296578:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb060707850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+18:5822:x1875689374514176:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 146us (215us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796918.296585:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1788796918.296613:0:5822:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb06ef1d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:5822:1875689374514176:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788796918.299545:0:8463:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb06ef1d180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:8463:1875689374514304:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788796918.299643:0:8463:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796918.299949:0:8463:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb069af3480 going to sleep for 11 seconds 00000100:00100000:0.0:1788796918.300346:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374514304 00000100:00100000:0.0:1788796918.300354:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374514304 00000100:00100000:0.0:1788796918.300401:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1788796918.300424:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb060705c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+18:8463:x1875689374514304:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788796918.300701:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb060705c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+18:8463:x1875689374514304:12345-0@lo:502:llog_process_th.0 Request processed in 280us (1058us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796918.300718:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1788796918.301017:0:8463:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb06ef1d180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:8463:1875689374514304:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788796918.301080:0:8463:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788796918.301089:0:8463:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788796918.301091:0:8463:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788796918.301097:0:8463:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1788796918.301125:0:8463:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb06ef1d180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:8463:1875689374514432:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788796918.301162:0:8463:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796918.301189:0:8463:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb04370f9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788796918.301377:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374514432 00000100:00100000:0.0:1788796918.301383:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374514432 00000100:00100000:0.0:1788796918.301431:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1788796918.301439:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb060707050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+18:8463:x1875689374514432:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788796918.301588:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb060707050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+18:8463:x1875689374514432:12345-0@lo:502:llog_process_th.0 Request processed in 149us (425us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796918.301596:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1788796918.301949:0:8463:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb06ef1d180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:8463:1875689374514432:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788796918.301972:0:8463:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788796918.301978:0:8463:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788796918.301979:0:8463:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1788796918.301984:0:8463:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:0.0:1788796918.302931:0:5822:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-36 (rc=0) 10000000:01000000:0.0:1788796918.302957:0:5822:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.138@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1788796918.302969:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.138@tcp lock: ffff8cb080437800/0xca7fc0c411f93564 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xca7fc0c411f9356b expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796918.302981:0:5822:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.138@tcp lock: ffff8cb080437800/0xca7fc0c411f93564 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xca7fc0c411f9356b expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788796918.302991:0:5822:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1788796918.302994:0:5822:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8cb0494f0000 from 1 10000000:01000000:0.0:1788796918.302996:0:5822:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1788796918.303344:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.138@tcp lock: ffff8cb079b80a00/0xca7fc0c411f93572 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796918.303353:0:5822:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.138@tcp lock: ffff8cb079b80a00/0xca7fc0c411f93572 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796918.303364:0:5822:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.138@tcp lock: ffff8cb079b80a00/0xca7fc0c411f93572 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788796918.303417:0:5822:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb079b91180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:5822:1875689374514560:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788796918.303485:0:5822:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788796918.303547:0:5822:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb045480600 going to sleep for 11 seconds 00000100:00100000:3.0:1788796918.303609:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374514560 00000100:00100000:3.0:1788796918.303617:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374514560 00000100:00100000:3.0:1788796918.303673:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1788796918.303683:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb060704050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+18:5822:x1875689374514560:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788796918.303696:0:5818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788796918.303709:0:5818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cb080436800/0xca7fc0c411f93579 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xca7fc0c411f93572 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796918.303735:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cb080436800/0xca7fc0c411f93579 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xca7fc0c411f93572 expref: 19 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796918.303936:0:5818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cb080436800/0xca7fc0c411f93579 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xca7fc0c411f93572 expref: 19 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796918.303957:0:5818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb080436800, rc 0) 00000100:00100000:3.0:1788796918.304010:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb060704050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+19:5822:x1875689374514560:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 328us (524us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796918.304016:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1788796918.304136:0:5822:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb079b91180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:5822:1875689374514560:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788796918.304151:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.138@tcp lock: ffff8cb079b80a00/0xca7fc0c411f93572 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xca7fc0c411f93579 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796918.304167:0:5822:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.138@tcp lock: ffff8cb079b80a00/0xca7fc0c411f93572 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xca7fc0c411f93579 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788796918.304230:0:5822:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb077978380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:5822:1875689374514688:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788796918.304260:0:5822:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788796918.304287:0:5822:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb045267600 going to sleep for 11 seconds 00000100:00100000:1.0:1788796918.304349:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374514688 00000100:00100000:1.0:1788796918.304354:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374514688 00000100:00100000:1.0:1788796918.304387:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1788796918.304395:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb048869050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+19:5822:x1875689374514688:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788796918.304639:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb048869050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+19:5822:x1875689374514688:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 245us (378us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788796918.304646:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1788796918.304875:0:5822:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb077978380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:5822:1875689374514688:0@lo:501:ll_cfg_requeue.0 10000000:01000000:2.0:1788796918.304901:0:5822:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.138@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1788796918.304907:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.138@tcp lock: ffff8cb079b80a00/0xca7fc0c411f93572 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xca7fc0c411f93579 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796918.304915:0:5822:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.138@tcp lock: ffff8cb079b80a00/0xca7fc0c411f93572 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xca7fc0c411f93579 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796918.578183:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788796919.602753:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788796919.860525:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788796919.860550:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb06f608380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875689374514816:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788796919.860632:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788796919.861052:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374514816 00000100:00100000:1.0:1788796919.861061:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374514816 00000100:00100000:1.0:1788796919.861147:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788796919.861158:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb077978380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1875689374514816:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788796919.861197:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788796919.861258:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb077978380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1875689374514816:12345-0@lo:13:osp-pre-0-0.0 Request processed in 102us (625us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796919.861264:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:2.0:1788796919.861941:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788796919.862885:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cb06f608380 x1875689374514816/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788796935 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788796919.862910:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb06f608380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875689374514816:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788796920.372612:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb079b91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3301:1875689374515328:0@lo:400:kworker.0 00000100:00100000:0.0:1788796920.372682:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788796920.372754:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788796920.372761:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb079b90e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875689374515200:0@lo:400:kworker.0 00000100:00100000:0.0:1788796920.372787:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788796920.372825:0:7636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374515328 00000100:00100000:0.0:1788796920.372833:0:7636:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374515328 00000100:00100000:0.0:1788796920.372886:0:7636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788796920.372895:0:7636:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb079b92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1875689374515328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788796920.372945:0:7636:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb079b92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1875689374515328:12345-0@lo:400:kworker.0 Request processed in 51us (262us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796920.372951:0:7636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788796920.372975:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374515200 00000100:00100000:0.0:1788796920.372979:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374515200 00000100:00100000:0.0:1788796920.373003:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788796920.373009:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb048e2a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3301:x1875689374515200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788796920.373073:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb048e2a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3301:x1875689374515200:12345-0@lo:400:kworker.0 Request processed in 64us (285us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796920.373080:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:0.0:1788796920.373121:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cb079b90e00 x1875689374515200/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788796936 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788796920.373155:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb079b90e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875689374515200:0@lo:400:kworker.0 00000100:00100000:0.0:1788796920.373169:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb079b91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3301:1875689374515328:0@lo:400:kworker.0 00000100:00100000:1.0:1788796920.373525:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb079b90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:3302:1875689374514944:0@lo:400:kworker.0 00000100:00100000:1.0:1788796920.373565:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788796920.373597:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb079b91180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3302:1875689374515456:0@lo:400:kworker.0 00000100:00100000:1.0:1788796920.373617:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788796920.373637:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788796920.373642:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb079b92300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875689374515072:0@lo:400:kworker.0 00000100:00100000:1.0:1788796920.373670:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788796920.373688:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb079b90380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875689374515584:0@lo:400:kworker.0 00000100:00100000:1.0:1788796920.373707:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788796920.373732:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374515456 00000100:00100000:1.0:1788796920.373736:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374515456 00000100:00100000:1.0:1788796920.373764:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374515072 00000100:00100000:1.0:1788796920.373766:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374515072 00000100:00100000:1.0:1788796920.373781:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788796920.373788:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb06f608a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1875689374515456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788796920.373825:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb06f608a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1875689374515456:12345-0@lo:400:kworker.0 Request processed in 38us (206us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796920.373832:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788796920.373848:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788796920.373853:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb06f609180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875689374515072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788796920.373879:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb06f609180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875689374515072:12345-0@lo:400:kworker.0 Request processed in 26us (209us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796920.373884:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788796920.373903:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374515584 00000100:00100000:1.0:1788796920.373907:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374515584 00000100:00100000:1.0:1788796920.373931:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788796920.373937:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb06f60a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1875689374515584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788796920.373967:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb06f60a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1875689374515584:12345-0@lo:400:kworker.0 Request processed in 30us (259us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796920.373973:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788796920.374006:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb079b92300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875689374515072:0@lo:400:kworker.0 00010000:00080000:1.0:1788796920.374017:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cb079b90380 x1875689374515584/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788796936 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788796920.374064:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb079b90380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875689374515584:0@lo:400:kworker.0 00000100:00100000:1.0:1788796920.374077:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb079b91180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3302:1875689374515456:0@lo:400:kworker.0 00000100:00080000:2.0:1788796920.374197:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788796920.374202:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788796920.374207:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788796920.374215:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb07797ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875689374515712:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788796920.374246:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788796920.374277:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374515712 00000100:00100000:2.0:1788796920.374281:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374515712 00000100:00100000:2.0:1788796920.374306:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788796920.374319:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb077979500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1875689374515712:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788796920.374346:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788796920.374397:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb077979500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1875689374515712:12345-0@lo:13:osp-pre-1-0.0 Request processed in 78us (149us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796920.374403:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:2.0:1788796920.374447:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cb07797ad80 x1875689374515712/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788796936 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788796920.374460:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb07797ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875689374515712:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788796920.375817:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374514944 00000100:00100000:0.0:1788796920.375830:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374514944 00000100:00100000:0.0:1788796920.375888:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1788796920.375897:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb060706450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+19:3302:x1875689374514944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788796920.375974:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb060706450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+19:3302:x1875689374514944:12345-0@lo:400:kworker.0 Request processed in 79us (2409us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796920.375979:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb079b90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:3302:1875689374514944:0@lo:400:kworker.0 00000100:00100000:0.0:1788796920.376187:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00010000:00010000:1.0:1788796920.627263:0:5815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788796920.723667:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1788796920.724578:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351418624 00000100:00100000:0.0:1788796920.724595:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351418624 00000100:00100000:0.0:1788796920.724688:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 166 00000100:00100000:0.0:1788796920.724701:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb060704c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4d9d1a9-601d-459e-8721-8bfc2fdde84f+8:5611:x1875689351418624:12345-192.168.204.38@tcp:101: 00010000:00010000:0.0:1788796920.724721:0:5818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788796920.724743:0:5818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cb079b81a00/0xca7fc0c411f93580 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x7c99e04559ee0f2b expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796920.724787:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cb079b81a00/0xca7fc0c411f93580 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee0f2b expref: 9 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796920.724800:0:5818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cb079b81a00/0xca7fc0c411f93580 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee0f2b expref: 9 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796920.724810:0:5818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb079b81a00, rc 0) 00000100:00100000:0.0:1788796920.724908:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb060704c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4d9d1a9-601d-459e-8721-8bfc2fdde84f+9:5611:x1875689351418624:12345-192.168.204.38@tcp:101: Request processed in 201us (1242us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796920.724939:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 166 00000100:00100000:1.0:1788796920.738167:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1788796920.739298:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351418752 00000100:00100000:0.0:1788796920.739313:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351418752 00000100:00100000:0.0:1788796920.739386:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 167 00000100:00100000:0.0:1788796920.739398:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb060706c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4d9d1a9-601d-459e-8721-8bfc2fdde84f+9:5611:x1875689351418752:12345-192.168.204.38@tcp:501: 00000100:00100000:0.0:1788796920.739777:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb060706c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4d9d1a9-601d-459e-8721-8bfc2fdde84f+9:5611:x1875689351418752:12345-192.168.204.38@tcp:501: Request processed in 380us (1622us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796920.739786:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 167 00000100:00100000:3.0:1788796920.751195:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1788796920.751409:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351418880 00000100:00100000:1.0:1788796920.751421:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351418880 00000100:00100000:1.0:1788796920.751488:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 168 00000100:00100000:1.0:1788796920.751502:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb060704450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4d9d1a9-601d-459e-8721-8bfc2fdde84f+9:5611:x1875689351418880:12345-192.168.204.38@tcp:503: 00000100:00100000:1.0:1788796920.752099:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb060704450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4d9d1a9-601d-459e-8721-8bfc2fdde84f+9:5611:x1875689351418880:12345-192.168.204.38@tcp:503: Request processed in 599us (913us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796920.752111:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 168 00000100:00100000:1.0:1788796920.778967:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1788796920.787849:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351419008 00000100:00100000:3.0:1788796920.787869:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351419008 00000100:00100000:3.0:1788796920.787960:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 169 00000100:00100000:3.0:1788796920.787972:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb060705450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4d9d1a9-601d-459e-8721-8bfc2fdde84f+9:6098:x1875689351419008:12345-192.168.204.38@tcp:502: 00000100:00100000:2.0:1788796920.789081:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb060705450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4d9d1a9-601d-459e-8721-8bfc2fdde84f+9:6098:x1875689351419008:12345-192.168.204.38@tcp:502: Request processed in 1102us (10116us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796920.789094:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 169 00000100:00100000:2.0:1788796920.793239:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1788796920.797207:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351419136 00000100:00100000:0.0:1788796920.797224:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351419136 00000100:00100000:0.0:1788796920.797352:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 170 00000100:00100000:0.0:1788796920.797374:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb060706850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4d9d1a9-601d-459e-8721-8bfc2fdde84f+9:6098:x1875689351419136:12345-192.168.204.38@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788796920.797658:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb060706850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4d9d1a9-601d-459e-8721-8bfc2fdde84f+9:6098:x1875689351419136:12345-192.168.204.38@tcp:502:llog_process_th.0 Request processed in 286us (4427us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796920.797667:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 170 00000100:00100000:3.0:1788796920.801729:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1788796920.802264:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351419264 00000100:00100000:2.0:1788796920.802278:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351419264 00000100:00100000:2.0:1788796920.802369:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 171 00000100:00100000:2.0:1788796920.802382:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb060707c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4d9d1a9-601d-459e-8721-8bfc2fdde84f+9:5611:x1875689351419264:12345-192.168.204.38@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788796920.802405:0:5818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788796920.802432:0:5818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cb041484a00/0xca7fc0c411f93587 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x7c99e04559ee0f32 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796920.802471:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cb041484a00/0xca7fc0c411f93587 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee0f32 expref: 10 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796920.802484:0:5818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cb041484a00/0xca7fc0c411f93587 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee0f32 expref: 10 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796920.802515:0:5818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb041484a00, rc 0) 00000100:00100000:2.0:1788796920.802754:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb060707c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4d9d1a9-601d-459e-8721-8bfc2fdde84f+10:5611:x1875689351419264:12345-192.168.204.38@tcp:101:ll_cfg_requeue.0 Request processed in 373us (1036us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796920.802762:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 171 00000100:00100000:0.0:1788796920.806156:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1788796920.806477:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351419392 00000100:00100000:1.0:1788796920.806490:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351419392 00000100:00100000:1.0:1788796920.806556:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 172 00000100:00100000:1.0:1788796920.806567:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb060704850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4d9d1a9-601d-459e-8721-8bfc2fdde84f+10:5611:x1875689351419392:12345-192.168.204.38@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788796920.808395:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb060704850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4d9d1a9-601d-459e-8721-8bfc2fdde84f+10:5611:x1875689351419392:12345-192.168.204.38@tcp:501:ll_cfg_requeue.0 Request processed in 1819us (2252us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788796920.808410:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 172 00010000:00010000:1.0:1788796921.652497:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788796921.994157:0:8502:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffdebdb3890 20000000:00000080:3.0:1788796921.994176:0:8502:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8cb077927000 uarg=0000000000000000 20000000:01000000:3.0:1788796921.994217:0:8502:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1788796921.994224:0:8502:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1788796921.994229:0:8502:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1788796921.995450:0:8503:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:3.0:1788796921.995853:0:8502:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:3.0:1788796922.004327:0:8502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:3.0:1788796922.004403:0:8502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:3.0:1788796922.004461:0:8502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:3.0:1788796922.004479:0:8502:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1788796922.004499:0:8502:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cb080436200/0xca7fc0c411f9358e lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796922.004517:0:8502:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cb082044200/0xca7fc0c411f93357 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xca7fc0c411f93349 expref: 18 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796922.004525:0:8502:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cb040030400/0xca7fc0c411f933a4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xca7fc0c411f9339d expref: 18 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796922.004542:0:8502:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cb040031a00/0xca7fc0c411f93430 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xca7fc0c411f93429 expref: 18 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796922.004552:0:8502:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cb080437c00/0xca7fc0c411f934ed lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee0efa expref: 9 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796922.004559:0:8502:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8cb080436200/0xca7fc0c411f9358e lrc: 7/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796922.004611:0:8502:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cb080437c00/0xca7fc0c411f934ed lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee0efa expref: 9 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796922.004626:0:8502:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8cb080437c00/0xca7fc0c411f934ed lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee0efa expref: 9 pid: 5820 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788796922.004639:0:8502:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb06ef1d180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8502:1875689374515840:192.168.204.38@tcp:104: 00010000:00010000:3.0:1788796922.004895:0:8502:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cb040031a00/0xca7fc0c411f93430 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xca7fc0c411f93429 expref: 18 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796922.004905:0:8502:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cb040031a00/0xca7fc0c411f93430 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xca7fc0c411f93429 expref: 18 pid: 5818 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788796922.004915:0:8502:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb06ef1d880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8502:1875689374515968:0@lo:104: 00000100:00100000:3.0:1788796922.004954:0:8502:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788796922.005007:0:8502:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cb040030400/0xca7fc0c411f933a4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xca7fc0c411f9339d expref: 18 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796922.005015:0:8502:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cb040030400/0xca7fc0c411f933a4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xca7fc0c411f9339d expref: 18 pid: 5818 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788796922.005057:0:8502:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb0774e7800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8502:1875689374516096:0@lo:104: 00000100:00100000:3.0:1788796922.005082:0:8502:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788796922.005107:0:8502:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cb082044200/0xca7fc0c411f93357 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xca7fc0c411f93349 expref: 18 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796922.005116:0:8502:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cb082044200/0xca7fc0c411f93357 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xca7fc0c411f93349 expref: 18 pid: 5820 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788796922.005124:0:8502:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb0774e4000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8502:1875689374516224:0@lo:104: 00000100:00100000:3.0:1788796922.005139:0:8502:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb0484ffcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788796922.005433:0:6697:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1788796922.005454:0:6697:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788796922.005481:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374515968 00000100:00100000:0.0:1788796922.005488:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374515968 00000100:00100000:0.0:1788796922.005525:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374516096 00000100:00100000:0.0:1788796922.005528:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374516096 00000100:00100000:0.0:1788796922.005537:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374516224 00000100:00100000:0.0:1788796922.005539:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374516224 00000100:00100000:0.0:1788796922.005550:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788796922.005558:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb06ef1c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+5:8502:x1875689374515968:12345-0@lo:104: 00010000:00010000:0.0:1788796922.005591:0:6697:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.138@tcp lock: ffff8cb040031e00/0xca7fc0c411f93429 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xca7fc0c411f93430 expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796922.005863:0:6697:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788796922.005870:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb06ef1c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+5:8502:x1875689374515968:12345-0@lo:104: Request processed in 313us (915us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796922.005877:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788796922.005900:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788796922.005907:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb077befc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+4:8502:x1875689374516096:12345-0@lo:104: 00010000:00010000:0.0:1788796922.005914:0:6697:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.138@tcp lock: ffff8cb082045e00/0xca7fc0c411f9339d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xca7fc0c411f933a4 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796922.005954:0:6697:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788796922.005959:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb077befc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+4:8502:x1875689374516096:12345-0@lo:104: Request processed in 54us (877us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796922.005965:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788796922.005997:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788796922.006004:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb048e29c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+3:8502:x1875689374516224:12345-0@lo:104: 00010000:00010000:0.0:1788796922.006011:0:6697:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.138@tcp lock: ffff8cb082045400/0xca7fc0c411f93349 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xca7fc0c411f93357 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796922.006075:0:6697:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1788796922.006080:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb048e29c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+3:8502:x1875689374516224:12345-0@lo:104: Request processed in 77us (626us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796922.006086:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788796922.006307:0:8502:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb06ef1d880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8502:1875689374515968:0@lo:104: 00000100:00100000:3.0:1788796922.006317:0:8502:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb0774e7800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8502:1875689374516096:0@lo:104: 00000100:00100000:3.0:1788796922.006324:0:8502:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb0774e4000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8502:1875689374516224:0@lo:104: 00010000:00010000:1.0:1788796922.006843:0:5815:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788796922.006853:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.138@tcp lock: ffff8cb040031e00/0xca7fc0c411f93429 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xca7fc0c411f93430 expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796922.006862:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb040031e00 already unused, calling callback (ffffffffc1adac20) 10000000:00010000:1.0:1788796922.006881:0:5815:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.138@tcp lock: ffff8cb040031e00/0xca7fc0c411f93429 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xca7fc0c411f93430 expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796922.006892:0:5815:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.138@tcp lock: ffff8cb040031e00/0xca7fc0c411f93429 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xca7fc0c411f93430 expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788796922.006901:0:5815:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.138@tcp lock: ffff8cb040031e00/0xca7fc0c411f93429 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xca7fc0c411f93430 expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788796922.006907:0:5815:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788796922.006965:0:5815:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.138@tcp lock: ffff8cb040031e00/0xca7fc0c411f93429 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca7fc0c411f93430 expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796922.006972:0:5815:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788796922.007091:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.138@tcp lock: ffff8cb040031e00/0xca7fc0c411f93429 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca7fc0c411f93430 expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796922.007099:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.138@tcp lock: ffff8cb040031e00/0xca7fc0c411f93429 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca7fc0c411f93430 expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796922.007116:0:5815:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788796922.007120:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.138@tcp lock: ffff8cb082045e00/0xca7fc0c411f9339d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xca7fc0c411f933a4 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796922.007126:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb082045e00 already unused, calling callback (ffffffffc1adac20) 10000000:00010000:1.0:1788796922.007129:0:5815:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.138@tcp lock: ffff8cb082045e00/0xca7fc0c411f9339d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xca7fc0c411f933a4 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796922.007136:0:5815:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.138@tcp lock: ffff8cb082045e00/0xca7fc0c411f9339d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xca7fc0c411f933a4 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788796922.007154:0:5815:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.138@tcp lock: ffff8cb082045e00/0xca7fc0c411f9339d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xca7fc0c411f933a4 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788796922.007160:0:5815:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788796922.007177:0:5815:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.138@tcp lock: ffff8cb082045e00/0xca7fc0c411f9339d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca7fc0c411f933a4 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796922.007184:0:5815:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788796922.007201:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.138@tcp lock: ffff8cb082045e00/0xca7fc0c411f9339d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca7fc0c411f933a4 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796922.007208:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.138@tcp lock: ffff8cb082045e00/0xca7fc0c411f9339d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca7fc0c411f933a4 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796922.007219:0:5815:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788796922.007223:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.138@tcp lock: ffff8cb082045400/0xca7fc0c411f93349 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xca7fc0c411f93357 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796922.007229:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb082045400 already unused, calling callback (ffffffffc1adac20) 10000000:00010000:1.0:1788796922.007232:0:5815:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.138@tcp lock: ffff8cb082045400/0xca7fc0c411f93349 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xca7fc0c411f93357 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796922.007239:0:5815:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.138@tcp lock: ffff8cb082045400/0xca7fc0c411f93349 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xca7fc0c411f93357 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788796922.007246:0:5815:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.138@tcp lock: ffff8cb082045400/0xca7fc0c411f93349 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xca7fc0c411f93357 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788796922.007252:0:5815:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788796922.007272:0:5815:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.138@tcp lock: ffff8cb082045400/0xca7fc0c411f93349 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca7fc0c411f93357 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796922.007279:0:5815:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788796922.007286:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.138@tcp lock: ffff8cb082045400/0xca7fc0c411f93349 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca7fc0c411f93357 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796922.007292:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.138@tcp lock: ffff8cb082045400/0xca7fc0c411f93349 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca7fc0c411f93357 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796922.007306:0:5815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788796922.007308:0:5815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788796922.007310:0:5815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788796922.007317:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788796922.007346:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb06f609c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:3301:1875689374516352:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788796922.007403:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788796922.007472:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb06f608380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:3302:1875689374516480:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788796922.007511:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788796922.007532:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788796922.007537:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb06f60a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:3302:1875689374516608:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788796922.007556:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788796922.008322:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788796922.009532:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374516352 00000100:00100000:0.0:1788796922.009544:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374516352 00010000:00010000:0.0:1788796922.009608:0:5811:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cb040031a00/0xca7fc0c411f93430 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xca7fc0c411f93429 expref: 19 pid: 5818 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788796922.009640:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374516480 00000100:00100000:0.0:1788796922.009643:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374516480 00010000:00010000:0.0:1788796922.009673:0:5811:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cb040030400/0xca7fc0c411f933a4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xca7fc0c411f9339d expref: 20 pid: 5818 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788796922.009686:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374516608 00000100:00100000:0.0:1788796922.009689:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374516608 00010000:00010000:0.0:1788796922.009700:0:5811:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cb082044200/0xca7fc0c411f93357 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xca7fc0c411f93349 expref: 21 pid: 5820 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788796922.009714:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788796922.009723:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb06f60b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+21:3301:x1875689374516352:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788796922.009737:0:5811:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788796922.009742:0:5811:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cb040031a00/0xca7fc0c411f93430 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xca7fc0c411f93429 expref: 21 pid: 5818 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796922.009752:0:5811:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cb040031a00/0xca7fc0c411f93430 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xca7fc0c411f93429 expref: 21 pid: 5818 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796922.009770:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cb040031a00/0xca7fc0c411f93430 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xca7fc0c411f93429 expref: 21 pid: 5818 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796922.009787:0:5811:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788796922.009859:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb06f60b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+20:3301:x1875689374516352:12345-0@lo:103:ldlm_bl.0 Request processed in 137us (2456us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796922.009867:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788796922.009885:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788796922.009892:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0794f5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+19:3302:x1875689374516480:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788796922.009906:0:5811:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788796922.009911:0:5811:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cb040030400/0xca7fc0c411f933a4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xca7fc0c411f9339d expref: 19 pid: 5818 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796922.009919:0:5811:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cb040030400/0xca7fc0c411f933a4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xca7fc0c411f9339d expref: 19 pid: 5818 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796922.009928:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cb040030400/0xca7fc0c411f933a4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xca7fc0c411f9339d expref: 19 pid: 5818 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796922.009936:0:5811:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788796922.009966:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0794f5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+18:3302:x1875689374516480:12345-0@lo:103:ldlm_bl.0 Request processed in 75us (2454us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796922.009972:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788796922.009999:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788796922.010006:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0794f7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+17:3302:x1875689374516608:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788796922.010016:0:5811:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788796922.010021:0:5811:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cb082044200/0xca7fc0c411f93357 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xca7fc0c411f93349 expref: 17 pid: 5820 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796922.010052:0:5811:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cb082044200/0xca7fc0c411f93357 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xca7fc0c411f93349 expref: 17 pid: 5820 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796922.010063:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cb082044200/0xca7fc0c411f93357 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xca7fc0c411f93349 expref: 17 pid: 5820 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796922.010073:0:5811:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788796922.010097:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0794f7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+16:3302:x1875689374516608:12345-0@lo:103:ldlm_bl.0 Request processed in 92us (2539us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796922.010113:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788796922.010215:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb06f609c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:3301:1875689374516352:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788796922.012652:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb06f60a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:3302:1875689374516608:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788796922.012669:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb06f608380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:3302:1875689374516480:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788796922.015604:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1788796922.016482:0:8502:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb06ef1d180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8502:1875689374515840:192.168.204.38@tcp:104: 00010000:00010000:3.0:1788796922.016528:0:8502:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8cb080436200/0xca7fc0c411f9358e lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788796922.018505:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351419520 00000100:00100000:1.0:1788796922.018523:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351419520 00010000:00010000:1.0:1788796922.018568:0:5811:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cb080437c00/0xca7fc0c411f934ed lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee0efa expref: 10 pid: 5820 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788796922.019160:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 24 00000100:00100000:1.0:1788796922.019175:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb048e29f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b4d9d1a9-601d-459e-8721-8bfc2fdde84f+10:2354:x1875689351419520:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788796922.019198:0:5811:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788796922.019211:0:5811:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cb080437c00/0xca7fc0c411f934ed lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee0efa expref: 10 pid: 5820 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796922.019226:0:5811:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cb080437c00/0xca7fc0c411f934ed lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee0efa expref: 10 pid: 5820 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796922.019249:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cb080437c00/0xca7fc0c411f934ed lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee0efa expref: 10 pid: 5820 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796922.019268:0:5811:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8cb080436200/0xca7fc0c411f9358e lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796922.019277:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cb080436200/0xca7fc0c411f9358e lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796922.019298:0:5811:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cb080436200/0xca7fc0c411f9358e lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796922.019305:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cb080436200/0xca7fc0c411f9358e lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796922.019312:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cb080436200/0xca7fc0c411f9358e lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796922.019320:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cb080436200/0xca7fc0c411f9358e lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796922.019351:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb080436200 already unused, calling callback (ffffffffc14d98b0) 00010000:00010000:1.0:1788796922.019356:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cb080436200/0xca7fc0c411f9358e lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796922.019365:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cb080436200/0xca7fc0c411f9358e lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796922.020285:0:8502:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8cb080436200/0xca7fc0c411f9358e lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796922.020298:0:8502:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cb080436200/0xca7fc0c411f9358e lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796922.025862:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cb080436200/0xca7fc0c411f9358e lrc: 3/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796922.025883:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cb080436200/0xca7fc0c411f9358e lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796922.025907:0:5811:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788796922.026151:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb048e29f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b4d9d1a9-601d-459e-8721-8bfc2fdde84f+9:2354:x1875689351419520:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 6974us (10554us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796922.026162:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 24 00000100:00100000:2.0:1788796922.275135:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1788796922.275181:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1788796922.275209:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1788796922.275239:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351419776 00000100:00100000:2.0:1788796922.275249:0:6683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351419776 00000100:00100000:2.0:1788796922.275300:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351419904 00000100:00100000:2.0:1788796922.275303:0:6683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351419904 00000100:00100000:2.0:1788796922.275319:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 13 00000100:00100000:2.0:1788796922.275339:0:6683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb07797b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e6d050bb-169e-4784-be5b-7071799bf3b0+5:2354:x1875689351419776:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:2.0:1788796922.275417:0:6683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb07797b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e6d050bb-169e-4784-be5b-7071799bf3b0+5:2354:x1875689351419776:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 89us (234us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796922.275424:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 13 00000100:00100000:2.0:1788796922.275442:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 14 00000100:00100000:2.0:1788796922.275448:0:6683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb077978e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e6d050bb-169e-4784-be5b-7071799bf3b0+5:2355:x1875689351419904:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:2.0:1788796922.275475:0:6683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb077978e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e6d050bb-169e-4784-be5b-7071799bf3b0+5:2355:x1875689351419904:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 27us (266us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796922.275481:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 14 00000100:00080000:2.0:1788796922.277146:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788796922.277157:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788796922.279277:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351419648 00000100:00100000:1.0:1788796922.279290:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351419648 00000100:00100000:1.0:1788796922.279374:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 31 00000100:00100000:1.0:1788796922.279386:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb07797ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6d050bb-169e-4784-be5b-7071799bf3b0+6:2355:x1875689351419648:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:1.0:1788796922.279472:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb07797ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6d050bb-169e-4784-be5b-7071799bf3b0+6:2355:x1875689351419648:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 89us (4348us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796922.279479:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 31 00000100:00080000:1.0:1788796922.279521:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788796922.675943:0:5815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788796922.707318:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1788796922.707437:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351420032 00000100:00100000:2.0:1788796922.707470:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351420032 00000100:00100000:2.0:1788796922.707531:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 173 00000100:00100000:2.0:1788796922.707540:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb060706050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4d9d1a9-601d-459e-8721-8bfc2fdde84f+9:5611:x1875689351420032:12345-192.168.204.38@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788796922.707559:0:5818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788796922.707581:0:5818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cb041484800/0xca7fc0c411f93595 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7c99e04559ee0f39 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796922.707613:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cb041484800/0xca7fc0c411f93595 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee0f39 expref: 10 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796922.707626:0:5818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cb041484800/0xca7fc0c411f93595 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee0f39 expref: 10 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796922.707637:0:5818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb041484800, rc 0) 00000100:00100000:2.0:1788796922.707714:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb060706050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4d9d1a9-601d-459e-8721-8bfc2fdde84f+10:5611:x1875689351420032:12345-192.168.204.38@tcp:101:ll_cfg_requeue.0 Request processed in 174us (408us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796922.707722:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 173 00000100:00100000:2.0:1788796922.712155:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1788796922.713109:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351420160 00000100:00100000:1.0:1788796922.713126:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351420160 00000100:00100000:1.0:1788796922.713206:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 174 00000100:00100000:1.0:1788796922.713219:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb060707450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4d9d1a9-601d-459e-8721-8bfc2fdde84f+10:5611:x1875689351420160:12345-192.168.204.38@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788796922.713570:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb060707450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4d9d1a9-601d-459e-8721-8bfc2fdde84f+10:5611:x1875689351420160:12345-192.168.204.38@tcp:501:ll_cfg_requeue.0 Request processed in 352us (1428us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796922.713579:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 174 00000100:00100000:3.0:1788796922.718475:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1788796922.718583:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351420288 00000100:00100000:0.0:1788796922.718593:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351420288 00000100:00100000:0.0:1788796922.718657:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 175 00000100:00100000:0.0:1788796922.718668:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb060705850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4d9d1a9-601d-459e-8721-8bfc2fdde84f+10:5611:x1875689351420288:12345-192.168.204.38@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788796922.719052:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb060705850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4d9d1a9-601d-459e-8721-8bfc2fdde84f+10:5611:x1875689351420288:12345-192.168.204.38@tcp:503:ll_cfg_requeue.0 Request processed in 384us (589us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796922.719061:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 175 00000100:00100000:3.0:1788796922.731987:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1788796922.732833:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351420416 00000100:00100000:0.0:1788796922.732845:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351420416 00000100:00100000:0.0:1788796922.732897:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 176 00000100:00100000:0.0:1788796922.732907:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb060705050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4d9d1a9-601d-459e-8721-8bfc2fdde84f+10:6155:x1875689351420416:12345-192.168.204.38@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788796922.733186:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb060705050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4d9d1a9-601d-459e-8721-8bfc2fdde84f+10:6155:x1875689351420416:12345-192.168.204.38@tcp:502:llog_process_th.0 Request processed in 280us (1209us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796922.733194:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 176 00000100:00100000:2.0:1788796922.743523:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1788796922.744201:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351420544 00000100:00100000:1.0:1788796922.744216:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351420544 00000100:00100000:1.0:1788796922.744284:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 177 00000100:00100000:1.0:1788796922.744295:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb051758c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4d9d1a9-601d-459e-8721-8bfc2fdde84f+10:6155:x1875689351420544:12345-192.168.204.38@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788796922.745449:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb051758c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4d9d1a9-601d-459e-8721-8bfc2fdde84f+10:6155:x1875689351420544:12345-192.168.204.38@tcp:502:llog_process_th.0 Request processed in 1142us (1925us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796922.745463:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 177 10000000:01000000:1.0:1788796923.381567:0:5822:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788796923.381577:0:5822:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8cb042fd2800 from 4 10000000:01000000:1.0:1788796923.381582:0:5822:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788796923.381672:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.138@tcp lock: ffff8cb0821f1200/0xca7fc0c411f9359c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796923.381687:0:5822:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.138@tcp lock: ffff8cb0821f1200/0xca7fc0c411f9359c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796923.381700:0:5822:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.138@tcp lock: ffff8cb0821f1200/0xca7fc0c411f9359c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788796923.381740:0:5822:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb0794f6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:5822:1875689374516736:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788796923.381844:0:5822:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788796923.381942:0:5822:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb043739600 going to sleep for 11 seconds 00000100:00100000:3.0:1788796923.382381:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374516736 00000100:00100000:3.0:1788796923.382392:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374516736 00000100:00100000:3.0:1788796923.382456:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1788796923.382467:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb051758450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+16:5822:x1875689374516736:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788796923.382485:0:5820:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788796923.382500:0:5820:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cb080437600/0xca7fc0c411f935a3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xca7fc0c411f9359c expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796923.382527:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cb080437600/0xca7fc0c411f935a3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xca7fc0c411f9359c expref: 17 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796923.382540:0:5820:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cb080437600/0xca7fc0c411f935a3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xca7fc0c411f9359c expref: 17 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796923.382550:0:5820:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb080437600, rc 0) 00000100:00100000:3.0:1788796923.382602:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb051758450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+17:5822:x1875689374516736:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 138us (759us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796923.382609:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1788796923.382669:0:5822:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb0794f6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:5822:1875689374516736:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788796923.382686:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.138@tcp lock: ffff8cb0821f1200/0xca7fc0c411f9359c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xca7fc0c411f935a3 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796923.382696:0:5822:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.138@tcp lock: ffff8cb0821f1200/0xca7fc0c411f9359c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xca7fc0c411f935a3 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788796923.382759:0:5822:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb0774e4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:5822:1875689374516864:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788796923.382786:0:5822:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796923.382814:0:5822:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb0465d4540 going to sleep for 11 seconds 00000100:00100000:3.0:1788796923.382828:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374516864 00000100:00100000:3.0:1788796923.382832:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374516864 00000100:00100000:3.0:1788796923.382854:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1788796923.382860:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb05175ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+17:5822:x1875689374516864:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788796923.383177:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb05175ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+17:5822:x1875689374516864:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 315us (388us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796923.383185:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1788796923.383216:0:5822:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb0774e4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:5822:1875689374516864:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788796923.383246:0:5822:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb0774e4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:5822:1875689374516992:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788796923.383377:0:5822:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796923.383391:0:5822:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb0465d4540 going to sleep for 11 seconds 00000100:00100000:3.0:1788796923.383407:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374516992 00000100:00100000:3.0:1788796923.383410:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374516992 00000100:00100000:3.0:1788796923.383434:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1788796923.383440:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb051759450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+17:5822:x1875689374516992:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788796923.383588:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb051759450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+17:5822:x1875689374516992:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 147us (211us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796923.383595:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1788796923.383633:0:5822:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb0774e4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:5822:1875689374516992:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788796923.383870:0:8556:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb0774e4000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:8556:1875689374517120:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788796923.383907:0:8556:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796923.383928:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374517120 00000100:00100000:3.0:1788796923.383932:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374517120 00000100:00100000:3.0:1788796923.383955:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:3.0:1788796923.383961:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb051758850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+17:8556:x1875689374517120:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788796923.384116:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb051758850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+17:8556:x1875689374517120:12345-0@lo:502:llog_process_th.0 Request processed in 155us (209us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796923.384124:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:3.0:1788796923.384163:0:8556:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb0465d40c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788796923.384175:0:8556:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb0774e4000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:8556:1875689374517120:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788796923.384197:0:8556:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788796923.384209:0:8556:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788796923.384212:0:8556:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788796923.384220:0:8556:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8cb042fd2800 00000020:00000080:3.0:1788796923.384222:0:8556:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1788796923.387797:0:8556:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb0774e4000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:8556:1875689374517248:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788796923.387910:0:8556:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796923.387973:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374517248 00000100:00100000:3.0:1788796923.387985:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374517248 00000100:00100000:3.0:1788796923.388075:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:3.0:1788796923.388087:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0465dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+17:8556:x1875689374517248:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788796923.388327:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0465dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+17:8556:x1875689374517248:12345-0@lo:502:llog_process_th.0 Request processed in 241us (419us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796923.388335:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:3.0:1788796923.388395:0:8556:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb0465d40c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788796923.388420:0:8556:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb0774e4000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:8556:1875689374517248:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788796923.388455:0:8556:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788796923.388465:0:8556:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788796923.388467:0:8556:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1788796923.388473:0:8556:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1788796923.388977:0:5822:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1788796923.389002:0:5822:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.138@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788796923.389016:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.138@tcp lock: ffff8cb0821f1200/0xca7fc0c411f9359c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xca7fc0c411f935a3 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796923.389058:0:5822:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.138@tcp lock: ffff8cb0821f1200/0xca7fc0c411f9359c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xca7fc0c411f935a3 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788796923.389071:0:5822:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788796923.389074:0:5822:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8cb042fda000 from 4 10000000:01000000:2.0:1788796923.389087:0:5822:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788796923.389115:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.138@tcp lock: ffff8cb041484600/0xca7fc0c411f935aa lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796923.389125:0:5822:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.138@tcp lock: ffff8cb041484600/0xca7fc0c411f935aa lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796923.389136:0:5822:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.138@tcp lock: ffff8cb041484600/0xca7fc0c411f935aa lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788796923.389154:0:5822:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb077979c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:5822:1875689374517376:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788796923.389191:0:5822:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788796923.389243:0:5822:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb045267f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788796923.389271:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374517376 00000100:00100000:2.0:1788796923.389278:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374517376 00000100:00100000:2.0:1788796923.389329:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:2.0:1788796923.389339:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0465dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+17:5822:x1875689374517376:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788796923.389352:0:5819:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788796923.389366:0:5819:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cb041484400/0xca7fc0c411f935b1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xca7fc0c411f935aa expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796923.389396:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cb041484400/0xca7fc0c411f935b1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xca7fc0c411f935aa expref: 18 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796923.389408:0:5819:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cb041484400/0xca7fc0c411f935b1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xca7fc0c411f935aa expref: 18 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796923.389417:0:5819:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb041484400, rc 0) 00000100:00100000:2.0:1788796923.389451:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0465dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+18:5822:x1875689374517376:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 114us (259us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796923.389466:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:2.0:1788796923.389507:0:5822:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb077979c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:5822:1875689374517376:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788796923.389520:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.138@tcp lock: ffff8cb041484600/0xca7fc0c411f935aa lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xca7fc0c411f935b1 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796923.389529:0:5822:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.138@tcp lock: ffff8cb041484600/0xca7fc0c411f935aa lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xca7fc0c411f935b1 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788796923.389573:0:5822:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb077979c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:5822:1875689374517504:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788796923.389595:0:5822:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788796923.389608:0:5822:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb045267f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788796923.389633:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374517504 00000100:00100000:2.0:1788796923.389636:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374517504 00000100:00100000:2.0:1788796923.389657:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:2.0:1788796923.389662:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0465dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+18:5822:x1875689374517504:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788796923.389938:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0465dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+18:5822:x1875689374517504:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 274us (340us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796923.389945:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:2.0:1788796923.389977:0:5822:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb077979c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:5822:1875689374517504:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788796923.390004:0:5822:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb077979c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:5822:1875689374517632:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788796923.390069:0:5822:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788796923.390092:0:5822:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb045267f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788796923.390106:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374517632 00000100:00100000:2.0:1788796923.390110:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374517632 00000100:00100000:2.0:1788796923.390133:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:2.0:1788796923.390145:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0465dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+18:5822:x1875689374517632:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788796923.390289:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0465dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+18:5822:x1875689374517632:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 144us (220us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796923.390297:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:2.0:1788796923.390347:0:5822:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb077979c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:5822:1875689374517632:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788796923.393201:0:8557:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb077979c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:8557:1875689374517760:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788796923.393442:0:8557:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788796923.393501:0:8557:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb045267e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788796923.393558:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374517760 00000100:00100000:0.0:1788796923.393568:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374517760 00000100:00100000:0.0:1788796923.393724:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:0.0:1788796923.393734:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0465de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+18:8557:x1875689374517760:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788796923.393994:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0465de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+18:8557:x1875689374517760:12345-0@lo:502:llog_process_th.0 Request processed in 261us (551us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796923.394004:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:2.0:1788796923.394137:0:8557:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb077979c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:8557:1875689374517760:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788796923.394171:0:8557:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788796923.394183:0:8557:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788796923.394185:0:8557:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1788796923.394192:0:8557:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8cb042fda000 00000020:00000080:2.0:1788796923.394195:0:8557:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788796923.394448:0:8557:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb077979c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:8557:1875689374517888:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788796923.394489:0:8557:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788796923.394522:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374517888 00000100:00100000:2.0:1788796923.394528:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374517888 00000100:00100000:2.0:1788796923.394561:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:2.0:1788796923.394568:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0465df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+18:8557:x1875689374517888:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788796923.394835:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0465df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+18:8557:x1875689374517888:12345-0@lo:502:llog_process_th.0 Request processed in 267us (345us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796923.394843:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:2.0:1788796923.394907:0:8557:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb0498eb780 going to sleep for 11 seconds 00000100:00100000:2.0:1788796923.394922:0:8557:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb077979c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:8557:1875689374517888:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788796923.394953:0:8557:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788796923.394959:0:8557:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788796923.394960:0:8557:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1788796923.394965:0:8557:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1788796923.395071:0:5822:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1788796923.395093:0:5822:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.138@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788796923.395110:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.138@tcp lock: ffff8cb041484600/0xca7fc0c411f935aa lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xca7fc0c411f935b1 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796923.395123:0:5822:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.138@tcp lock: ffff8cb041484600/0xca7fc0c411f935aa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xca7fc0c411f935b1 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788796923.395135:0:5822:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788796923.395138:0:5822:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8cb042f0b000 from 4 10000000:01000000:0.0:1788796923.395141:0:5822:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788796923.395173:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.138@tcp lock: ffff8cb079b81400/0xca7fc0c411f935b8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796923.395181:0:5822:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.138@tcp lock: ffff8cb079b81400/0xca7fc0c411f935b8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796923.395190:0:5822:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.138@tcp lock: ffff8cb079b81400/0xca7fc0c411f935b8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788796923.395204:0:5822:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb048e2bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:5822:1875689374518016:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788796923.395238:0:5822:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788796923.395255:0:5822:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb069af3c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788796923.395367:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374518016 00000100:00100000:0.0:1788796923.395372:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374518016 00000100:00100000:0.0:1788796923.395403:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:0.0:1788796923.395410:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0465dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+18:5822:x1875689374518016:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788796923.395423:0:5819:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788796923.395439:0:5819:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cb079b81800/0xca7fc0c411f935bf lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xca7fc0c411f935b8 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796923.395468:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cb079b81800/0xca7fc0c411f935bf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xca7fc0c411f935b8 expref: 19 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796923.395487:0:5819:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cb079b81800/0xca7fc0c411f935bf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xca7fc0c411f935b8 expref: 19 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796923.395495:0:5819:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb079b81800, rc 0) 00000100:00100000:0.0:1788796923.395528:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0465dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+19:5822:x1875689374518016:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 119us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796923.395535:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:0.0:1788796923.395566:0:5822:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb048e2bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:5822:1875689374518016:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788796923.395580:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.138@tcp lock: ffff8cb079b81400/0xca7fc0c411f935b8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xca7fc0c411f935bf expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796923.395589:0:5822:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.138@tcp lock: ffff8cb079b81400/0xca7fc0c411f935b8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xca7fc0c411f935bf expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788796923.395834:0:5822:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb048e2bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:5822:1875689374518144:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788796923.395858:0:5822:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788796923.395927:0:5822:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb069af3c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788796923.395967:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374518144 00000100:00100000:2.0:1788796923.395972:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374518144 00000100:00100000:2.0:1788796923.395998:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:2.0:1788796923.396006:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0465dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+19:5822:x1875689374518144:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788796923.396375:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0465dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+19:5822:x1875689374518144:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 369us (514us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796923.396384:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:0.0:1788796923.396870:0:5822:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb048e2bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:5822:1875689374518144:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788796923.396913:0:5822:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb048e2bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:5822:1875689374518272:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788796923.396965:0:5822:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788796923.397066:0:5822:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb069af3c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788796923.397128:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374518272 00000100:00100000:2.0:1788796923.397135:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374518272 00000100:00100000:2.0:1788796923.397174:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:2.0:1788796923.397184:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0465df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+19:5822:x1875689374518272:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788796923.397393:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0465df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+19:5822:x1875689374518272:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 211us (429us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796923.397401:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:0.0:1788796923.397551:0:5822:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb048e2bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:5822:1875689374518272:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788796923.397943:0:8560:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb077979c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:8560:1875689374518400:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788796923.397988:0:8560:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788796923.398092:0:8560:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb0698eff00 going to sleep for 11 seconds 00000100:00100000:0.0:1788796923.398413:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374518400 00000100:00100000:0.0:1788796923.398421:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374518400 00000100:00100000:0.0:1788796923.398500:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:0.0:1788796923.398509:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0465ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+19:8560:x1875689374518400:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788796923.398717:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0465ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+19:8560:x1875689374518400:12345-0@lo:502:llog_process_th.0 Request processed in 210us (729us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796923.398726:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:2.0:1788796923.398860:0:8560:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb077979c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:8560:1875689374518400:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788796923.398896:0:8560:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788796923.398905:0:8560:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788796923.398908:0:8560:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1788796923.398914:0:8560:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8cb042f0b000 00000020:00000080:2.0:1788796923.398917:0:8560:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788796923.399000:0:8560:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb077979c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:8560:1875689374518528:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788796923.399062:0:8560:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788796923.399091:0:8560:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb061fca600 going to sleep for 11 seconds 00000100:00100000:0.0:1788796923.399146:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374518528 00000100:00100000:0.0:1788796923.399150:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374518528 00000100:00100000:0.0:1788796923.399212:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:0.0:1788796923.399219:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb06cfc5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+19:8560:x1875689374518528:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788796923.399724:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb06cfc5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+19:8560:x1875689374518528:12345-0@lo:502:llog_process_th.0 Request processed in 504us (661us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796923.399732:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:2.0:1788796923.399794:0:8560:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb077979c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:8560:1875689374518528:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788796923.399826:0:8560:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788796923.399831:0:8560:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788796923.399833:0:8560:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1788796923.399838:0:8560:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1788796923.400016:0:5822:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1788796923.400115:0:5822:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.138@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788796923.400128:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.138@tcp lock: ffff8cb079b81400/0xca7fc0c411f935b8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xca7fc0c411f935bf expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796923.400141:0:5822:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.138@tcp lock: ffff8cb079b81400/0xca7fc0c411f935b8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xca7fc0c411f935bf expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796923.703360:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788796924.722289:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788796924.989486:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb0794f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875689374518656:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788796924.989618:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788796924.993217:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374518656 00000100:00100000:1.0:1788796924.993265:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374518656 00000100:00100000:1.0:1788796924.993390:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788796924.993402:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0774e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1875689374518656:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788796924.993456:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788796924.993557:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0774e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1875689374518656:12345-0@lo:13:osp-pre-0-0.0 Request processed in 157us (3938us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796924.993564:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:0.0:1788796924.993883:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788796924.994255:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cb0794f4000 x1875689374518656/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788796940 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788796924.994295:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb0794f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875689374518656:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788796925.490384:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb0794f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875689374519040:0@lo:400:kworker.0 00000100:00100000:1.0:1788796925.490463:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788796925.490539:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1788796925.490546:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb0794f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875689374518912:0@lo:400:kworker.0 00000100:00100000:1.0:1788796925.490574:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788796925.490593:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb0794f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875689374519424:0@lo:400:kworker.0 00000100:00100000:1.0:1788796925.490629:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788796925.490665:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374519040 00000100:00100000:1.0:1788796925.490674:0:6683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374519040 00000100:00100000:1.0:1788796925.490730:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374519424 00000100:00100000:1.0:1788796925.490734:0:6683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374519424 00000100:00100000:1.0:1788796925.490764:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788796925.490772:0:6683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0794f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1875689374519040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788796925.490823:0:6683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0794f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1875689374519040:12345-0@lo:400:kworker.0 Request processed in 52us (360us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796925.490831:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788796925.490848:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788796925.490854:0:6683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0794f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1875689374519424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788796925.490880:0:6683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0794f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1875689374519424:12345-0@lo:400:kworker.0 Request processed in 27us (251us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796925.490902:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788796925.490921:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374518912 00000100:00100000:1.0:1788796925.490926:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374518912 00000100:00100000:1.0:1788796925.490954:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788796925.490961:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0794f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875689374518912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788796925.490995:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0794f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875689374518912:12345-0@lo:400:kworker.0 Request processed in 35us (420us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796925.491002:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:1.0:1788796925.491025:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788796925.491121:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb0794f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875689374518912:0@lo:400:kworker.0 00010000:00080000:1.0:1788796925.491134:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cb0794f6d80 x1875689374519424/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788796941 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788796925.491145:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb0794f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875689374519424:0@lo:400:kworker.0 00010000:00080000:1.0:1788796925.491155:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cb0794f4700 x1875689374519040/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788796941 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788796925.491163:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb0794f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875689374519040:0@lo:400:kworker.0 00000100:00100000:2.0:1788796925.491505:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb0794f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875689374519552:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788796925.491540:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796925.491730:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb0794f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3300:1875689374519168:0@lo:400:kworker.0 00000100:00100000:3.0:1788796925.491765:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796925.491790:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788796925.491796:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb0794f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:3300:1875689374518784:0@lo:400:kworker.0 00000100:00100000:3.0:1788796925.491826:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796925.491853:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb0794f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3300:1875689374519296:0@lo:400:kworker.0 00000100:00100000:3.0:1788796925.491873:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796925.491922:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374519168 00000100:00100000:3.0:1788796925.491928:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374519168 00000100:00100000:3.0:1788796925.491969:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374519296 00000100:00100000:3.0:1788796925.491972:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374519296 00000100:00100000:3.0:1788796925.491992:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788796925.491999:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0774e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1875689374519168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788796925.492063:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0774e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1875689374519168:12345-0@lo:400:kworker.0 Request processed in 64us (296us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796925.492069:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788796925.492083:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788796925.492089:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0774e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1875689374519296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788796925.492116:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0774e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1875689374519296:12345-0@lo:400:kworker.0 Request processed in 28us (242us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796925.492122:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:3.0:1788796925.492157:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788796925.492180:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb0794f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3300:1875689374519296:0@lo:400:kworker.0 00000100:00100000:3.0:1788796925.492190:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb0794f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3300:1875689374519168:0@lo:400:kworker.0 00000100:00100000:3.0:1788796925.494833:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374519552 00000100:00100000:3.0:1788796925.494847:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374519552 00000100:00100000:3.0:1788796925.494972:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788796925.494986:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb077979c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875689374519552:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788796925.495060:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788796925.500365:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb077979c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875689374519552:12345-0@lo:13:osp-pre-1-0.0 Request processed in 5372us (8814us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796925.500380:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:2.0:1788796925.500496:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cb0794f4700 x1875689374519552/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788796941 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788796925.500520:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb0794f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875689374519552:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788796925.500561:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374518784 00000100:00100000:2.0:1788796925.500570:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374518784 00000100:00100000:0.0:1788796925.504504:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:0.0:1788796925.504531:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0585b2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+19:3300:x1875689374518784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788796925.504628:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0585b2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+19:3300:x1875689374518784:12345-0@lo:400:kworker.0 Request processed in 111us (12800us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796925.504637:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:0.0:1788796925.504714:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb0794f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:3300:1875689374518784:0@lo:400:kworker.0 00010000:00010000:1.0:1788796925.746892:0:5815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788796926.770381:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788796927.381391:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1788796927.381438:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1788796927.381458:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1788796927.381477:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1788796927.381499:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351420928 00000100:00100000:1.0:1788796927.381508:0:6683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351420928 00000100:00100000:1.0:1788796927.381557:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351421056 00000100:00100000:1.0:1788796927.381570:0:6683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351421056 00000100:00100000:1.0:1788796927.381587:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 17 00000100:00100000:1.0:1788796927.381596:0:6683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0794f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e6d050bb-169e-4784-be5b-7071799bf3b0+5:2352:x1875689351420928:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:1.0:1788796927.381665:0:6683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0794f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e6d050bb-169e-4784-be5b-7071799bf3b0+5:2352:x1875689351420928:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 70us (226us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796927.381673:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 17 00000100:00100000:1.0:1788796927.381688:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 18 00000100:00100000:1.0:1788796927.381694:0:6683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0794f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e6d050bb-169e-4784-be5b-7071799bf3b0+5:2352:x1875689351421056:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:1.0:1788796927.381715:0:6683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0794f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e6d050bb-169e-4784-be5b-7071799bf3b0+5:2352:x1875689351421056:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 21us (237us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796927.381721:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 18 00000100:00100000:1.0:1788796927.381736:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351420800 00000100:00100000:1.0:1788796927.381739:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351420800 00000100:00100000:1.0:1788796927.381764:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 35 00000100:00100000:1.0:1788796927.381769:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0794f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6d050bb-169e-4784-be5b-7071799bf3b0+6:2352:x1875689351420800:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:1.0:1788796927.381790:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0794f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6d050bb-169e-4784-be5b-7071799bf3b0+6:2352:x1875689351420800:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 21us (331us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796927.381796:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 35 00000100:00080000:1.0:1788796927.381810:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788796927.381814:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788796927.381816:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788796927.384289:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351420672 00000100:00100000:2.0:1788796927.384312:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351420672 00000100:00100000:2.0:1788796927.384381:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 194 00000100:00100000:2.0:1788796927.384391:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0585b2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4d9d1a9-601d-459e-8721-8bfc2fdde84f+10:2352:x1875689351420672:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:2.0:1788796927.384469:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0585b2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4d9d1a9-601d-459e-8721-8bfc2fdde84f+10:2352:x1875689351420672:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 80us (3091us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796927.384477:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 194 00010000:00010000:2.0:1788796927.794993:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788796928.679288:0:8801:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg438-server.virtnet: executing check_logdir /tmp/testlogs/ 00010000:00010000:1.0:1788796928.819216:0:5815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788796929.843463:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788796930.098561:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb0794f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875689374519680:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788796930.098657:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788796930.101474:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374519680 00000100:00100000:1.0:1788796930.101491:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374519680 00000100:00100000:1.0:1788796930.101669:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788796930.101681:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb048e2bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1875689374519680:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788796930.101733:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788796930.101835:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb048e2bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1875689374519680:12345-0@lo:13:osp-pre-0-0.0 Request processed in 157us (3178us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796930.101843:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:2.0:1788796930.101949:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cb0794f4e00 x1875689374519680/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788796946 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788796930.101983:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb0794f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875689374519680:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788796930.105614:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788796930.610293:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb0774e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875689374519936:0@lo:400:kworker.0 00000100:00100000:3.0:1788796930.610390:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796930.610454:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788796930.610460:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb0774e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3302:1875689374520064:0@lo:400:kworker.0 00000100:00100000:3.0:1788796930.610512:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796930.610555:0:7636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374519936 00000100:00100000:3.0:1788796930.610564:0:7636:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374519936 00000100:00100000:3.0:1788796930.610608:0:7636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374520064 00000100:00100000:3.0:1788796930.610611:0:7636:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374520064 00000100:00100000:3.0:1788796930.610642:0:7636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788796930.610650:0:7636:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb06f609c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875689374519936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788796930.610702:0:7636:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb06f609c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875689374519936:12345-0@lo:400:kworker.0 Request processed in 53us (313us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796930.610709:0:7636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788796930.610726:0:7636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788796930.610740:0:7636:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb04945e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1875689374520064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788796930.610769:0:7636:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb04945e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1875689374520064:12345-0@lo:400:kworker.0 Request processed in 31us (258us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796930.610775:0:7636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:3.0:1788796930.610795:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788796930.610825:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb0774e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3302:1875689374520064:0@lo:400:kworker.0 00000100:00100000:3.0:1788796930.610835:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb0774e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875689374519936:0@lo:400:kworker.0 00000100:00100000:1.0:1788796930.611127:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb0774e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:3301:1875689374519808:0@lo:400:kworker.0 00000100:00100000:1.0:1788796930.611179:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788796930.611208:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb06f60a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875689374520320:0@lo:400:kworker.0 00000100:00100000:1.0:1788796930.611233:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788796930.611253:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788796930.611259:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb06f608380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3301:1875689374520192:0@lo:400:kworker.0 00000100:00100000:1.0:1788796930.611278:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788796930.611300:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374520192 00000100:00100000:1.0:1788796930.611304:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374520192 00000100:00100000:1.0:1788796930.611348:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788796930.611354:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0794f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1875689374520192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788796930.611388:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0794f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1875689374520192:12345-0@lo:400:kworker.0 Request processed in 35us (109us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796930.611394:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788796930.611417:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374520320 00000100:00100000:1.0:1788796930.611421:0:6683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374520320 00000100:00100000:1.0:1788796930.611445:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788796930.611451:0:6683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0794f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3301:x1875689374520320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788796930.611492:0:6683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0794f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3301:x1875689374520320:12345-0@lo:400:kworker.0 Request processed in 40us (257us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796930.611649:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:1.0:1788796930.611673:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788796930.611677:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788796930.611697:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb06f608380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3301:1875689374520192:0@lo:400:kworker.0 00010000:00080000:1.0:1788796930.611710:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cb06f60a680 x1875689374520320/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788796946 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788796930.611720:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb06f60a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875689374520320:0@lo:400:kworker.0 00000100:00100000:3.0:1788796930.612061:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374519808 00000100:00100000:3.0:1788796930.612066:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374519808 00000100:00100000:3.0:1788796930.612097:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:3.0:1788796930.612103:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0585b0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+19:3301:x1875689374519808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788796930.612147:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0585b0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+19:3301:x1875689374519808:12345-0@lo:400:kworker.0 Request processed in 44us (968us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796930.612153:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:1.0:1788796930.612738:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb0774e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:3301:1875689374519808:0@lo:400:kworker.0 00000100:00100000:2.0:1788796930.612848:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788796930.612860:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb0794f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875689374520448:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788796930.612900:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788796930.612966:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374520448 00000100:00100000:1.0:1788796930.612971:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374520448 00000100:00100000:1.0:1788796930.613008:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788796930.613016:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb077978000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875689374520448:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788796930.613068:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788796930.613112:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb077978000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875689374520448:12345-0@lo:13:osp-pre-1-0.0 Request processed in 97us (212us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796930.613119:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:1.0:1788796930.613147:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cb0794f7800 x1875689374520448/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788796946 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788796930.613164:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb0794f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875689374520448:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788796930.870495:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788796931.901954:0:5815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788796932.507320:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1788796932.507369:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1788796932.507408:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351421184 00000100:00100000:0.0:1788796932.507419:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351421184 00000100:00100000:0.0:1788796932.507497:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 196 00000100:00100000:0.0:1788796932.507510:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0585b2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4d9d1a9-601d-459e-8721-8bfc2fdde84f+10:2352:x1875689351421184:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:0.0:1788796932.507588:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0585b2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4d9d1a9-601d-459e-8721-8bfc2fdde84f+10:2352:x1875689351421184:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 81us (283us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796932.507595:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 196 00000100:00100000:0.0:1788796932.507631:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351421312 00000100:00100000:0.0:1788796932.507635:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351421312 00000100:00100000:0.0:1788796932.507674:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 39 00000100:00100000:0.0:1788796932.507680:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb048e29500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6d050bb-169e-4784-be5b-7071799bf3b0+6:2352:x1875689351421312:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:0.0:1788796932.507712:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb048e29500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6d050bb-169e-4784-be5b-7071799bf3b0+6:2352:x1875689351421312:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 30us (340us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796932.507718:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 39 00000100:00080000:0.0:1788796932.507849:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788796932.512873:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1788796932.512916:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1788796932.513169:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351421440 00000100:00100000:1.0:1788796932.513179:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351421440 00000100:00100000:1.0:1788796932.513240:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351421568 00000100:00100000:1.0:1788796932.513243:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351421568 00000100:00100000:1.0:1788796932.513262:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 11 00000100:00100000:1.0:1788796932.513286:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb06ef1d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e6d050bb-169e-4784-be5b-7071799bf3b0+5:2351:x1875689351421440:12345-192.168.204.38@tcp:9:kworker.0 00000020:00000080:1.0:1788796932.513325:0:6684:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xca7fc0c411f934fb 00000100:00080000:1.0:1788796932.513336:0:6684:0:(import.c:65:import_set_state_nolock()) ffff8caf41990800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788796932.513371:0:6684:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:1.0:1788796932.513739:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb06ef1d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e6d050bb-169e-4784-be5b-7071799bf3b0+2:2351:x1875689351421440:12345-192.168.204.38@tcp:9:kworker.0 Request processed in 454us (875us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796932.513746:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 11 00000100:00100000:1.0:1788796932.513763:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 12 00000100:00100000:1.0:1788796932.513770:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb06ef1d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e6d050bb-169e-4784-be5b-7071799bf3b0+5:2351:x1875689351421568:12345-192.168.204.38@tcp:9:kworker.0 00000020:00000080:1.0:1788796932.513785:0:6684:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xca7fc0c411f93502 00000100:00080000:1.0:1788796932.513792:0:6684:0:(import.c:65:import_set_state_nolock()) ffff8caf41992000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788796932.513814:0:6684:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:1.0:1788796932.513996:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb06ef1d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e6d050bb-169e-4784-be5b-7071799bf3b0+2:2351:x1875689351421568:12345-192.168.204.38@tcp:9:kworker.0 Request processed in 224us (1077us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796932.514003:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 12 00010000:00010000:1.0:1788796932.514122:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788796932.514139:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788796932.516470:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788796932.516479:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788796932.924136:0:5815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788796933.872995:0:9045:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg438-server.virtnet: executing yml_node 00010000:00010000:1.0:1788796933.943365:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788796934.965532:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788796935.220325:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788796935.220608:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb0794f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875689374520576:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788796935.220701:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788796935.223558:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374520576 00000100:00100000:1.0:1788796935.223571:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374520576 00000100:00100000:1.0:1788796935.223645:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788796935.223655:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb06ef1ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875689374520576:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788796935.223700:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788796935.223776:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb06ef1ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875689374520576:12345-0@lo:13:osp-pre-0-0.0 Request processed in 123us (3075us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796935.223794:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:1.0:1788796935.223848:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cb0794f7800 x1875689374520576/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788796951 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788796935.223868:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb0794f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875689374520576:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788796935.225178:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788796935.730355:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb0794f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875689374520704:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788796935.730439:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788796935.730668:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374520704 00000100:00100000:1.0:1788796935.730678:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374520704 00000100:00100000:1.0:1788796935.730743:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788796935.730754:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb07797bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1875689374520704:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788796935.730797:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788796935.730845:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb07797bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1875689374520704:12345-0@lo:13:osp-pre-1-0.0 Request processed in 94us (407us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796935.730852:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:0.0:1788796935.730861:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1788796935.730946:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cb0794f7800 x1875689374520704/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788796951 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788796935.730967:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb0794f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875689374520704:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788796935.731262:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb079b90380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3300:1875689374521216:0@lo:400:kworker.0 00000100:00100000:2.0:1788796935.731296:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796935.731302:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb06ef1c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:3301:1875689374520832:0@lo:400:kworker.0 00000100:00100000:3.0:1788796935.731340:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788796935.731354:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb079b91180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3303:1875689374521088:0@lo:400:kworker.0 00000100:00100000:2.0:1788796935.731378:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796935.731395:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374520832 00000100:00100000:2.0:1788796935.731396:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788796935.731399:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374520832 00000100:00100000:2.0:1788796935.731401:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb079b90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875689374520960:0@lo:400:kworker.0 00000100:00100000:2.0:1788796935.731421:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796935.731430:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:3.0:1788796935.731436:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0585b0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+19:3301:x1875689374520832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788796935.731490:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0585b0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+19:3301:x1875689374520832:12345-0@lo:400:kworker.0 Request processed in 54us (149us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796935.731497:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:0.0:1788796935.731505:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374521216 00000100:00100000:0.0:1788796935.731509:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374521216 00000100:00100000:0.0:1788796935.731540:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374521088 00000100:00100000:3.0:1788796935.731541:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374520960 00000100:00100000:3.0:1788796935.731544:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374520960 00000100:00100000:0.0:1788796935.731544:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374521088 00000100:00100000:0.0:1788796935.731558:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788796935.731680:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb07797aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1875689374521216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788796935.731728:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb07797aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1875689374521216:12345-0@lo:400:kworker.0 Request processed in 164us (431us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796935.731780:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb06ef1c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:3301:1875689374520832:0@lo:400:kworker.0 00000100:00100000:2.0:1788796935.731814:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb079b90380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3300:1875689374521216:0@lo:400:kworker.0 00000100:00080000:2.0:1788796935.731834:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788796935.734271:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788796935.734298:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb077979880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875689374521088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788796935.734713:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb077979880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875689374521088:12345-0@lo:400:kworker.0 Request processed in 429us (3331us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796935.734722:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788796935.734755:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788796935.734762:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb07797a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875689374520960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788796935.734869:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb07797a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875689374520960:12345-0@lo:400:kworker.0 Request processed in 107us (3446us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796935.734876:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788796935.734926:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb079b90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875689374520960:0@lo:400:kworker.0 00000100:00100000:3.0:1788796935.734937:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb079b91180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3303:1875689374521088:0@lo:400:kworker.0 00000100:00100000:0.0:1788796935.735966:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00010000:1.0:1788796935.986882:0:5815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788796936.851424:0:6713:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of e6d050bb-169e-4784-be5b-7071799bf3b0 00000020:00000080:2.0:1788796936.851435:0:6713:0:(genops.c:885:class_export_put()) final put ffff8caf41991000/e6d050bb-169e-4784-be5b-7071799bf3b0 00000020:00000080:2.0:1788796936.851463:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8caf41991000/e6d050bb-169e-4784-be5b-7071799bf3b0 for lustre-OST0000 00000020:00000080:2.0:1788796936.851531:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8caf41990800 for lustre-OST0000 00000001:00100000:3.0:1788796936.864342:0:7640:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of e6d050bb-169e-4784-be5b-7071799bf3b0 00000020:00000080:3.0:1788796936.864351:0:7640:0:(genops.c:885:class_export_put()) final put ffff8caf41997000/e6d050bb-169e-4784-be5b-7071799bf3b0 00000020:00000080:0.0:1788796936.864425:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8caf41997000/e6d050bb-169e-4784-be5b-7071799bf3b0 for lustre-OST0001 00000020:00000080:0.0:1788796936.864480:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8caf41992000 for lustre-OST0001 00010000:00010000:1.0:1788796937.010283:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788796937.623413:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1788796937.623473:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1788796937.623618:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351421696 00000100:00100000:3.0:1788796937.623631:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351421696 00000100:00100000:3.0:1788796937.623704:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 198 00000100:00100000:3.0:1788796937.623716:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0585b1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4d9d1a9-601d-459e-8721-8bfc2fdde84f+10:2352:x1875689351421696:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:3.0:1788796937.623796:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0585b1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4d9d1a9-601d-459e-8721-8bfc2fdde84f+10:2352:x1875689351421696:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 82us (395us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796937.623803:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 198 00000100:00100000:2.0:1788796937.623894:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351421824 00000100:00100000:2.0:1788796937.623928:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351421824 00000100:00100000:2.0:1788796937.624002:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 43 00000100:00100000:2.0:1788796937.624011:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0794f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6d050bb-169e-4784-be5b-7071799bf3b0+6:2352:x1875689351421824:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:2.0:1788796937.624097:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0794f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6d050bb-169e-4784-be5b-7071799bf3b0+6:2352:x1875689351421824:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 87us (623us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796937.624105:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 43 00000100:00080000:3.0:1788796937.624174:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788796938.042990:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788796938.720957:0:9241:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.58.39 00010000:00010000:1.0:1788796939.059428:0:5815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788796940.082406:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788796940.339416:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788796940.339465:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb0794f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875689374521344:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788796940.339533:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788796940.339772:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374521344 00000100:00100000:1.0:1788796940.339782:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374521344 00000100:00100000:1.0:1788796940.339849:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788796940.339860:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb04945fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1875689374521344:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788796940.339903:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788796940.339952:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb04945fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1875689374521344:12345-0@lo:13:osp-pre-0-0.0 Request processed in 95us (418us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796940.339991:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:1.0:1788796940.340062:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cb0794f4e00 x1875689374521344/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788796956 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788796940.340079:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb0794f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875689374521344:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788796940.340352:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788796940.850880:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb04945ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:3302:1875689374521472:0@lo:400:kworker.0 00000100:00100000:3.0:1788796940.850991:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796940.851083:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb04945d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875689374521984:0@lo:400:kworker.0 00000100:00100000:3.0:1788796940.851113:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796940.851144:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788796940.851150:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb04945df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875689374521600:0@lo:400:kworker.0 00000100:00100000:3.0:1788796940.851175:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796940.851209:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb04945f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3300:1875689374521728:0@lo:400:kworker.0 00000100:00100000:3.0:1788796940.851232:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796940.851252:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788796940.851258:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb04945f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3300:1875689374521856:0@lo:400:kworker.0 00000100:00100000:0.0:1788796940.851365:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374521472 00000100:00100000:0.0:1788796940.851375:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374521472 00000100:00100000:0.0:1788796940.851428:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:0.0:1788796940.851439:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0585b0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+19:3302:x1875689374521472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788796940.851497:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0585b0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+19:3302:x1875689374521472:12345-0@lo:400:kworker.0 Request processed in 60us (506us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796940.851504:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:3.0:1788796940.851580:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796940.851658:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374521984 00000100:00100000:3.0:1788796940.851663:0:6683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374521984 00000100:00100000:3.0:1788796940.851714:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788796940.851721:0:6683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb04945f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1875689374521984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788796940.851756:0:6683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb04945f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1875689374521984:12345-0@lo:400:kworker.0 Request processed in 36us (643us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796940.851762:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788796940.853492:0:7636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374521600 00000100:00100000:0.0:1788796940.853502:0:7636:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374521600 00000100:00100000:0.0:1788796940.853545:0:7636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374521728 00000100:00100000:0.0:1788796940.853548:0:7636:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374521728 00000100:00100000:0.0:1788796940.853564:0:7636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374521856 00000100:00100000:0.0:1788796940.853567:0:7636:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374521856 00000100:00100000:0.0:1788796940.853584:0:7636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788796940.853592:0:7636:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb04945ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875689374521600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788796940.853671:0:7636:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb04945ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875689374521600:12345-0@lo:400:kworker.0 Request processed in 79us (2494us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796940.853678:0:7636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788796940.853818:0:7636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788796940.853827:0:7636:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb04945c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1875689374521728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788796940.853883:0:7636:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb04945c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1875689374521728:12345-0@lo:400:kworker.0 Request processed in 57us (2649us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796940.853889:0:7636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788796940.853904:0:7636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788796940.853912:0:7636:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb04945d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1875689374521856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788796940.853938:0:7636:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb04945d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1875689374521856:12345-0@lo:400:kworker.0 Request processed in 27us (2358us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796940.853944:0:7636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00080000:3.0:1788796940.854395:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788796940.854400:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788796940.854425:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb077979f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875689374522112:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788796940.854479:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796940.854561:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb04945f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3300:1875689374521856:0@lo:400:kworker.0 00000100:00100000:3.0:1788796940.854574:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb04945f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3300:1875689374521728:0@lo:400:kworker.0 00000100:00100000:3.0:1788796940.854620:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb04945df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875689374521600:0@lo:400:kworker.0 00000100:00100000:3.0:1788796940.854631:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb04945ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:3302:1875689374521472:0@lo:400:kworker.0 00010000:00080000:3.0:1788796940.854644:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cb04945d500 x1875689374521984/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788796956 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788796940.854654:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb04945d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875689374521984:0@lo:400:kworker.0 00000100:00100000:0.0:1788796940.854806:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374522112 00000100:00100000:0.0:1788796940.854811:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374522112 00000100:00100000:0.0:1788796940.854856:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788796940.854865:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb04945ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875689374522112:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788796940.854903:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788796940.854953:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb04945ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875689374522112:12345-0@lo:13:osp-pre-1-0.0 Request processed in 89us (474us total) trans 0 rc 0/0 00010000:00080000:1.0:1788796940.855012:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cb077979f80 x1875689374522112/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788796956 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788796940.855048:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb077979f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875689374522112:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788796940.855190:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00010000:1.0:1788796941.108306:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788796941.624308:0:9338:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.58.39 00010000:00010000:1.0:1788796942.133714:0:5815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788796942.741582:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1788796942.741780:0:7636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351422080 00000100:00100000:0.0:1788796942.741855:0:7636:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351422080 00000100:00100000:0.0:1788796942.741977:0:7636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 47 00000100:00100000:0.0:1788796942.741989:0:7636:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0794f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6d050bb-169e-4784-be5b-7071799bf3b0+6:2355:x1875689351422080:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:0.0:1788796942.742105:0:7636:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0794f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6d050bb-169e-4784-be5b-7071799bf3b0+6:2355:x1875689351422080:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 118us (531us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796942.742113:0:7636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 47 00000100:00080000:3.0:1788796942.746659:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788796942.746757:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1788796942.746874:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351421952 00000100:00100000:3.0:1788796942.746886:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351421952 00000100:00100000:3.0:1788796942.747605:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 200 00000100:00100000:3.0:1788796942.747621:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0585b3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4d9d1a9-601d-459e-8721-8bfc2fdde84f+10:2354:x1875689351421952:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:3.0:1788796942.747720:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0585b3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4d9d1a9-601d-459e-8721-8bfc2fdde84f+10:2354:x1875689351421952:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 103us (970us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796942.747729:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 200 00010000:00010000:1.0:1788796943.154378:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788796944.199173:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788796944.403751:0:9437:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.58.39 00010000:00010000:1.0:1788796945.203559:0:5815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788796945.469457:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788796945.469481:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb07797b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875689374522240:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788796945.469555:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788796945.469691:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374522240 00000100:00100000:2.0:1788796945.469699:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374522240 00000100:00100000:2.0:1788796945.469764:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788796945.469774:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0794f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1875689374522240:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788796945.469811:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788796945.469860:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0794f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1875689374522240:12345-0@lo:13:osp-pre-0-0.0 Request processed in 88us (305us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796945.469867:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:2.0:1788796945.469918:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cb07797b800 x1875689374522240/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788796961 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788796945.469937:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb07797b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875689374522240:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788796945.469997:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788796945.970526:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb0794f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3303:1875689374522624:0@lo:400:kworker.0 00000100:00100000:1.0:1788796945.970601:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788796945.970682:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788796945.970689:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb0794f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875689374522496:0@lo:400:kworker.0 00000100:00100000:1.0:1788796945.970712:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788796945.970774:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374522624 00000100:00100000:3.0:1788796945.970782:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb0794f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:3301:1875689374522368:0@lo:400:kworker.0 00000100:00100000:1.0:1788796945.970784:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374522624 00000100:00100000:3.0:1788796945.970832:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788796945.970879:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374522496 00000100:00100000:1.0:1788796945.970883:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374522496 00000100:00100000:3.0:1788796945.970887:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb0794f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875689374522880:0@lo:400:kworker.0 00000100:00100000:1.0:1788796945.970911:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788796945.970921:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788796945.970925:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb06f60a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875689374522624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788796945.970952:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788796945.970960:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb0794f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3301:1875689374522752:0@lo:400:kworker.0 00000100:00100000:1.0:1788796945.970994:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb06f60a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875689374522624:12345-0@lo:400:kworker.0 Request processed in 72us (390us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796945.971000:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788796945.971005:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788796945.971057:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374522752 00000100:00100000:1.0:1788796945.971071:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374522752 00000100:00100000:3.0:1788796945.971075:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788796945.971086:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb06f608380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875689374522496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788796945.971098:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788796945.971107:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb04945ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1875689374522752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788796945.971125:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb06f608380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875689374522496:12345-0@lo:400:kworker.0 Request processed in 41us (409us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796945.971132:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788796945.971156:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb04945ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1875689374522752:12345-0@lo:400:kworker.0 Request processed in 49us (157us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796945.971163:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374522368 00000100:00100000:1.0:1788796945.971164:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788796945.971170:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374522368 00000100:00100000:3.0:1788796945.971200:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:3.0:1788796945.971207:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0585b2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+19:3301:x1875689374522368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788796945.971251:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0585b2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+19:3301:x1875689374522368:12345-0@lo:400:kworker.0 Request processed in 44us (418us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796945.971257:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:3.0:1788796945.971359:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374522880 00000100:00100000:3.0:1788796945.971363:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374522880 00000100:00080000:1.0:1788796945.972364:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788796945.972374:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788796945.972431:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb0794f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875689374522496:0@lo:400:kworker.0 00000100:00100000:1.0:1788796945.972449:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb0794f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3303:1875689374522624:0@lo:400:kworker.0 00000100:00100000:3.0:1788796945.972855:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788796945.972899:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb04945d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3301:x1875689374522880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788796945.972991:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb04945d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3301:x1875689374522880:12345-0@lo:400:kworker.0 Request processed in 125us (2070us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796945.972999:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788796945.973176:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb07797b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875689374523008:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788796945.973359:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788796945.973391:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb0794f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3301:1875689374522752:0@lo:400:kworker.0 00000100:00100000:2.0:1788796945.973408:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb0794f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:3301:1875689374522368:0@lo:400:kworker.0 00000100:00100000:1.0:1788796945.973415:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374523008 00010000:00080000:2.0:1788796945.973422:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cb0794f6a00 x1875689374522880/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788796961 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788796945.973422:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374523008 00000100:00100000:2.0:1788796945.973436:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb0794f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875689374522880:0@lo:400:kworker.0 00000100:00100000:1.0:1788796945.973465:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788796945.973475:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0794f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875689374523008:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788796945.973510:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788796945.973610:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0794f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875689374523008:12345-0@lo:13:osp-pre-1-0.0 Request processed in 137us (252us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796945.973624:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:2.0:1788796945.978114:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cb07797b800 x1875689374523008/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788796961 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788796945.978149:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb07797b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875689374523008:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788796946.226488:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788796946.242395:0:9485:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Mon Sep 7 12:02:25 EDT 2026 00010000:00010000:1.0:1788796947.250589:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788796947.865631:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1788796947.865691:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1788796947.865783:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351422336 00000100:00100000:3.0:1788796947.865794:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351422336 00000100:00100000:3.0:1788796947.865882:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 51 00000100:00100000:3.0:1788796947.865893:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb079b92300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6d050bb-169e-4784-be5b-7071799bf3b0+6:2355:x1875689351422336:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:3.0:1788796947.865972:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb079b92300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6d050bb-169e-4784-be5b-7071799bf3b0+6:2355:x1875689351422336:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 81us (355us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796947.865979:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 51 00000100:00100000:3.0:1788796947.866013:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351422208 00000100:00100000:3.0:1788796947.866017:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351422208 00000100:00100000:3.0:1788796947.866069:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 202 00000100:00100000:3.0:1788796947.866076:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0585b3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4d9d1a9-601d-459e-8721-8bfc2fdde84f+10:2355:x1875689351422208:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:3.0:1788796947.866103:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0585b3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4d9d1a9-601d-459e-8721-8bfc2fdde84f+10:2355:x1875689351422208:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 28us (412us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796947.866110:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 202 00000100:00080000:0.0:1788796947.866612:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788796948.276293:0:5815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788796949.298428:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788796950.327409:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788796950.578349:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788796950.578376:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb07797b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875689374523136:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788796950.578460:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788796950.579241:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374523136 00000100:00100000:2.0:1788796950.579251:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374523136 00000100:00100000:2.0:1788796950.579326:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788796950.579337:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb04945df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875689374523136:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788796950.579374:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788796950.579444:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb04945df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875689374523136:12345-0@lo:13:osp-pre-0-0.0 Request processed in 109us (983us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796950.579451:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:3.0:1788796950.579543:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cb07797b800 x1875689374523136/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788796966 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788796950.579566:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb07797b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875689374523136:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788796950.579766:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788796951.090485:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb079b91180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875689374523520:0@lo:400:kworker.0 00000100:00100000:3.0:1788796951.090558:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796951.090620:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788796951.090626:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb079b90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3302:1875689374523648:0@lo:400:kworker.0 00000100:00100000:3.0:1788796951.090649:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796951.090678:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374523520 00000100:00100000:3.0:1788796951.090686:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374523520 00000100:00100000:3.0:1788796951.090745:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788796951.090754:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb04945f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1875689374523520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788796951.090821:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb04945f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1875689374523520:12345-0@lo:400:kworker.0 Request processed in 67us (262us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796951.090829:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788796951.091194:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb079b91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:3300:1875689374523264:0@lo:400:kworker.0 00000100:00100000:1.0:1788796951.091231:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788796951.091276:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb079b90380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3300:1875689374523776:0@lo:400:kworker.0 00000100:00100000:1.0:1788796951.091299:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788796951.091320:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788796951.091326:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb079b90e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3300:1875689374523392:0@lo:400:kworker.0 00000100:00100000:1.0:1788796951.091346:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796951.091361:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374523264 00000100:00100000:1.0:1788796951.091364:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb0498ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875689374523904:0@lo:400:kworker.0 00000100:00100000:3.0:1788796951.091365:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374523264 00000100:00100000:3.0:1788796951.091395:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:1.0:1788796951.091397:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796951.091402:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0585b1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+19:3300:x1875689374523264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788796951.091424:0:7636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374523648 00000100:00100000:1.0:1788796951.091428:0:7636:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374523648 00000100:00100000:3.0:1788796951.091439:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0585b1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+19:3300:x1875689374523264:12345-0@lo:400:kworker.0 Request processed in 38us (208us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796951.091446:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:1.0:1788796951.091465:0:7636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374523776 00000100:00100000:1.0:1788796951.091468:0:7636:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374523776 00000100:00100000:1.0:1788796951.091480:0:7636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374523392 00000100:00100000:3.0:1788796951.091481:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374523904 00000100:00100000:1.0:1788796951.091483:0:7636:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374523392 00000100:00100000:3.0:1788796951.091484:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374523904 00000100:00100000:1.0:1788796951.091494:0:7636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788796951.091500:0:7636:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb04945f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1875689374523648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788796951.091504:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788796951.091510:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0794f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3300:x1875689374523904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788796951.091531:0:7636:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb04945f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1875689374523648:12345-0@lo:400:kworker.0 Request processed in 31us (881us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796951.091532:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0794f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3300:x1875689374523904:12345-0@lo:400:kworker.0 Request processed in 23us (147us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796951.091537:0:7636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788796951.091538:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788796951.091550:0:7636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788796951.091555:0:7636:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0794f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1875689374523776:12345-0@lo:400:kworker.0 00010000:00080000:3.0:1788796951.091570:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cb0498ef100 x1875689374523904/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788796967 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788796951.091583:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb0498ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875689374523904:0@lo:400:kworker.0 00000100:00100000:1.0:1788796951.091590:0:7636:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0794f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1875689374523776:12345-0@lo:400:kworker.0 Request processed in 35us (290us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796951.091592:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb079b91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:3300:1875689374523264:0@lo:400:kworker.0 00000100:00100000:1.0:1788796951.091596:0:7636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788796951.091600:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb079b90380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3300:1875689374523776:0@lo:400:kworker.0 00000100:00100000:1.0:1788796951.091607:0:7636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788796951.091611:0:7636:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0794f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1875689374523392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788796951.091642:0:7636:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0794f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1875689374523392:12345-0@lo:400:kworker.0 Request processed in 30us (294us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796951.091647:0:7636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788796951.091655:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb079b90e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3300:1875689374523392:0@lo:400:kworker.0 00000100:00080000:1.0:1788796951.091661:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788796951.091665:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788796951.093809:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb079b90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3302:1875689374523648:0@lo:400:kworker.0 00010000:00080000:0.0:1788796951.093830:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cb079b91180 x1875689374523520/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788796967 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788796951.093840:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb079b91180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875689374523520:0@lo:400:kworker.0 00000100:00100000:1.0:1788796951.094312:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788796951.094328:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb0794f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875689374524032:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788796951.095580:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788796951.095660:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374524032 00000100:00100000:2.0:1788796951.095668:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374524032 00000100:00100000:2.0:1788796951.095715:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788796951.095725:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0796c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875689374524032:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788796951.095763:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788796951.097872:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0796c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875689374524032:12345-0@lo:13:osp-pre-1-0.0 Request processed in 2131us (2277us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796951.097885:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:3.0:1788796951.102543:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cb0794f4000 x1875689374524032/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788796967 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788796951.102573:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb0794f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875689374524032:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788796951.352960:0:5815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788796952.373969:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788796953.000784:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1788796953.003463:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1788796953.004462:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351422592 00000100:00100000:1.0:1788796953.004475:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351422592 00000100:00100000:1.0:1788796953.004544:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 55 00000100:00100000:1.0:1788796953.004555:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0498ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6d050bb-169e-4784-be5b-7071799bf3b0+6:2354:x1875689351422592:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:1.0:1788796953.004646:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0498ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6d050bb-169e-4784-be5b-7071799bf3b0+6:2354:x1875689351422592:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 93us (1194us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796953.004654:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 55 00000100:00080000:0.0:1788796953.004799:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788796953.009784:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351422464 00000100:00100000:2.0:1788796953.009801:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351422464 00000100:00100000:2.0:1788796953.009873:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 204 00000100:00100000:2.0:1788796953.009884:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0585b1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4d9d1a9-601d-459e-8721-8bfc2fdde84f+10:2354:x1875689351422464:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:2.0:1788796953.009977:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0585b1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4d9d1a9-601d-459e-8721-8bfc2fdde84f+10:2354:x1875689351422464:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 94us (9202us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796953.009997:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 204 00010000:00010000:0.0:1788796953.395875:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788796954.418684:0:5815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788796955.442345:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788796955.699281:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb07797b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875689374524160:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788796955.699375:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788796955.699509:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374524160 00000100:00100000:2.0:1788796955.699521:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374524160 00000100:00100000:2.0:1788796955.699604:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788796955.699613:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb04945c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875689374524160:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788796955.699819:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788796955.699878:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb04945c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875689374524160:12345-0@lo:13:osp-pre-0-0.0 Request processed in 266us (501us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796955.699886:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:2.0:1788796955.699938:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cb07797b480 x1875689374524160/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788796971 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788796955.699959:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb07797b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875689374524160:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788796955.700182:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788796956.213345:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb04945e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875689374524288:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788796956.213424:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796956.213502:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374524288 00000100:00100000:3.0:1788796956.213510:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374524288 00000100:00100000:3.0:1788796956.213560:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788796956.213569:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb04945c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1875689374524288:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788796956.213602:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788796956.213863:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb04945c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1875689374524288:12345-0@lo:13:osp-pre-1-0.0 Request processed in 294us (438us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796956.213871:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:3.0:1788796956.213892:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1788796956.213919:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cb04945e300 x1875689374524288/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788796972 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788796956.213938:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb04945e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875689374524288:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788796956.215349:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb04945d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875689374524672:0@lo:400:kworker.0 00000100:00100000:3.0:1788796956.215404:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796956.215435:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788796956.215441:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb04945ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875689374524544:0@lo:400:kworker.0 00000100:00100000:3.0:1788796956.215466:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796956.215496:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374524672 00000100:00100000:3.0:1788796956.215502:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374524672 00000100:00100000:3.0:1788796956.215544:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788796956.215553:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb079b91180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1875689374524672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788796956.215598:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb079b91180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1875689374524672:12345-0@lo:400:kworker.0 Request processed in 46us (192us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796956.215613:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788796956.217413:0:7636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374524544 00000100:00100000:3.0:1788796956.217430:0:7636:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374524544 00000100:00100000:3.0:1788796956.217475:0:7636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788796956.217484:0:7636:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb079b90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875689374524544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788796956.217573:0:7636:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb079b90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875689374524544:12345-0@lo:400:kworker.0 Request processed in 91us (2106us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796956.217578:0:7636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788796956.217614:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb04945e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:3301:1875689374524416:0@lo:400:kworker.0 00000100:00100000:3.0:1788796956.219451:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796956.219507:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb0794f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3301:1875689374524928:0@lo:400:kworker.0 00000100:00100000:3.0:1788796956.219536:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796956.219577:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788796956.219584:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb04945dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3301:1875689374524800:0@lo:400:kworker.0 00000100:00100000:3.0:1788796956.219657:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796956.219712:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374524416 00000100:00100000:3.0:1788796956.219722:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374524416 00000100:00100000:3.0:1788796956.219774:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:3.0:1788796956.219783:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0585b3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+19:3301:x1875689374524416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788796956.220418:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0585b3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+19:3301:x1875689374524416:12345-0@lo:400:kworker.0 Request processed in 635us (973us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796956.220427:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:3.0:1788796956.220467:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374524928 00000100:00100000:3.0:1788796956.220471:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374524928 00000100:00100000:3.0:1788796956.220505:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374524800 00000100:00100000:3.0:1788796956.220508:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374524800 00000100:00100000:3.0:1788796956.220539:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788796956.220545:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb079b90e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1875689374524928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788796956.220579:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb079b90e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1875689374524928:12345-0@lo:400:kworker.0 Request processed in 34us (1043us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796956.220585:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788796956.220597:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788796956.220603:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb079b90380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1875689374524800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788796956.220639:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb079b90380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1875689374524800:12345-0@lo:400:kworker.0 Request processed in 36us (982us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796956.220644:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00080000:3.0:1788796956.220683:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788796956.220720:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb04945ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875689374524544:0@lo:400:kworker.0 00010000:00080000:3.0:1788796956.220736:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cb04945d880 x1875689374524672/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788796972 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788796956.220747:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb04945d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875689374524672:0@lo:400:kworker.0 00000100:00100000:3.0:1788796956.220787:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb04945dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3301:1875689374524800:0@lo:400:kworker.0 00000100:00100000:3.0:1788796956.220795:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb04945e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:3301:1875689374524416:0@lo:400:kworker.0 00000100:00100000:3.0:1788796956.220803:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb0794f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3301:1875689374524928:0@lo:400:kworker.0 00010000:00010000:0.0:1788796956.466365:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788796957.494290:0:5815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788796958.104646:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1788796958.104756:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1788796958.104837:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351422720 00000100:00100000:3.0:1788796958.104850:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351422720 00000100:00100000:3.0:1788796958.104935:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 206 00000100:00100000:3.0:1788796958.104953:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0585b1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4d9d1a9-601d-459e-8721-8bfc2fdde84f+10:2354:x1875689351422720:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:3.0:1788796958.105055:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0585b1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4d9d1a9-601d-459e-8721-8bfc2fdde84f+10:2354:x1875689351422720:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 111us (431us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796958.105070:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 206 00000100:00100000:1.0:1788796958.105516:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351422848 00000100:00100000:1.0:1788796958.105522:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351422848 00000100:00100000:1.0:1788796958.105575:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 59 00000100:00100000:1.0:1788796958.105583:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb04982d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6d050bb-169e-4784-be5b-7071799bf3b0+6:2354:x1875689351422848:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:1.0:1788796958.105646:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb04982d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6d050bb-169e-4784-be5b-7071799bf3b0+6:2354:x1875689351422848:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 64us (890us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796958.105654:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 59 00000100:00080000:3.0:1788796958.106171:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788796958.517593:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788796959.538370:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788796960.562324:0:5815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788796960.821164:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb07797b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875689374525056:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788796960.821262:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788796960.829716:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374525056 00000100:00100000:2.0:1788796960.829730:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374525056 00000100:00100000:2.0:1788796960.829796:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788796960.829805:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0796c6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875689374525056:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788796960.829854:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788796960.829942:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0796c6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875689374525056:12345-0@lo:13:osp-pre-0-0.0 Request processed in 139us (8680us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796960.829949:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:2.0:1788796960.829990:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cb07797b480 x1875689374525056/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788796976 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788796960.830008:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb07797b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875689374525056:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788796960.830439:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788796961.330744:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb079b91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875689374525184:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788796961.331290:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788796961.331987:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374525184 00000100:00100000:2.0:1788796961.332003:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374525184 00000100:00100000:2.0:1788796961.332968:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788796961.332980:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0794f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875689374525184:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788796961.333017:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788796961.333346:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0794f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875689374525184:12345-0@lo:13:osp-pre-1-0.0 Request processed in 368us (2055us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796961.333354:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788796961.333408:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb04945d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875689374525568:0@lo:400:kworker.0 00000100:00100000:2.0:1788796961.333445:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788796961.333473:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788796961.333480:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb04945ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3302:1875689374525696:0@lo:400:kworker.0 00000100:00100000:2.0:1788796961.333504:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788796961.334705:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb04945dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3301:1875689374525440:0@lo:400:kworker.0 00000100:00100000:2.0:1788796961.334744:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788796961.334772:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1788796961.334779:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb04945e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:3301:1875689374525312:0@lo:400:kworker.0 00000100:00100000:2.0:1788796961.334921:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788796961.334951:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb0774e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3301:1875689374525824:0@lo:400:kworker.0 00000100:00100000:2.0:1788796961.334973:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788796961.335010:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374525696 00000100:00100000:2.0:1788796961.335016:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374525696 00000100:00100000:2.0:1788796961.335070:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374525440 00000100:00100000:2.0:1788796961.335073:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374525440 00000100:00100000:2.0:1788796961.335083:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374525824 00000100:00100000:2.0:1788796961.335085:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374525824 00000100:00100000:2.0:1788796961.335099:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788796961.335106:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb07797b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1875689374525696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788796961.335173:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb07797b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1875689374525696:12345-0@lo:400:kworker.0 Request processed in 67us (1667us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796961.335180:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788796961.335207:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788796961.335213:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb077979f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1875689374525440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788796961.335244:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb077979f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1875689374525440:12345-0@lo:400:kworker.0 Request processed in 32us (500us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796961.335250:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788796961.335261:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788796961.335267:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb06ef1c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1875689374525824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788796961.335294:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb06ef1c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1875689374525824:12345-0@lo:400:kworker.0 Request processed in 27us (319us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796961.335299:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788796961.335339:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb04945ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3302:1875689374525696:0@lo:400:kworker.0 00000100:00100000:2.0:1788796961.335364:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb0774e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3301:1875689374525824:0@lo:400:kworker.0 00000100:00100000:2.0:1788796961.335373:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb04945dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3301:1875689374525440:0@lo:400:kworker.0 00000100:00100000:2.0:1788796961.335412:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374525568 00000100:00100000:2.0:1788796961.335415:0:6683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374525568 00000100:00100000:2.0:1788796961.335441:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788796961.335446:0:6683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb07797b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1875689374525568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788796961.335479:0:6683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb07797b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1875689374525568:12345-0@lo:400:kworker.0 Request processed in 33us (2035us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796961.335485:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:2.0:1788796961.335504:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788796961.335514:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788796961.336340:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374525312 00000100:00100000:3.0:1788796961.336349:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374525312 00000100:00100000:3.0:1788796961.336386:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:3.0:1788796961.336394:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0585b3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+19:3301:x1875689374525312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788796961.336447:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0585b3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+19:3301:x1875689374525312:12345-0@lo:400:kworker.0 Request processed in 54us (1526us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796961.336453:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:3.0:1788796961.336499:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb04945e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:3301:1875689374525312:0@lo:400:kworker.0 00010000:00080000:3.0:1788796961.337376:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cb04945d880 x1875689374525568/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788796977 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788796961.337391:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb04945d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875689374525568:0@lo:400:kworker.0 00010000:00080000:2.0:1788796961.337696:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cb079b91500 x1875689374525184/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788796977 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788796961.337716:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb079b91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875689374525184:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788796961.586353:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788796962.610340:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788796963.218994:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1788796963.219076:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1788796963.219101:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351422976 00000100:00100000:0.0:1788796963.219111:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351422976 00000100:00100000:0.0:1788796963.219160:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 208 00000100:00100000:0.0:1788796963.219171:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0585b0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4d9d1a9-601d-459e-8721-8bfc2fdde84f+10:2352:x1875689351422976:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:0.0:1788796963.219266:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0585b0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4d9d1a9-601d-459e-8721-8bfc2fdde84f+10:2352:x1875689351422976:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 96us (279us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796963.219275:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 208 00000100:00100000:2.0:1788796963.219343:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351423104 00000100:00100000:2.0:1788796963.219348:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351423104 00000100:00100000:2.0:1788796963.219400:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 63 00000100:00100000:2.0:1788796963.219407:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0796c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6d050bb-169e-4784-be5b-7071799bf3b0+6:2352:x1875689351423104:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:2.0:1788796963.219438:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0796c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6d050bb-169e-4784-be5b-7071799bf3b0+6:2352:x1875689351423104:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 32us (363us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796963.219445:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 63 00000100:00080000:0.0:1788796963.219491:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788796963.634335:0:5815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788796963.905467:0:10116:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 12:02:42 (1788796962) === 00000100:00100000:2.0:1788796964.541968:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1788796964.542404:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351423232 00000100:00100000:3.0:1788796964.542415:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351423232 00000100:00100000:3.0:1788796964.542494:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 209 00000100:00100000:3.0:1788796964.542515:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb04886ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4d9d1a9-601d-459e-8721-8bfc2fdde84f+10:8156:x1875689351423232:12345-192.168.204.38@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788796964.542535:0:5820:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788796964.542562:0:5820:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cb080436000/0xca7fc0c411f935c6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x7c99e04559ee0f40 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796964.542621:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cb080436000/0xca7fc0c411f935c6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee0f40 expref: 11 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796964.542635:0:5820:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cb080436000/0xca7fc0c411f935c6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee0f40 expref: 11 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796964.542645:0:5820:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb080436000, rc 0) 00000100:00100000:3.0:1788796964.542712:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb04886ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4d9d1a9-601d-459e-8721-8bfc2fdde84f+11:8156:x1875689351423232:12345-192.168.204.38@tcp:101:mount.lustre.0 Request processed in 209us (756us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796964.542719:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 209 00000100:00100000:1.0:1788796964.561996:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1788796964.562135:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351423360 00000100:00100000:3.0:1788796964.562144:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351423360 00000100:00100000:3.0:1788796964.562206:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 210 00000100:00100000:3.0:1788796964.562217:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb048868450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4d9d1a9-601d-459e-8721-8bfc2fdde84f+11:8156:x1875689351423360:12345-192.168.204.38@tcp:501:mount.lustre.0 00000100:00100000:3.0:1788796964.562563:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb048868450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4d9d1a9-601d-459e-8721-8bfc2fdde84f+11:8156:x1875689351423360:12345-192.168.204.38@tcp:501:mount.lustre.0 Request processed in 348us (575us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796964.562571:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 210 00000100:00100000:0.0:1788796964.568715:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1788796964.568920:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351423488 00000100:00100000:1.0:1788796964.568931:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351423488 00000100:00100000:1.0:1788796964.568992:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 211 00000100:00100000:1.0:1788796964.569002:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb048869450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4d9d1a9-601d-459e-8721-8bfc2fdde84f+11:8156:x1875689351423488:12345-192.168.204.38@tcp:503:mount.lustre.0 00000100:00100000:1.0:1788796964.569265:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb048869450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4d9d1a9-601d-459e-8721-8bfc2fdde84f+11:8156:x1875689351423488:12345-192.168.204.38@tcp:503:mount.lustre.0 Request processed in 263us (561us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796964.569273:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 211 00000100:00100000:2.0:1788796964.583426:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1788796964.583548:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351423616 00000100:00100000:0.0:1788796964.583559:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351423616 00000100:00100000:0.0:1788796964.583690:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 212 00000100:00100000:0.0:1788796964.583703:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb048868c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4d9d1a9-601d-459e-8721-8bfc2fdde84f+11:8160:x1875689351423616:12345-192.168.204.38@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788796964.587291:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb048868c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4d9d1a9-601d-459e-8721-8bfc2fdde84f+11:8160:x1875689351423616:12345-192.168.204.38@tcp:502:llog_process_th.0 Request processed in 3580us (3864us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796964.587307:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 212 00000100:00100000:0.0:1788796964.623161:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1788796964.623426:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351423744 00000100:00100000:3.0:1788796964.623452:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351423744 00000100:00100000:3.0:1788796964.623520:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 213 00000100:00100000:3.0:1788796964.623531:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb048868850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4d9d1a9-601d-459e-8721-8bfc2fdde84f+11:8160:x1875689351423744:12345-192.168.204.38@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788796964.623846:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb048868850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4d9d1a9-601d-459e-8721-8bfc2fdde84f+11:8160:x1875689351423744:12345-192.168.204.38@tcp:502:llog_process_th.0 Request processed in 316us (695us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796964.624149:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 213 00000100:00100000:1.0:1788796964.649571:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1788796964.649966:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351423872 00000100:00100000:0.0:1788796964.649976:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351423872 00000100:00100000:0.0:1788796964.650057:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 214 00000100:00100000:0.0:1788796964.650067:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb04886bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4d9d1a9-601d-459e-8721-8bfc2fdde84f+11:8156:x1875689351423872:12345-192.168.204.38@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788796964.650083:0:5820:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788796964.650109:0:5820:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cb079b81000/0xca7fc0c411f935cd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x7c99e04559ee0f6a expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796964.650137:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cb079b81000/0xca7fc0c411f935cd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee0f6a expref: 12 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796964.650148:0:5820:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cb079b81000/0xca7fc0c411f935cd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee0f6a expref: 12 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796964.650177:0:5820:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb079b81000, rc 0) 00000100:00100000:0.0:1788796964.650245:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb04886bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4d9d1a9-601d-459e-8721-8bfc2fdde84f+12:8156:x1875689351423872:12345-192.168.204.38@tcp:101:mount.lustre.0 Request processed in 179us (686us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796964.650253:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 214 00010000:00010000:1.0:1788796964.658600:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788796964.659787:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1788796964.660202:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351424000 00000100:00100000:3.0:1788796964.660228:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351424000 00000100:00100000:3.0:1788796964.660290:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 215 00000100:00100000:3.0:1788796964.660301:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb04886a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4d9d1a9-601d-459e-8721-8bfc2fdde84f+12:8156:x1875689351424000:12345-192.168.204.38@tcp:256:mount.lustre.0 20000000:01000000:3.0:1788796964.660330:0:5819:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1788796964.660349:0:5819:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1788796964.660354:0:5819:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1788796964.660357:0:5819:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1788796964.660359:0:5819:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:3.0:1788796964.664813:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb04886a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4d9d1a9-601d-459e-8721-8bfc2fdde84f+12:8156:x1875689351424000:12345-192.168.204.38@tcp:256:mount.lustre.0 Request processed in 4500us (5020us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796964.664847:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 215 00000100:00100000:1.0:1788796964.669629:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1788796964.669811:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351424128 00000100:00100000:0.0:1788796964.669844:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351424128 00000100:00100000:0.0:1788796964.669912:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 216 00000100:00100000:0.0:1788796964.669924:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb04886b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4d9d1a9-601d-459e-8721-8bfc2fdde84f+12:8156:x1875689351424128:12345-192.168.204.38@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788796964.669943:0:5818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788796964.670419:0:5818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cb079b80e00/0xca7fc0c411f935d4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x7c99e04559ee0f71 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796964.670468:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cb079b80e00/0xca7fc0c411f935d4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee0f71 expref: 13 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796964.670481:0:5818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cb079b80e00/0xca7fc0c411f935d4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee0f71 expref: 13 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796964.670491:0:5818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb079b80e00, rc 0) 00000100:00100000:0.0:1788796964.670570:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb04886b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4d9d1a9-601d-459e-8721-8bfc2fdde84f+13:8156:x1875689351424128:12345-192.168.204.38@tcp:101:mount.lustre.0 Request processed in 648us (951us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796964.670578:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 216 00000100:00100000:2.0:1788796964.679740:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1788796964.679861:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351424256 00000100:00100000:3.0:1788796964.679872:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351424256 00000100:00100000:3.0:1788796964.679930:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 217 00000100:00100000:3.0:1788796964.679940:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb048869850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4d9d1a9-601d-459e-8721-8bfc2fdde84f+13:8156:x1875689351424256:12345-192.168.204.38@tcp:501:mount.lustre.0 00000100:00100000:3.0:1788796964.680337:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb048869850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4d9d1a9-601d-459e-8721-8bfc2fdde84f+13:8156:x1875689351424256:12345-192.168.204.38@tcp:501:mount.lustre.0 Request processed in 396us (604us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796964.680345:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 217 00000100:00100000:2.0:1788796964.685845:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1788796964.685957:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351424384 00000100:00100000:0.0:1788796964.685977:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351424384 00000100:00100000:0.0:1788796964.686072:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 218 00000100:00100000:0.0:1788796964.686084:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb04886b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4d9d1a9-601d-459e-8721-8bfc2fdde84f+13:8156:x1875689351424384:12345-192.168.204.38@tcp:503:mount.lustre.0 00000100:00100000:0.0:1788796964.686388:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb04886b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4d9d1a9-601d-459e-8721-8bfc2fdde84f+13:8156:x1875689351424384:12345-192.168.204.38@tcp:503:mount.lustre.0 Request processed in 305us (572us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796964.686398:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 218 00000100:00100000:1.0:1788796964.690642:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1788796964.691025:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351424512 00000100:00100000:0.0:1788796964.691060:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351424512 00000100:00100000:0.0:1788796964.691123:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 219 00000100:00100000:0.0:1788796964.691133:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb048869c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4d9d1a9-601d-459e-8721-8bfc2fdde84f+13:8165:x1875689351424512:12345-192.168.204.38@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788796964.691385:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb048869c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4d9d1a9-601d-459e-8721-8bfc2fdde84f+13:8165:x1875689351424512:12345-192.168.204.38@tcp:502:llog_process_th.0 Request processed in 252us (750us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796964.691393:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 219 00000100:00100000:2.0:1788796964.694246:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1788796964.694390:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351424640 00000100:00100000:3.0:1788796964.694400:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351424640 00000100:00100000:3.0:1788796964.694462:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 220 00000100:00100000:3.0:1788796964.694472:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb04886b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4d9d1a9-601d-459e-8721-8bfc2fdde84f+13:8165:x1875689351424640:12345-192.168.204.38@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788796964.694734:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb04886b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4d9d1a9-601d-459e-8721-8bfc2fdde84f+13:8165:x1875689351424640:12345-192.168.204.38@tcp:502:llog_process_th.0 Request processed in 262us (497us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796964.694742:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 220 00000100:00100000:3.0:1788796964.702495:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1788796964.702567:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1788796964.702712:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351424768 00000100:00100000:0.0:1788796964.702723:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351424768 00000100:00100000:0.0:1788796964.702768:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351425152 00000100:00100000:0.0:1788796964.702771:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351425152 00000100:00100000:0.0:1788796964.702811:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 64 00000100:00100000:0.0:1788796964.702831:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0774e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6d050bb-169e-4784-be5b-7071799bf3b0+6:2354:x1875689351425152:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:0.0:1788796964.702922:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0774e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6d050bb-169e-4784-be5b-7071799bf3b0+6:2354:x1875689351425152:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 93us (353us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796964.702928:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 64 00000100:00100000:0.0:1788796964.702945:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 10 00000100:00100000:0.0:1788796964.702949:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0774e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2351:x1875689351424768:12345-192.168.204.38@tcp:38:mount.lustre.0 00010000:00080000:0.0:1788796964.702980:0:5826:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from ed124ec0-b908-4000-b768-8e53d5def0fc@192.168.204.38@tcp t0 exp 0000000000000000 cur 253 last 0 00000020:00000080:0.0:1788796964.703014:0:5826:0:(genops.c:1384:class_connect()) connect: client ed124ec0-b908-4000-b768-8e53d5def0fc, cookie 0xca7fc0c411f935db 00000004:00100000:0.0:1788796964.703069:0:5826:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:0.0:1788796964.703609:0:5826:0:(import.c:65:import_set_state_nolock()) ffff8cb046314000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788796964.703652:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0774e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed124ec0-b908-4000-b768-8e53d5def0fc+6:2351:x1875689351424768:12345-192.168.204.38@tcp:38:mount.lustre.0 Request processed in 700us (1166us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796964.703659:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 10 00000100:00100000:1.0:1788796964.706330:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1788796964.706462:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351424896 00000100:00100000:0.0:1788796964.706475:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351424896 00000100:00100000:0.0:1788796964.706576:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 11 00000100:00100000:0.0:1788796964.706588:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0796c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed124ec0-b908-4000-b768-8e53d5def0fc+6:0:x1875689351424896:12345-192.168.204.38@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788796964.706639:0:5826:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1788796964.706800:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0796c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed124ec0-b908-4000-b768-8e53d5def0fc+6:0:x1875689351424896:12345-192.168.204.38@tcp:41:mount.lustre.0 Request processed in 214us (478us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796964.706808:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 11 00000100:00100000:3.0:1788796964.707417:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1788796964.707546:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351425024 00000100:00100000:1.0:1788796964.707554:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351425024 00000100:00100000:1.0:1788796964.707600:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 12 00000100:00100000:1.0:1788796964.707665:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0774e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed124ec0-b908-4000-b768-8e53d5def0fc+6:8156:x1875689351425024:12345-192.168.204.38@tcp:41:mount.lustre.0 00000004:00000024:1.0:1788796964.707684:0:5827:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1788796964.707734:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0774e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed124ec0-b908-4000-b768-8e53d5def0fc+6:8156:x1875689351425024:12345-192.168.204.38@tcp:41:mount.lustre.0 Request processed in 71us (319us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796964.707741:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 12 00000100:00080000:2.0:1788796964.708130:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788796964.726876:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1788796964.727205:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351425280 00000100:00100000:0.0:1788796964.727217:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351425280 00000100:00100000:0.0:1788796964.727283:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 13 00000100:00100000:0.0:1788796964.727293:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb049408700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed124ec0-b908-4000-b768-8e53d5def0fc+6:8156:x1875689351425280:12345-192.168.204.38@tcp:40:mount.lustre.0 00000100:00100000:0.0:1788796964.727429:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb049408700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed124ec0-b908-4000-b768-8e53d5def0fc+6:8156:x1875689351425280:12345-192.168.204.38@tcp:40:mount.lustre.0 Request processed in 137us (565us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796964.727436:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 13 00000100:00100000:0.0:1788796964.744721:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1788796964.744761:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1788796964.744976:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1788796964.745157:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351425664 00000100:00100000:1.0:1788796964.745170:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351425664 00000100:00100000:1.0:1788796964.745243:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1 00000100:00100000:1.0:1788796964.745255:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb04982c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ed124ec0-b908-4000-b768-8e53d5def0fc+6:8156:x1875689351425664:12345-192.168.204.38@tcp:33:mount.lustre.0 00000004:00200000:1.0:1788796964.745449:0:5828:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:1.0:1788796964.745563:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb04982c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ed124ec0-b908-4000-b768-8e53d5def0fc+6:8156:x1875689351425664:12345-192.168.204.38@tcp:33:mount.lustre.0 Request processed in 309us (599us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796964.745570:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1 00000100:00100000:2.0:1788796964.746612:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351425408 00000100:00100000:2.0:1788796964.746623:0:6683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351425408 00000100:00100000:2.0:1788796964.746700:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351425536 00000100:00100000:2.0:1788796964.746704:0:6683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351425536 00000100:00100000:2.0:1788796964.746720:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 13 00000100:00100000:2.0:1788796964.746729:0:6683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb04982f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2351:x1875689351425408:12345-192.168.204.38@tcp:8:mount.lustre.0 00010000:00080000:2.0:1788796964.746763:0:6683:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from ed124ec0-b908-4000-b768-8e53d5def0fc@192.168.204.38@tcp t0 exp 0000000000000000 cur 253 last 0 00000020:00000080:2.0:1788796964.746793:0:6683:0:(genops.c:1384:class_connect()) connect: client ed124ec0-b908-4000-b768-8e53d5def0fc, cookie 0xca7fc0c411f935e2 00002000:00100000:2.0:1788796964.746805:0:6683:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli ed124ec0-b908-4000-b768-8e53d5def0fc/ffff8cb077c0a800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788796964.746853:0:6683:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788796964.747789:0:6683:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788796964.748235:0:6683:0:(import.c:65:import_set_state_nolock()) ffff8cb077c0f000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788796964.748344:0:6683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb04982f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ed124ec0-b908-4000-b768-8e53d5def0fc+6:2351:x1875689351425408:12345-192.168.204.38@tcp:8:mount.lustre.0 Request processed in 1613us (3633us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796964.748355:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 13 00000100:00100000:2.0:1788796964.748395:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 14 00000100:00100000:2.0:1788796964.748402:0:6683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb04982ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2351:x1875689351425536:12345-192.168.204.38@tcp:8:mount.lustre.0 00010000:00080000:2.0:1788796964.748431:0:6683:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from ed124ec0-b908-4000-b768-8e53d5def0fc@192.168.204.38@tcp t0 exp 0000000000000000 cur 253 last 0 00000020:00000080:2.0:1788796964.748471:0:6683:0:(genops.c:1384:class_connect()) connect: client ed124ec0-b908-4000-b768-8e53d5def0fc, cookie 0xca7fc0c411f935e9 00002000:00100000:2.0:1788796964.748482:0:6683:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli ed124ec0-b908-4000-b768-8e53d5def0fc/ffff8cb077c08000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788796964.748514:0:6683:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788796964.748748:0:6683:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788796964.748767:0:6683:0:(import.c:65:import_set_state_nolock()) ffff8cb077c0c800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788796964.748793:0:6683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb04982ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ed124ec0-b908-4000-b768-8e53d5def0fc+6:2351:x1875689351425536:12345-192.168.204.38@tcp:8:mount.lustre.0 Request processed in 391us (4032us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796964.748800:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 14 00010000:00010000:0.0:1788796965.682497:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788796965.938591:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788796965.938617:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb079b91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875689374525952:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788796965.938700:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788796965.938776:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374525952 00000100:00100000:2.0:1788796965.938785:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374525952 00000100:00100000:2.0:1788796965.938849:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788796965.938859:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb04945d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1875689374525952:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788796965.938884:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788796965.939301:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb04945d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1875689374525952:12345-0@lo:13:osp-pre-0-0.0 Request processed in 439us (596us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796965.939315:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:2.0:1788796965.939345:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788796965.939376:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cb079b91500 x1875689374525952/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788796981 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788796965.939394:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb079b91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875689374525952:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788796966.451012:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb04945ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875689374526336:0@lo:400:kworker.0 00000100:00100000:1.0:1788796966.451529:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb04945dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875689374526208:0@lo:400:kworker.0 00000100:00100000:1.0:1788796966.451599:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788796966.451650:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb079175880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875689374526720:0@lo:400:kworker.0 00000100:00100000:1.0:1788796966.451676:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788796966.451707:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1788796966.451714:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb04945e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:3303:1875689374526080:0@lo:400:kworker.0 00000100:00100000:1.0:1788796966.451741:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788796966.451764:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb079176d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3303:1875689374526592:0@lo:400:kworker.0 00000100:00100000:1.0:1788796966.451853:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788796966.451888:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374526208 00000100:00100000:1.0:1788796966.451898:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374526208 00000100:00100000:1.0:1788796966.451943:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374526592 00000100:00100000:1.0:1788796966.451955:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374526592 00000100:00100000:1.0:1788796966.451988:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788796966.451996:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0796c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875689374526208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788796966.452073:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0796c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875689374526208:12345-0@lo:400:kworker.0 Request processed in 77us (472us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796966.452080:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788796966.452098:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788796966.452105:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0796c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1875689374526592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788796966.452131:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0796c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1875689374526592:12345-0@lo:400:kworker.0 Request processed in 27us (278us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796966.452136:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788796966.452155:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374526080 00000100:00100000:1.0:1788796966.452159:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374526080 00000100:00100000:1.0:1788796966.452181:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:1.0:1788796966.452187:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb048868050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+19:3303:x1875689374526080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788796966.452213:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb048868050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+19:3303:x1875689374526080:12345-0@lo:400:kworker.0 Request processed in 27us (472us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796966.452219:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:1.0:1788796966.452265:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb04945e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:3303:1875689374526080:0@lo:400:kworker.0 00000100:00100000:1.0:1788796966.452278:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb079176d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3303:1875689374526592:0@lo:400:kworker.0 00000100:00100000:1.0:1788796966.452285:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb04945dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875689374526208:0@lo:400:kworker.0 00000100:00100000:3.0:1788796966.452462:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374526720 00000100:00100000:3.0:1788796966.452466:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374526720 00000100:00100000:3.0:1788796966.452561:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788796966.452569:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0796c7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1875689374526720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788796966.452612:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0796c7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1875689374526720:12345-0@lo:400:kworker.0 Request processed in 44us (934us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796966.452617:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:3.0:1788796966.452652:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cb079175880 x1875689374526720/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788796982 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788796966.452663:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb079175880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875689374526720:0@lo:400:kworker.0 00000100:00100000:2.0:1788796966.452897:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788796966.452937:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb04940a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875689374526848:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788796966.452961:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788796966.452987:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788796966.452993:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb079b91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3300:1875689374526464:0@lo:400:kworker.0 00000100:00100000:2.0:1788796966.453014:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788796966.453064:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788796966.453068:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788796966.453076:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374526464 00000100:00100000:2.0:1788796966.453079:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374526464 00000100:00100000:2.0:1788796966.453113:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788796966.453119:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb079177b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1875689374526464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788796966.453153:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb079177b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1875689374526464:12345-0@lo:400:kworker.0 Request processed in 34us (138us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796966.453159:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00080000:2.0:1788796966.453174:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788796966.453193:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb079b91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3300:1875689374526464:0@lo:400:kworker.0 00000100:00100000:3.0:1788796966.453270:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374526336 00000100:00100000:3.0:1788796966.453275:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374526336 00000100:00100000:3.0:1788796966.453304:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788796966.453311:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb079175c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3300:x1875689374526336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788796966.453351:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb079175c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3300:x1875689374526336:12345-0@lo:400:kworker.0 Request processed in 41us (455us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796966.453357:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:3.0:1788796966.453381:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cb04945ed80 x1875689374526336/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788796982 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788796966.453391:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb04945ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875689374526336:0@lo:400:kworker.0 00000100:00100000:1.0:1788796966.453491:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374526848 00000100:00100000:1.0:1788796966.453495:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374526848 00000100:00100000:1.0:1788796966.453528:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788796966.453536:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb079176680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1875689374526848:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788796966.453577:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788796966.453622:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb079176680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1875689374526848:12345-0@lo:13:osp-pre-1-0.0 Request processed in 88us (659us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796966.453629:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:3.0:1788796966.453692:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cb04940a300 x1875689374526848/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788796982 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788796966.453708:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb04940a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875689374526848:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788796966.718649:0:5815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788796967.584474:0:5848:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of ed124ec0-b908-4000-b768-8e53d5def0fc 00000001:00100000:0.0:1788796967.633419:0:7640:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of ed124ec0-b908-4000-b768-8e53d5def0fc 00000001:00100000:0.0:1788796967.652768:0:6713:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of ed124ec0-b908-4000-b768-8e53d5def0fc 00010000:00010000:1.0:1788796967.732852:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788796968.757262:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788796969.778370:0:5815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788796969.888145:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1788796969.888213:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1788796969.888249:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1788796969.888282:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1788796969.888307:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1788796969.888458:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351426304 00000100:00100000:2.0:1788796969.888469:0:6683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351426304 00000100:00100000:2.0:1788796969.888540:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351426176 00000100:00100000:2.0:1788796969.888543:0:6683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351426176 00000100:00100000:2.0:1788796969.888563:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 28 00000100:00100000:2.0:1788796969.888573:0:6683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb04982ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ed124ec0-b908-4000-b768-8e53d5def0fc+5:2353:x1875689351426304:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:2.0:1788796969.888829:0:6683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb04982ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ed124ec0-b908-4000-b768-8e53d5def0fc+5:2353:x1875689351426304:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 256us (577us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796969.888838:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 28 00000100:00100000:2.0:1788796969.888858:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 29 00000100:00100000:2.0:1788796969.888865:0:6683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb04982e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ed124ec0-b908-4000-b768-8e53d5def0fc+5:2353:x1875689351426176:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:2.0:1788796969.888891:0:6683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb04982e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ed124ec0-b908-4000-b768-8e53d5def0fc+5:2353:x1875689351426176:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 27us (583us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796969.888897:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 29 00000100:00100000:3.0:1788796969.888982:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351425792 00000100:00100000:3.0:1788796969.888987:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351425792 00000100:00100000:3.0:1788796969.889025:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 222 00000100:00100000:3.0:1788796969.889051:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb04886a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4d9d1a9-601d-459e-8721-8bfc2fdde84f+13:2353:x1875689351425792:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:1.0:1788796969.889064:0:7636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351426048 00000100:00100000:1.0:1788796969.889069:0:7636:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351426048 00000100:00100000:3.0:1788796969.889080:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb04886a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4d9d1a9-601d-459e-8721-8bfc2fdde84f+13:2353:x1875689351425792:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 31us (949us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796969.889086:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 222 00000100:00100000:1.0:1788796969.889096:0:7636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351425920 00000100:00100000:1.0:1788796969.889098:0:7636:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351425920 00000100:00100000:1.0:1788796969.889114:0:7636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 68 00000100:00080000:0.0:1788796969.889157:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788796969.889162:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788796969.889164:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788796969.892662:0:7636:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb04982d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed124ec0-b908-4000-b768-8e53d5def0fc+5:2353:x1875689351426048:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:1.0:1788796969.892980:0:7636:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb04982d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed124ec0-b908-4000-b768-8e53d5def0fc+5:2353:x1875689351426048:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 3855us (4762us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796969.893111:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 69 00000100:00100000:3.0:1788796969.893128:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb04982c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6d050bb-169e-4784-be5b-7071799bf3b0+6:2353:x1875689351425920:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:3.0:1788796969.893161:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb04982c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6d050bb-169e-4784-be5b-7071799bf3b0+6:2353:x1875689351425920:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 41us (4879us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796969.893168:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 69 00000100:00100000:1.0:1788796969.902471:0:7636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 68 00010000:00010000:2.0:1788796970.802518:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788796971.058727:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb079174e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875689374526976:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788796971.058800:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788796971.059070:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374526976 00000100:00100000:2.0:1788796971.059078:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374526976 00000100:00100000:2.0:1788796971.059141:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788796971.059151:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb04940a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1875689374526976:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788796971.059186:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788796971.059230:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb04940a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1875689374526976:12345-0@lo:13:osp-pre-0-0.0 Request processed in 82us (431us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796971.059237:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:3.0:1788796971.059394:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788796971.059423:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cb079174e00 x1875689374526976/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788796987 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788796971.059441:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb079174e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875689374526976:0@lo:13:osp-pre-0-0.0 00000001:02000400:3.0:1788796971.406369:0:10310:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg438-client.virtnet: executing check_config_client /mnt/lustre 00000100:00100000:2.0:1788796971.570414:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb04982ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875689374527232:0@lo:400:kworker.0 00000100:00100000:2.0:1788796971.570500:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788796971.570593:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1788796971.570618:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb04982c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:3303:1875689374527104:0@lo:400:kworker.0 00000100:00100000:2.0:1788796971.570651:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788796971.570677:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb04982e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875689374527616:0@lo:400:kworker.0 00000100:00100000:2.0:1788796971.570701:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788796971.570733:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374527104 00000100:00100000:2.0:1788796971.570741:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374527104 00000100:00100000:2.0:1788796971.570791:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:2.0:1788796971.570802:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb04886a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+19:3303:x1875689374527104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788796971.570854:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb04886a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+19:3303:x1875689374527104:12345-0@lo:400:kworker.0 Request processed in 53us (201us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796971.570863:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:2.0:1788796971.570898:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374527616 00000100:00100000:2.0:1788796971.570903:0:6683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374527616 00000100:00100000:2.0:1788796971.570943:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788796971.570950:0:6683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb079177100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1875689374527616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788796971.570980:0:6683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb079177100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1875689374527616:12345-0@lo:400:kworker.0 Request processed in 31us (278us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796971.570985:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:2.0:1788796971.571003:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788796971.571052:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb04982c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:3303:1875689374527104:0@lo:400:kworker.0 00010000:00080000:2.0:1788796971.571065:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cb04982e680 x1875689374527616/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788796987 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788796971.571077:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb04982e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875689374527616:0@lo:400:kworker.0 00000100:00100000:0.0:1788796971.571234:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374527232 00000100:00100000:0.0:1788796971.571239:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374527232 00000100:00100000:0.0:1788796971.571277:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788796971.571285:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb079175f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875689374527232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788796971.571325:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb079175f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875689374527232:12345-0@lo:400:kworker.0 Request processed in 41us (826us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796971.571331:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788796971.571562:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb04982d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3300:1875689374527360:0@lo:400:kworker.0 00000100:00100000:3.0:1788796971.571594:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796971.571613:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788796971.571620:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb04982dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3300:1875689374527488:0@lo:400:kworker.0 00000100:00100000:3.0:1788796971.571641:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796971.571682:0:7636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374527360 00000100:00100000:3.0:1788796971.571686:0:7636:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374527360 00000100:00100000:3.0:1788796971.571714:0:7636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374527488 00000100:00100000:3.0:1788796971.571717:0:7636:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374527488 00000100:00100000:3.0:1788796971.571734:0:7636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788796971.571740:0:7636:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb049408380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1875689374527360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788796971.571775:0:7636:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb049408380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1875689374527360:12345-0@lo:400:kworker.0 Request processed in 35us (180us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796971.571781:0:7636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788796971.571794:0:7636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788796971.571800:0:7636:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb04940ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1875689374527488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788796971.571827:0:7636:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb04940ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1875689374527488:12345-0@lo:400:kworker.0 Request processed in 27us (185us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796971.571832:0:7636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788796971.571857:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb04982dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3300:1875689374527488:0@lo:400:kworker.0 00000100:00100000:3.0:1788796971.571867:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb04982d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3300:1875689374527360:0@lo:400:kworker.0 00000100:00080000:2.0:1788796971.572151:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788796971.572165:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb04982fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875689374527744:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788796971.572204:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788796971.572243:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb04982ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875689374527232:0@lo:400:kworker.0 00000100:00100000:0.0:1788796971.572309:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374527744 00000100:00100000:0.0:1788796971.572314:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374527744 00000100:00100000:0.0:1788796971.572349:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788796971.572358:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb079177800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875689374527744:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788796971.572398:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788796971.572434:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb079177800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875689374527744:12345-0@lo:13:osp-pre-1-0.0 Request processed in 78us (230us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796971.572440:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:2.0:1788796971.576011:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cb04982fb80 x1875689374527744/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788796987 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788796971.576067:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb04982fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875689374527744:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788796971.826457:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788796972.855315:0:5815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788796973.874251:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788796974.898352:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788796974.996509:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1788796974.996556:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1788796974.996585:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1788796974.996678:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351426432 00000100:00100000:2.0:1788796974.996689:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351426432 00000100:00100000:2.0:1788796974.996752:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 224 00000100:00100000:2.0:1788796974.996764:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb060707850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4d9d1a9-601d-459e-8721-8bfc2fdde84f+13:2355:x1875689351426432:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:2.0:1788796974.996855:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb060707850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4d9d1a9-601d-459e-8721-8bfc2fdde84f+13:2355:x1875689351426432:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 93us (364us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796974.996863:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 224 00000100:00100000:1.0:1788796974.997370:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351426944 00000100:00100000:1.0:1788796974.997377:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351426944 00000100:00100000:1.0:1788796974.997426:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 31 00000100:00100000:1.0:1788796974.997434:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb04982df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ed124ec0-b908-4000-b768-8e53d5def0fc+5:2355:x1875689351426944:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:1.0:1788796974.997473:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb04982df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ed124ec0-b908-4000-b768-8e53d5def0fc+5:2355:x1875689351426944:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 40us (887us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796974.997480:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 31 00000100:00100000:3.0:1788796974.997645:0:7636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351426688 00000100:00100000:3.0:1788796974.997649:0:7636:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351426688 00000100:00100000:3.0:1788796974.997793:0:7636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 73 00000100:00100000:3.0:1788796974.997801:0:7636:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb04982ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed124ec0-b908-4000-b768-8e53d5def0fc+5:2355:x1875689351426688:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:3.0:1788796974.997840:0:7636:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb04982ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed124ec0-b908-4000-b768-8e53d5def0fc+5:2355:x1875689351426688:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 40us (1283us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796974.997846:0:7636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 73 00000100:00080000:2.0:1788796974.998199:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788796974.998206:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788796974.998285:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1788796974.998366:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351426560 00000100:00100000:2.0:1788796974.998371:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351426560 00000100:00100000:2.0:1788796974.998419:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 74 00000100:00100000:2.0:1788796974.998427:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb04982f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6d050bb-169e-4784-be5b-7071799bf3b0+6:2355:x1875689351426560:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:2.0:1788796974.998469:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb04982f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6d050bb-169e-4784-be5b-7071799bf3b0+6:2355:x1875689351426560:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 44us (185us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796974.998475:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 74 00000100:00080000:0.0:1788796974.998519:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788796975.000465:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1788796975.000648:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351426816 00000100:00100000:2.0:1788796975.000663:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351426816 00000100:00100000:2.0:1788796975.000748:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 32 00000100:00100000:2.0:1788796975.000760:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb04982f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ed124ec0-b908-4000-b768-8e53d5def0fc+5:2355:x1875689351426816:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:2.0:1788796975.000870:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb04982f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ed124ec0-b908-4000-b768-8e53d5def0fc+5:2355:x1875689351426816:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 111us (414us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796975.000878:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 32 00000100:00080000:0.0:1788796975.001257:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788796975.922522:0:5815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788796976.181409:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb0796c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875689374527872:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788796976.181486:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788796976.181640:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374527872 00000100:00100000:1.0:1788796976.181649:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374527872 00000100:00100000:1.0:1788796976.181740:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788796976.181750:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb049409880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1875689374527872:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788796976.181789:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788796976.181834:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb049409880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1875689374527872:12345-0@lo:13:osp-pre-0-0.0 Request processed in 86us (349us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796976.181841:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:0.0:1788796976.183175:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788796976.184183:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cb0796c5500 x1875689374527872/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788796992 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788796976.184214:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb0796c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875689374527872:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788796976.690720:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788796976.690760:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb079175500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875689374528000:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788796976.690887:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788796976.691284:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374528000 00000100:00100000:2.0:1788796976.691293:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374528000 00000100:00100000:2.0:1788796976.691358:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788796976.691370:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb079177480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1875689374528000:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788796976.691936:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788796976.692016:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb079177480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1875689374528000:12345-0@lo:13:osp-pre-1-0.0 Request processed in 647us (1129us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796976.692025:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:2.0:1788796976.692093:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1788796976.692135:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cb079175500 x1875689374528000/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788796992 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788796976.692167:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb079175500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875689374528000:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788796976.694874:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb079176a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875689374528256:0@lo:400:kworker.0 00000100:00100000:3.0:1788796976.694925:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb079174000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3300:1875689374528384:0@lo:400:kworker.0 00000100:00100000:2.0:1788796976.694963:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796976.694983:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb079175180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3301:1875689374528512:0@lo:400:kworker.0 00000100:00100000:2.0:1788796976.695020:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788796976.695048:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb079175500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:3303:1875689374528128:0@lo:400:kworker.0 00000100:00100000:3.0:1788796976.695059:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788796976.695101:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796976.695107:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374528256 00000100:00100000:3.0:1788796976.695117:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374528256 00000100:00100000:2.0:1788796976.695148:0:7636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374528512 00000100:00100000:2.0:1788796976.695154:0:7636:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374528512 00000100:00100000:3.0:1788796976.695173:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788796976.695185:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb079174a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875689374528256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788796976.695201:0:7636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788796976.695210:0:7636:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb049409c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1875689374528512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788796976.695246:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb079174a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875689374528256:12345-0@lo:400:kworker.0 Request processed in 63us (284us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796976.695253:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788796976.695263:0:7636:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb049409c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1875689374528512:12345-0@lo:400:kworker.0 Request processed in 53us (207us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796976.695282:0:7636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1788796976.695311:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374528128 00000100:00100000:3.0:1788796976.695316:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374528128 00000100:00100000:2.0:1788796976.695333:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb079175180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3301:1875689374528512:0@lo:400:kworker.0 00000100:00100000:3.0:1788796976.695348:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:3.0:1788796976.695357:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb060705c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+19:3303:x1875689374528128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788796976.695374:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb079176a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875689374528256:0@lo:400:kworker.0 00000100:00100000:2.0:1788796976.695396:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb079175500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:3303:1875689374528128:0@lo:400:kworker.0 00000100:00100000:3.0:1788796976.695401:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb060705c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+19:3303:x1875689374528128:12345-0@lo:400:kworker.0 Request processed in 43us (297us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796976.695410:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00080000:3.0:1788796976.695435:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788796976.695446:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796976.695471:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374528384 00000100:00100000:3.0:1788796976.695475:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374528384 00000100:00100000:3.0:1788796976.695501:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1788796976.695508:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb04940a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1875689374528384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788796976.695543:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb04940a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1875689374528384:12345-0@lo:400:kworker.0 Request processed in 35us (96us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796976.695550:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00080000:3.0:1788796976.695563:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788796976.696130:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb079174000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3300:1875689374528384:0@lo:400:kworker.0 00010000:00010000:2.0:1788796976.952304:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788796977.975413:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788796979.001698:0:5815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788796980.018162:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788796980.121622:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1788796980.121662:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1788796980.121696:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1788796980.121718:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1788796980.121742:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1788796980.121775:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351427072 00000100:00100000:3.0:1788796980.121785:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351427072 00000100:00100000:3.0:1788796980.121833:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 226 00000100:00100000:3.0:1788796980.121843:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb060707050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4d9d1a9-601d-459e-8721-8bfc2fdde84f+13:2353:x1875689351427072:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:0.0:1788796980.121890:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351427456 00000100:00100000:0.0:1788796980.121894:0:6683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351427456 00000100:00100000:0.0:1788796980.121935:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351427584 00000100:00100000:0.0:1788796980.121939:0:6683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351427584 00000100:00100000:0.0:1788796980.121959:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 33 00000100:00100000:0.0:1788796980.121966:0:6683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb049408e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ed124ec0-b908-4000-b768-8e53d5def0fc+5:2353:x1875689351427456:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:0.0:1788796980.122068:0:6683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb049408e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ed124ec0-b908-4000-b768-8e53d5def0fc+5:2353:x1875689351427456:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 102us (405us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796980.122076:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 33 00000100:00100000:0.0:1788796980.122093:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 34 00000100:00100000:0.0:1788796980.122099:0:6683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb04940b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ed124ec0-b908-4000-b768-8e53d5def0fc+5:2353:x1875689351427584:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:0.0:1788796980.122123:0:6683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb04940b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ed124ec0-b908-4000-b768-8e53d5def0fc+5:2353:x1875689351427584:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 24us (380us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796980.122129:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 34 00000100:00100000:3.0:1788796980.122395:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb060707050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4d9d1a9-601d-459e-8721-8bfc2fdde84f+13:2353:x1875689351427072:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 552us (696us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796980.122546:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 226 00000100:00100000:3.0:1788796980.122582:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351427200 00000100:00100000:3.0:1788796980.122586:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351427200 00000100:00100000:3.0:1788796980.122616:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351427328 00000100:00100000:3.0:1788796980.122620:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351427328 00000100:00100000:3.0:1788796980.122644:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 78 00000100:00100000:3.0:1788796980.122652:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb04940bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6d050bb-169e-4784-be5b-7071799bf3b0+6:2353:x1875689351427200:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:3.0:1788796980.122684:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb04940bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6d050bb-169e-4784-be5b-7071799bf3b0+6:2353:x1875689351427200:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 33us (1073us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796980.122691:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 78 00000100:00100000:3.0:1788796980.122703:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 79 00000100:00100000:3.0:1788796980.122711:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb049409f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed124ec0-b908-4000-b768-8e53d5def0fc+5:2353:x1875689351427328:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:3.0:1788796980.122737:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb049409f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed124ec0-b908-4000-b768-8e53d5def0fc+5:2353:x1875689351427328:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 27us (1018us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796980.122760:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 79 00000100:00080000:3.0:1788796980.122788:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788796980.122794:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788796980.122797:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788796981.047523:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788796981.313812:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb0796c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875689374528640:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788796981.313903:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788796981.315635:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374528640 00000100:00100000:1.0:1788796981.315655:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374528640 00000100:00100000:1.0:1788796981.315757:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788796981.315769:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb079175500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875689374528640:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788796981.315828:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788796981.315936:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb079175500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875689374528640:12345-0@lo:13:osp-pre-0-0.0 Request processed in 167us (2031us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796981.315945:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00080000:1.0:1788796981.316005:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cb0796c7480 x1875689374528640/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788796997 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788796981.316054:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb0796c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875689374528640:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788796981.316872:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788796981.810230:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788796981.810259:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb079176a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875689374528768:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788796981.810340:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788796981.810428:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374528768 00000100:00100000:2.0:1788796981.810436:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374528768 00000100:00100000:2.0:1788796981.810518:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788796981.810528:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb079175180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875689374528768:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788796981.810563:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788796981.810608:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb079175180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875689374528768:12345-0@lo:13:osp-pre-1-0.0 Request processed in 82us (269us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796981.810624:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00080000:2.0:1788796981.810657:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1788796981.810688:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cb079176a00 x1875689374528768/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788796997 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788796981.810708:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb079176a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875689374528768:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788796981.811216:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb0796c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:3300:1875689374528896:0@lo:400:kworker.0 00000100:00100000:3.0:1788796981.811267:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788796981.811362:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb0796c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3301:1875689374529024:0@lo:400:kworker.0 00000100:00100000:2.0:1788796981.811394:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788796981.811428:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb0796c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3302:1875689374529152:0@lo:400:kworker.0 00000100:00100000:2.0:1788796981.811450:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788796981.811468:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788796981.811472:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb0796c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3302:1875689374529280:0@lo:400:kworker.0 00000100:00100000:2.0:1788796981.812136:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796981.812623:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374529024 00000100:00100000:3.0:1788796981.812643:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374529024 00000100:00100000:3.0:1788796981.812696:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374529152 00000100:00100000:3.0:1788796981.812700:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374529152 00000100:00100000:3.0:1788796981.812724:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374529280 00000100:00100000:3.0:1788796981.812727:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374529280 00000100:00100000:3.0:1788796981.812746:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1788796981.812756:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb079176a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1875689374529024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788796981.812823:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb079176a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1875689374529024:12345-0@lo:400:kworker.0 Request processed in 68us (1427us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796981.812830:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1788796981.812845:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1788796981.812851:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb079174700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1875689374529152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788796981.812881:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb079174700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1875689374529152:12345-0@lo:400:kworker.0 Request processed in 30us (1430us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796981.812887:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1788796981.812898:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1788796981.812904:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb079176300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1875689374529280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788796981.812928:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb079176300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1875689374529280:12345-0@lo:400:kworker.0 Request processed in 24us (794us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796981.812950:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00080000:2.0:1788796981.814223:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788796981.814273:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb0796c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3301:1875689374529024:0@lo:400:kworker.0 00000100:00100000:2.0:1788796981.814323:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb0796c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3302:1875689374529280:0@lo:400:kworker.0 00000100:00100000:2.0:1788796981.814334:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb0796c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3302:1875689374529152:0@lo:400:kworker.0 00000100:00100000:1.0:1788796981.818348:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374528896 00000100:00100000:1.0:1788796981.818370:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374528896 00000100:00100000:1.0:1788796981.818516:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:1.0:1788796981.818595:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb060704050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+19:3300:x1875689374528896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788796981.818791:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb060704050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+19:3300:x1875689374528896:12345-0@lo:400:kworker.0 Request processed in 201us (7524us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796981.818799:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:1.0:1788796981.818861:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb0796c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:3300:1875689374528896:0@lo:400:kworker.0 00010000:00010000:1.0:1788796982.069491:0:5815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788796983.091569:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788796984.114352:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788796985.141272:0:5815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788796985.246659:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1788796985.248554:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1788796985.248597:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1788796985.248620:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1788796985.248699:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1788796985.248731:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351427840 00000100:00100000:3.0:1788796985.248742:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351427840 00000100:00100000:3.0:1788796985.248812:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351427968 00000100:00100000:3.0:1788796985.248816:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351427968 00000100:00100000:3.0:1788796985.248842:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 83 00000100:00100000:3.0:1788796985.248853:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb04940b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6d050bb-169e-4784-be5b-7071799bf3b0+6:2354:x1875689351427840:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:3.0:1788796985.248956:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb04940b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6d050bb-169e-4784-be5b-7071799bf3b0+6:2354:x1875689351427840:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 104us (411us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796985.248964:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 83 00000100:00100000:3.0:1788796985.248996:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 84 00000100:00100000:3.0:1788796985.249003:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb049409500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed124ec0-b908-4000-b768-8e53d5def0fc+5:2355:x1875689351427968:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:3.0:1788796985.249055:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb049409500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed124ec0-b908-4000-b768-8e53d5def0fc+5:2355:x1875689351427968:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 27us (432us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796985.249061:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 84 00000100:00080000:3.0:1788796985.249089:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788796985.249535:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351427712 00000100:00100000:0.0:1788796985.249542:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351427712 00000100:00100000:0.0:1788796985.249610:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 228 00000100:00100000:0.0:1788796985.249626:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb048869050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4d9d1a9-601d-459e-8721-8bfc2fdde84f+13:2354:x1875689351427712:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:0.0:1788796985.249659:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb048869050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4d9d1a9-601d-459e-8721-8bfc2fdde84f+13:2354:x1875689351427712:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 35us (3010us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796985.249665:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 228 00000100:00100000:1.0:1788796985.250134:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351428096 00000100:00100000:1.0:1788796985.250141:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351428096 00000100:00100000:1.0:1788796985.250194:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351428224 00000100:00100000:1.0:1788796985.250198:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351428224 00000100:00100000:1.0:1788796985.250217:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 15 00000100:00080000:3.0:1788796985.250391:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788796985.250395:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788796985.250481:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb04940b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ed124ec0-b908-4000-b768-8e53d5def0fc+5:2351:x1875689351428096:12345-192.168.204.38@tcp:9:kworker.0 00000020:00000080:1.0:1788796985.250509:0:6681:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xca7fc0c411f935e2 00000100:00080000:1.0:1788796985.250519:0:6681:0:(import.c:65:import_set_state_nolock()) ffff8cb077c0f000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788796985.250566:0:6681:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00010000:00010000:2.0:1788796985.251091:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788796985.251167:0:6683:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:0.0:1788796985.251179:0:6683:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:0.0:1788796985.255327:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb04940b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ed124ec0-b908-4000-b768-8e53d5def0fc+2:2351:x1875689351428096:12345-192.168.204.38@tcp:9:kworker.0 Request processed in 5090us (6691us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796985.255343:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 15 00000100:00100000:1.0:1788796985.256120:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 16 00000100:00100000:1.0:1788796985.256138:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb04940aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ed124ec0-b908-4000-b768-8e53d5def0fc+5:2351:x1875689351428224:12345-192.168.204.38@tcp:9:kworker.0 00000020:00000080:1.0:1788796985.256176:0:6681:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xca7fc0c411f935e9 00000100:00080000:1.0:1788796985.256188:0:6681:0:(import.c:65:import_set_state_nolock()) ffff8cb077c0c800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788796985.256239:0:6681:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00010000:00010000:3.0:1788796985.256356:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788796985.256849:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb04940aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ed124ec0-b908-4000-b768-8e53d5def0fc+2:2351:x1875689351428224:12345-192.168.204.38@tcp:9:kworker.0 Request processed in 716us (8146us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796985.256859:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 16 00010000:00010000:2.0:1788796986.162284:0:5815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788796986.419154:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb079174380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875689374529408:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788796986.419243:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788796986.419417:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374529408 00000100:00100000:0.0:1788796986.419427:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374529408 00000100:00100000:0.0:1788796986.419504:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788796986.419527:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb079174000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1875689374529408:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788796986.419563:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788796986.419613:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb079174000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1875689374529408:12345-0@lo:13:osp-pre-0-0.0 Request processed in 100us (369us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796986.419620:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00080000:2.0:1788796986.419743:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788796986.419784:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cb079174380 x1875689374529408/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788797002 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788796986.419821:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb079174380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875689374529408:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788796986.933293:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb04982dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3300:1875689374529920:0@lo:400:kworker.0 00000100:00100000:0.0:1788796986.933370:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788796986.933469:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788796986.933476:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb04982fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:3300:1875689374529536:0@lo:400:kworker.0 00000100:00100000:0.0:1788796986.933511:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788796986.933547:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb04982e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875689374530048:0@lo:400:kworker.0 00000100:00100000:0.0:1788796986.933594:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788796986.933626:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb04982ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875689374529664:0@lo:400:kworker.0 00000100:00100000:0.0:1788796986.933664:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788796986.933684:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788796986.933689:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb04982d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3302:1875689374529792:0@lo:400:kworker.0 00000100:00100000:0.0:1788796986.933708:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788796986.933742:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374529920 00000100:00100000:0.0:1788796986.933751:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374529920 00000100:00100000:0.0:1788796986.933819:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374529664 00000100:00100000:0.0:1788796986.933823:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374529664 00000100:00100000:0.0:1788796986.933836:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374529792 00000100:00100000:0.0:1788796986.933838:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374529792 00000100:00100000:0.0:1788796986.933873:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788796986.933883:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb04982c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1875689374529920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788796986.933956:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb04982c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1875689374529920:12345-0@lo:400:kworker.0 Request processed in 73us (584us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796986.933964:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788796986.933986:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1788796986.933993:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb077921880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875689374529664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788796986.934051:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb077921880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875689374529664:12345-0@lo:400:kworker.0 Request processed in 36us (362us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796986.934058:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1788796986.934083:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1788796986.934091:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb077921c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1875689374529792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788796986.934129:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb077921c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1875689374529792:12345-0@lo:400:kworker.0 Request processed in 40us (419us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796986.934135:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1788796986.934159:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374529536 00000100:00100000:0.0:1788796986.934164:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374529536 00000100:00100000:0.0:1788796986.934202:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:0.0:1788796986.934209:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb060706450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+19:3300:x1875689374529536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788796986.934244:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb060706450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+19:3300:x1875689374529536:12345-0@lo:400:kworker.0 Request processed in 35us (730us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796986.934251:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:0.0:1788796986.934286:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374530048 00000100:00100000:0.0:1788796986.934290:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374530048 00000100:00100000:0.0:1788796986.934322:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788796986.934329:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb077922d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3300:x1875689374530048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788796986.934361:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb077922d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3300:x1875689374530048:12345-0@lo:400:kworker.0 Request processed in 34us (767us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796986.934367:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00080000:0.0:1788796986.934389:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788796986.934393:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788796986.934402:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788796986.934411:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb049408000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875689374530176:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788796986.934437:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788796986.934493:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb04982d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3302:1875689374529792:0@lo:400:kworker.0 00000100:00100000:0.0:1788796986.934503:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb04982ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875689374529664:0@lo:400:kworker.0 00000100:00100000:0.0:1788796986.934675:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb04982fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:3300:1875689374529536:0@lo:400:kworker.0 00010000:00080000:0.0:1788796986.934688:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cb04982e680 x1875689374530048/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788797002 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788796986.934699:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb04982e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875689374530048:0@lo:400:kworker.0 00000100:00100000:0.0:1788796986.934710:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb04982dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3300:1875689374529920:0@lo:400:kworker.0 00000100:00100000:3.0:1788796986.934750:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374530176 00000100:00100000:3.0:1788796986.934757:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374530176 00000100:00100000:3.0:1788796986.934805:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788796986.934813:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb077922680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875689374530176:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788796986.934843:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788796986.934900:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb077922680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875689374530176:12345-0@lo:13:osp-pre-1-0.0 Request processed in 88us (461us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796986.934907:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:0.0:1788796986.935191:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cb049408000 x1875689374530176/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788797002 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788796986.935207:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb049408000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875689374530176:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788796987.186314:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788796988.038267:0:6713:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of ed124ec0-b908-4000-b768-8e53d5def0fc 00000020:00000080:1.0:1788796988.038276:0:6713:0:(genops.c:885:class_export_put()) final put ffff8cb077c0a800/ed124ec0-b908-4000-b768-8e53d5def0fc 00000020:00000080:2.0:1788796988.038340:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8cb077c0a800/ed124ec0-b908-4000-b768-8e53d5def0fc for lustre-OST0000 00000020:00000080:2.0:1788796988.038395:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8cb077c0f000 for lustre-OST0000 00000001:00100000:2.0:1788796988.044453:0:7640:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of ed124ec0-b908-4000-b768-8e53d5def0fc 00000020:00000080:2.0:1788796988.044463:0:7640:0:(genops.c:885:class_export_put()) final put ffff8cb077c08000/ed124ec0-b908-4000-b768-8e53d5def0fc 00000020:00000080:1.0:1788796988.048074:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8cb077c08000/ed124ec0-b908-4000-b768-8e53d5def0fc for lustre-OST0001 00000020:00000080:1.0:1788796988.048158:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8cb077c0c800 for lustre-OST0001 00010000:00010000:3.0:1788796988.210764:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788796989.237904:0:5815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788796990.259206:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788796990.359249:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1788796990.359668:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351428352 00000100:00100000:3.0:1788796990.359679:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351428352 00000100:00100000:3.0:1788796990.359748:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 230 00000100:00100000:3.0:1788796990.359759:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb060704c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4d9d1a9-601d-459e-8721-8bfc2fdde84f+13:2355:x1875689351428352:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:3.0:1788796990.359835:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb060704c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4d9d1a9-601d-459e-8721-8bfc2fdde84f+13:2355:x1875689351428352:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 77us (597us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796990.359842:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 230 00000100:00100000:0.0:1788796990.367552:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1788796990.370307:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1788796990.370576:0:7636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351428480 00000100:00100000:1.0:1788796990.370595:0:7636:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351428480 00000100:00100000:1.0:1788796990.370675:0:7636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351428608 00000100:00100000:1.0:1788796990.370679:0:7636:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351428608 00000100:00100000:1.0:1788796990.370708:0:7636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 88 00000100:00100000:1.0:1788796990.370718:0:7636:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb077923b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6d050bb-169e-4784-be5b-7071799bf3b0+6:2354:x1875689351428480:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:2.0:1788796990.370753:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 89 00000100:00100000:2.0:1788796990.370766:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb077920e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed124ec0-b908-4000-b768-8e53d5def0fc+5:2355:x1875689351428608:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:1.0:1788796990.370812:0:7636:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb077923b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6d050bb-169e-4784-be5b-7071799bf3b0+6:2354:x1875689351428480:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 91us (3266us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796990.370813:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb077920e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed124ec0-b908-4000-b768-8e53d5def0fc+5:2355:x1875689351428608:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 46us (512us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796990.370829:0:7636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 88 00000100:00080000:0.0:1788796990.370870:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788796990.371735:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 89 00010000:00010000:1.0:1788796991.291706:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788796991.541724:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788796991.541753:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb0796c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875689374530304:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788796991.541832:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796991.548630:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374530304 00000100:00100000:3.0:1788796991.548647:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374530304 00000100:00100000:3.0:1788796991.548726:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788796991.548736:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0796c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875689374530304:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788796991.548773:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788796991.548855:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0796c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875689374530304:12345-0@lo:13:osp-pre-0-0.0 Request processed in 121us (7023us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796991.548861:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00080000:3.0:1788796991.548952:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cb0796c7480 x1875689374530304/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788797007 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788796991.548972:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb0796c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875689374530304:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788796991.549710:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:02000400:3.0:1788796991.683865:0:11014:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:1.0:1788796992.053069:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb0796c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3301:1875689374530560:0@lo:400:kworker.0 00000100:00100000:0.0:1788796992.053484:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb0796c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:3300:1875689374530432:0@lo:400:kworker.0 00000100:00100000:0.0:1788796992.053643:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788796992.053702:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb0796c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3300:1875689374530944:0@lo:400:kworker.0 00000100:00100000:0.0:1788796992.053727:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788796992.053763:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb0796c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3303:1875689374530816:0@lo:400:kworker.0 00000100:00100000:0.0:1788796992.053786:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788796992.053805:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1788796992.053811:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb0796c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875689374530688:0@lo:400:kworker.0 00000100:00100000:0.0:1788796992.053849:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788796992.053868:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb079174380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875689374531200:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788796992.053890:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788796992.053920:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374530944 00000100:00100000:0.0:1788796992.053927:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374530944 00000100:00100000:0.0:1788796992.053984:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374530816 00000100:00100000:0.0:1788796992.053988:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374530816 00000100:00100000:0.0:1788796992.054010:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1788796992.054017:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb077921f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1875689374530944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788796992.054089:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb077921f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1875689374530944:12345-0@lo:400:kworker.0 Request processed in 72us (361us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796992.054107:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1788796992.054123:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1788796992.054270:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374530432 00000100:00100000:2.0:1788796992.054275:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374530432 00000100:00100000:2.0:1788796992.054318:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:2.0:1788796992.054326:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb060706c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+19:3300:x1875689374530432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788796992.054364:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb060706c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+19:3300:x1875689374530432:12345-0@lo:400:kworker.0 Request processed in 40us (722us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796992.054370:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00080000:2.0:1788796992.054404:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788796992.054489:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb077923100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875689374530816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788796992.054532:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb077923100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875689374530816:12345-0@lo:400:kworker.0 Request processed in 403us (745us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796992.054539:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1788796992.054575:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb0796c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:3300:1875689374530432:0@lo:400:kworker.0 00000100:00100000:0.0:1788796992.054587:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb0796c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3300:1875689374530944:0@lo:400:kworker.0 00000100:00100000:3.0:1788796992.054808:0:10829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374530688 00000100:00100000:3.0:1788796992.054813:0:10829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374530688 00000100:00100000:3.0:1788796992.054855:0:10829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788796992.054864:0:10829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb077923800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3303:x1875689374530688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788796992.054903:0:10829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb077923800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3303:x1875689374530688:12345-0@lo:400:kworker.0 Request processed in 41us (1053us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796992.054909:0:10829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788796992.054927:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374531200 00000100:00100000:3.0:1788796992.054931:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374531200 00000100:00100000:3.0:1788796992.054962:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788796992.054968:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb077921500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875689374531200:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788796992.055009:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788796992.055075:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb077921500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875689374531200:12345-0@lo:13:osp-pre-1-0.0 Request processed in 106us (1183us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796992.055080:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00080000:3.0:1788796992.055115:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1788796992.055458:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cb0796c4380 x1875689374530688/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788797008 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788796992.055469:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb0796c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875689374530688:0@lo:400:kworker.0 00010000:00080000:2.0:1788796992.055489:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cb079174380 x1875689374531200/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788797008 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788796992.055502:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb079174380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875689374531200:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788796992.055513:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb0796c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3303:1875689374530816:0@lo:400:kworker.0 00000100:00100000:1.0:1788796992.055583:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788796992.055648:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb0796c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875689374531072:0@lo:400:kworker.0 00000100:00100000:1.0:1788796992.055675:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788796992.055760:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374531072 00000100:00100000:0.0:1788796992.055766:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374531072 00000100:00100000:0.0:1788796992.055839:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788796992.055847:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0796c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3301:x1875689374531072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788796992.055898:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0796c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3301:x1875689374531072:12345-0@lo:400:kworker.0 Request processed in 52us (223us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796992.055905:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788796992.055937:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374530560 00000100:00100000:2.0:1788796992.055941:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374530560 00000100:00100000:2.0:1788796992.055982:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1788796992.055990:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0796c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1875689374530560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788796992.056023:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0796c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1875689374530560:12345-0@lo:400:kworker.0 Request processed in 34us (441us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796992.056166:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1788796992.056493:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb0796c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3301:1875689374530560:0@lo:400:kworker.0 00010000:00080000:3.0:1788796992.056503:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cb0796c7480 x1875689374531072/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788797008 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788796992.056512:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb0796c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875689374531072:0@lo:400:kworker.0 00010000:00010000:2.0:1788796992.306400:0:5815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788796993.339902:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788796994.355497:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788796995.378172:0:5815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788796995.476744:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1788796995.476791:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1788796995.476818:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1788796995.476848:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351428992 00000100:00100000:0.0:1788796995.476857:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351428992 00000100:00100000:0.0:1788796995.476924:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351428864 00000100:00100000:0.0:1788796995.476928:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351428864 00000100:00100000:0.0:1788796995.476948:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 93 00000100:00100000:0.0:1788796995.476957:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb077923480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed124ec0-b908-4000-b768-8e53d5def0fc+5:2354:x1875689351428992:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:0.0:1788796995.477021:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb077923480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed124ec0-b908-4000-b768-8e53d5def0fc+5:2354:x1875689351428992:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 65us (229us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796995.477071:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 93 00000100:00100000:0.0:1788796995.477089:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 94 00000100:00100000:0.0:1788796995.477095:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb077922a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6d050bb-169e-4784-be5b-7071799bf3b0+6:2354:x1875689351428864:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:0.0:1788796995.477119:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb077922a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6d050bb-169e-4784-be5b-7071799bf3b0+6:2354:x1875689351428864:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 25us (301us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796995.477125:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 94 00000100:00080000:0.0:1788796995.477140:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788796995.477403:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351428736 00000100:00100000:1.0:1788796995.477409:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351428736 00000100:00100000:1.0:1788796995.477444:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 232 00000100:00100000:1.0:1788796995.477452:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb060704450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4d9d1a9-601d-459e-8721-8bfc2fdde84f+13:2354:x1875689351428736:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:1.0:1788796995.477488:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb060704450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4d9d1a9-601d-459e-8721-8bfc2fdde84f+13:2354:x1875689351428736:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 37us (755us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796995.477495:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 232 00000020:00000080:0.0:1788796995.795841:0:11163:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc5bb85d90 20000000:00000080:0.0:1788796995.795862:0:11163:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8cb045792c00 uarg=0000000000000000 20000000:01000000:0.0:1788796995.795912:0:11163:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1788796995.795919:0:11163:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1788796995.795925:0:11163:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1788796995.802248:0:11164:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:1.0:1788796995.802481:0:11163:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:1.0:1788796995.811731:0:11163:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1788796995.811772:0:11163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cb0821f1000/0xca7fc0c411f935f0 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796995.811795:0:11163:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cb041484800/0xca7fc0c411f93595 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee0f39 expref: 12 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796995.811822:0:11163:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cb080437600/0xca7fc0c411f935a3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xca7fc0c411f9359c expref: 18 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796995.811829:0:11163:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cb041484400/0xca7fc0c411f935b1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xca7fc0c411f935aa expref: 18 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796995.811836:0:11163:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cb079b81800/0xca7fc0c411f935bf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xca7fc0c411f935b8 expref: 18 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796995.811844:0:11163:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cb079b80e00/0xca7fc0c411f935d4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee0f71 expref: 12 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796995.811852:0:11163:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8cb0821f1000/0xca7fc0c411f935f0 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796995.811920:0:11163:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cb079b80e00/0xca7fc0c411f935d4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee0f71 expref: 12 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796995.811945:0:11163:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8cb079b80e00/0xca7fc0c411f935d4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee0f71 expref: 12 pid: 5818 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788796995.811964:0:11163:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb0796c6a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11163:1875689374531328:192.168.204.38@tcp:104: 00010000:00010000:1.0:1788796995.812141:0:11163:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cb079b81800/0xca7fc0c411f935bf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xca7fc0c411f935b8 expref: 18 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796995.812150:0:11163:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cb079b81800/0xca7fc0c411f935bf lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xca7fc0c411f935b8 expref: 18 pid: 5819 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788796995.812158:0:11163:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb0796c5500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11163:1875689374531456:0@lo:104: 00000100:00100000:1.0:1788796995.812212:0:11163:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788796995.812262:0:11163:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cb041484400/0xca7fc0c411f935b1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xca7fc0c411f935aa expref: 18 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796995.812270:0:11163:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cb041484400/0xca7fc0c411f935b1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xca7fc0c411f935aa expref: 18 pid: 5819 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788796995.812278:0:11163:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb0796c6300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11163:1875689374531584:0@lo:104: 00000100:00100000:1.0:1788796995.812298:0:11163:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788796995.812320:0:11163:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cb080437600/0xca7fc0c411f935a3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xca7fc0c411f9359c expref: 18 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796995.812327:0:11163:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cb080437600/0xca7fc0c411f935a3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xca7fc0c411f9359c expref: 18 pid: 5820 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788796995.812335:0:11163:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb0796c4380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11163:1875689374531712:0@lo:104: 00000100:00100000:1.0:1788796995.812355:0:11163:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788796995.812391:0:11163:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cb041484800/0xca7fc0c411f93595 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee0f39 expref: 12 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796995.812399:0:11163:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8cb041484800/0xca7fc0c411f93595 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee0f39 expref: 12 pid: 5818 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788796995.812402:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374531456 00000100:00100000:1.0:1788796995.812407:0:11163:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb0796c4700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11163:1875689374531840:192.168.204.38@tcp:104: 00000100:00100000:3.0:1788796995.812411:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374531456 00000100:00100000:3.0:1788796995.812453:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374531584 00000100:00100000:3.0:1788796995.812456:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374531584 00000100:00100000:3.0:1788796995.812466:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374531712 00000100:00100000:3.0:1788796995.812468:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374531712 00000100:00100000:3.0:1788796995.812483:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788796995.812492:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0796c7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+5:11163:x1875689374531456:12345-0@lo:104: 00010000:00010000:3.0:1788796995.812511:0:5810:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.138@tcp lock: ffff8cb079b81400/0xca7fc0c411f935b8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xca7fc0c411f935bf expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796995.812558:0:5810:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788796995.812564:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0796c7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+5:11163:x1875689374531456:12345-0@lo:104: Request processed in 74us (352us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796995.812588:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788796995.812607:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788796995.812613:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0796c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+4:11163:x1875689374531584:12345-0@lo:104: 00010000:00010000:3.0:1788796995.812621:0:5810:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.138@tcp lock: ffff8cb041484600/0xca7fc0c411f935aa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xca7fc0c411f935b1 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796995.812654:0:5810:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788796995.812659:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0796c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+4:11163:x1875689374531584:12345-0@lo:104: Request processed in 47us (360us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796995.812664:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788796995.812675:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788796995.812681:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0796c5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+3:11163:x1875689374531712:12345-0@lo:104: 00010000:00010000:3.0:1788796995.812687:0:5810:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.138@tcp lock: ffff8cb0821f1200/0xca7fc0c411f9359c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xca7fc0c411f935a3 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796995.812717:0:5810:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1788796995.812722:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0796c5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+3:11163:x1875689374531712:12345-0@lo:104: Request processed in 43us (367us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796995.812728:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:3.0:1788796995.812747:0:5814:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788796995.812753:0:5814:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.138@tcp lock: ffff8cb079b81400/0xca7fc0c411f935b8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xca7fc0c411f935bf expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796995.812766:0:5814:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb079b81400 already unused, calling callback (ffffffffc1adac20) 10000000:00010000:3.0:1788796995.812791:0:5814:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.138@tcp lock: ffff8cb079b81400/0xca7fc0c411f935b8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xca7fc0c411f935bf expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796995.812799:0:5814:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.138@tcp lock: ffff8cb079b81400/0xca7fc0c411f935b8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xca7fc0c411f935bf expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788796995.812813:0:5814:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.138@tcp lock: ffff8cb079b81400/0xca7fc0c411f935b8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xca7fc0c411f935bf expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788796995.812819:0:5814:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788796995.812855:0:5814:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.138@tcp lock: ffff8cb079b81400/0xca7fc0c411f935b8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca7fc0c411f935bf expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796995.812862:0:5814:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788796995.812890:0:5814:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.138@tcp lock: ffff8cb079b81400/0xca7fc0c411f935b8 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca7fc0c411f935bf expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796995.812916:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.138@tcp lock: ffff8cb079b81400/0xca7fc0c411f935b8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca7fc0c411f935bf expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796995.812937:0:5814:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788796995.812940:0:5814:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.138@tcp lock: ffff8cb041484600/0xca7fc0c411f935aa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xca7fc0c411f935b1 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796995.812946:0:5814:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb041484600 already unused, calling callback (ffffffffc1adac20) 10000000:00010000:3.0:1788796995.812949:0:5814:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.138@tcp lock: ffff8cb041484600/0xca7fc0c411f935aa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xca7fc0c411f935b1 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796995.812964:0:5814:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.138@tcp lock: ffff8cb041484600/0xca7fc0c411f935aa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xca7fc0c411f935b1 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788796995.812970:0:5814:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.138@tcp lock: ffff8cb041484600/0xca7fc0c411f935aa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xca7fc0c411f935b1 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788796995.812975:0:5814:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788796995.812997:0:5814:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.138@tcp lock: ffff8cb041484600/0xca7fc0c411f935aa lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca7fc0c411f935b1 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796995.813004:0:5814:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788796995.813017:0:5814:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.138@tcp lock: ffff8cb041484600/0xca7fc0c411f935aa lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca7fc0c411f935b1 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796995.813023:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.138@tcp lock: ffff8cb041484600/0xca7fc0c411f935aa lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca7fc0c411f935b1 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796995.813054:0:5814:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788796995.813057:0:5814:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.138@tcp lock: ffff8cb0821f1200/0xca7fc0c411f9359c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xca7fc0c411f935a3 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796995.813062:0:5814:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb0821f1200 already unused, calling callback (ffffffffc1adac20) 10000000:00010000:3.0:1788796995.813064:0:5814:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.138@tcp lock: ffff8cb0821f1200/0xca7fc0c411f9359c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xca7fc0c411f935a3 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796995.813071:0:5814:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.138@tcp lock: ffff8cb0821f1200/0xca7fc0c411f9359c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xca7fc0c411f935a3 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788796995.813076:0:5814:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.138@tcp lock: ffff8cb0821f1200/0xca7fc0c411f9359c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xca7fc0c411f935a3 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788796995.813087:0:5814:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788796995.813101:0:5814:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.138@tcp lock: ffff8cb0821f1200/0xca7fc0c411f9359c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca7fc0c411f935a3 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796995.813106:0:5814:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788796995.813111:0:5814:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.138@tcp lock: ffff8cb0821f1200/0xca7fc0c411f9359c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca7fc0c411f935a3 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796995.813117:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.138@tcp lock: ffff8cb0821f1200/0xca7fc0c411f9359c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca7fc0c411f935a3 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796995.813131:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788796995.813133:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788796995.813135:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788796995.813142:0:5815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788796995.813151:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788796995.813161:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb049409180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:3302:1875689374531968:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788796995.813207:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796995.813234:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb049408000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:3301:1875689374532224:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788796995.813279:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796995.813297:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788796995.813302:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb049408a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:3301:1875689374532096:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788796995.813331:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796995.813366:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374531968 00000100:00100000:3.0:1788796995.813372:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374531968 00010000:00010000:3.0:1788796995.813400:0:5811:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cb079b81800/0xca7fc0c411f935bf lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xca7fc0c411f935b8 expref: 19 pid: 5819 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788796995.813431:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374532224 00000100:00100000:3.0:1788796995.813434:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374532224 00010000:00010000:3.0:1788796995.813454:0:5811:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cb080437600/0xca7fc0c411f935a3 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xca7fc0c411f9359c expref: 20 pid: 5820 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788796995.813464:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374532096 00000100:00100000:3.0:1788796995.813467:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374532096 00010000:00010000:3.0:1788796995.813475:0:5811:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cb041484400/0xca7fc0c411f935b1 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xca7fc0c411f935aa expref: 21 pid: 5819 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788796995.813485:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788796995.813491:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb042ed9050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+21:3302:x1875689374531968:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788796995.813503:0:5811:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788796995.813508:0:5811:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cb079b81800/0xca7fc0c411f935bf lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xca7fc0c411f935b8 expref: 21 pid: 5819 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796995.813516:0:5811:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cb079b81800/0xca7fc0c411f935bf lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xca7fc0c411f935b8 expref: 21 pid: 5819 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796995.813531:0:5811:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788796995.813561:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb042ed9050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+21:3302:x1875689374531968:12345-0@lo:103:ldlm_bl.0 Request processed in 71us (353us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796995.813567:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788796995.813606:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788796995.813612:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb080475c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+20:3301:x1875689374532224:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788796995.813618:0:5811:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788796995.813622:0:5811:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cb080437600/0xca7fc0c411f935a3 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xca7fc0c411f9359c expref: 20 pid: 5820 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796995.813639:0:5811:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cb080437600/0xca7fc0c411f935a3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xca7fc0c411f9359c expref: 20 pid: 5820 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796995.813647:0:5811:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788796995.813671:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb080475c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+20:3301:x1875689374532224:12345-0@lo:103:ldlm_bl.0 Request processed in 60us (393us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796995.813677:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788796995.813688:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788796995.813693:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb080476680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+19:3301:x1875689374532096:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788796995.813700:0:5811:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788796995.813703:0:5811:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cb041484400/0xca7fc0c411f935b1 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xca7fc0c411f935aa expref: 19 pid: 5819 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796995.813710:0:5811:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cb041484400/0xca7fc0c411f935b1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xca7fc0c411f935aa expref: 19 pid: 5819 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796995.813718:0:5811:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788796995.813746:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb080476680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+19:3301:x1875689374532096:12345-0@lo:103:ldlm_bl.0 Request processed in 52us (423us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796995.813752:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788796995.813801:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb049409180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:3302:1875689374531968:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788796995.813839:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb049408a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:3301:1875689374532096:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788796995.813847:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb049408000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:3301:1875689374532224:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788796995.813893:0:11163:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb079a91300 going to sleep for 11 seconds 00010000:00010000:1.0:1788796995.813919:0:11163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cb079b81800/0xca7fc0c411f935bf lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xca7fc0c411f935b8 expref: 18 pid: 5819 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788796995.813931:0:11163:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb0796c5500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11163:1875689374531456:0@lo:104: 00010000:00010000:1.0:1788796995.813940:0:11163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cb041484400/0xca7fc0c411f935b1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xca7fc0c411f935aa expref: 17 pid: 5819 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788796995.813955:0:11163:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb0796c6300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11163:1875689374531584:0@lo:104: 00010000:00010000:1.0:1788796995.813967:0:11163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cb080437600/0xca7fc0c411f935a3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xca7fc0c411f9359c expref: 16 pid: 5820 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788796995.813974:0:11163:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb0796c4380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11163:1875689374531712:0@lo:104: 00010000:00010000:2.0:1788796995.814061:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788796995.821803:0:11163:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb0796c6a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11163:1875689374531328:192.168.204.38@tcp:104: 00000100:00100000:0.0:1788796995.822021:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1788796995.822150:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1788796995.822194:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351429248 00000100:00100000:0.0:1788796995.822201:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351429248 00010000:00010000:0.0:1788796995.822242:0:5813:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cb041484800/0xca7fc0c411f93595 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee0f39 expref: 13 pid: 5818 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788796995.822277:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351429120 00000100:00100000:0.0:1788796995.822281:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351429120 00010000:00010000:0.0:1788796995.822294:0:5813:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cb079b80e00/0xca7fc0c411f935d4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee0f71 expref: 14 pid: 5818 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788796995.822314:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 28 00000100:00100000:0.0:1788796995.822324:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb077920000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b4d9d1a9-601d-459e-8721-8bfc2fdde84f+14:2352:x1875689351429248:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788796995.822363:0:5813:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788796995.822368:0:5813:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cb041484800/0xca7fc0c411f93595 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee0f39 expref: 14 pid: 5818 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796995.822379:0:5813:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cb041484800/0xca7fc0c411f93595 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee0f39 expref: 14 pid: 5818 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796995.822405:0:5813:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788796995.822458:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb077920000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b4d9d1a9-601d-459e-8721-8bfc2fdde84f+14:2352:x1875689351429248:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 136us (439us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796995.822466:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 28 00000100:00100000:0.0:1788796995.822484:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 29 00000100:00100000:0.0:1788796995.822490:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb077921180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b4d9d1a9-601d-459e-8721-8bfc2fdde84f+13:2353:x1875689351429120:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788796995.822497:0:5813:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788796995.822502:0:5813:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cb079b80e00/0xca7fc0c411f935d4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee0f71 expref: 13 pid: 5818 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796995.822512:0:5813:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cb079b80e00/0xca7fc0c411f935d4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee0f71 expref: 13 pid: 5818 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796995.822523:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cb079b80e00/0xca7fc0c411f935d4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee0f71 expref: 13 pid: 5818 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796995.822538:0:5813:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8cb0821f1000/0xca7fc0c411f935f0 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 11163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796995.822547:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cb0821f1000/0xca7fc0c411f935f0 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 11163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796995.822575:0:5813:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cb0821f1000/0xca7fc0c411f935f0 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796995.822583:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cb0821f1000/0xca7fc0c411f935f0 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796995.822591:0:5813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cb0821f1000/0xca7fc0c411f935f0 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796995.822599:0:5813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cb0821f1000/0xca7fc0c411f935f0 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796995.822605:0:5813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb0821f1000 already unused, calling callback (ffffffffc14d98b0) 00010000:00010000:0.0:1788796995.822610:0:5813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cb0821f1000/0xca7fc0c411f935f0 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796995.822619:0:5813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cb0821f1000/0xca7fc0c411f935f0 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796995.822629:0:5813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cb0821f1000/0xca7fc0c411f935f0 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796995.822641:0:5813:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788796995.822662:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb077921180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b4d9d1a9-601d-459e-8721-8bfc2fdde84f+12:2353:x1875689351429120:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 172us (511us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796995.822669:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 29 00010000:00010000:2.0:1788796995.822974:0:11163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cb041484800/0xca7fc0c411f93595 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee0f39 expref: 11 pid: 5818 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788796995.822988:0:11163:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb0796c4700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11163:1875689374531840:192.168.204.38@tcp:104: 00010000:00010000:2.0:1788796995.823073:0:11163:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8cb0821f1000/0xca7fc0c411f935f0 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796995.823086:0:11163:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8cb0821f1000/0xca7fc0c411f935f0 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796995.823094:0:11163:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cb0821f1000/0xca7fc0c411f935f0 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796995.823113:0:11163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cb0821f1000/0xca7fc0c411f935f0 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796996.402266:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788796996.658490:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb0796c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875689374532352:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788796996.658609:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788796996.658964:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374532352 00000100:00100000:0.0:1788796996.658973:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374532352 00000100:00100000:0.0:1788796996.659063:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788796996.659074:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb080477b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875689374532352:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788796996.659119:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788796996.659177:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb080477b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875689374532352:12345-0@lo:13:osp-pre-0-0.0 Request processed in 106us (568us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796996.659185:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00080000:3.0:1788796996.659904:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788796996.659953:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cb0796c4700 x1875689374532352/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788797012 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788796996.659977:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb0796c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875689374532352:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788796997.170463:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788796997.170491:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb079174380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875689374532480:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788796997.170558:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788796997.172773:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374532480 00000100:00100000:0.0:1788796997.172786:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374532480 00000100:00100000:2.0:1788796997.173119:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb077920700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3301:1875689374532736:0@lo:400:kworker.0 00000100:00100000:2.0:1788796997.173212:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788796997.173261:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1788796997.173267:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb077920a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:3301:1875689374532608:0@lo:400:kworker.0 00000100:00100000:2.0:1788796997.173300:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788796997.173343:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb04982dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3301:1875689374533120:0@lo:400:kworker.0 00000100:00100000:2.0:1788796997.173366:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788796997.173396:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374532608 00000100:00100000:2.0:1788796997.173400:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374532608 00000100:00100000:2.0:1788796997.173441:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:2.0:1788796997.173453:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb060705450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+16:3301:x1875689374532608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788796997.173516:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb060705450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+16:3301:x1875689374532608:12345-0@lo:400:kworker.0 Request processed in 65us (214us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796997.173523:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:2.0:1788796997.173584:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb077920a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:3301:1875689374532608:0@lo:400:kworker.0 00000100:00100000:1.0:1788796997.173833:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb077920380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3303:1875689374532992:0@lo:400:kworker.0 00000100:00100000:1.0:1788796997.173868:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788796997.173914:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788796997.173921:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb077922300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875689374532864:0@lo:400:kworker.0 00000100:00100000:1.0:1788796997.173948:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788796997.173988:0:10829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374532864 00000100:00100000:1.0:1788796997.173992:0:10829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374532864 00000100:00100000:1.0:1788796997.174045:0:10829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788796997.174054:0:10829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb077ffe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3303:x1875689374532864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788796997.174094:0:10829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb077ffe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3303:x1875689374532864:12345-0@lo:400:kworker.0 Request processed in 41us (145us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796997.174100:0:10829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00080000:1.0:1788796997.174287:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cb077922300 x1875689374532864/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788797013 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788796997.174299:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb077922300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875689374532864:0@lo:400:kworker.0 00000100:00080000:1.0:1788796997.174587:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788796997.174618:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374532736 00000100:00100000:1.0:1788796997.174623:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374532736 00000100:00100000:1.0:1788796997.174671:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374533120 00000100:00100000:1.0:1788796997.174675:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374533120 00000100:00100000:1.0:1788796997.174692:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374532992 00000100:00100000:1.0:1788796997.174695:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374532992 00000100:00100000:1.0:1788796997.174710:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1788796997.174716:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb079175880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1875689374532736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788796997.174758:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb079175880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1875689374532736:12345-0@lo:400:kworker.0 Request processed in 42us (1546us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796997.174765:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1788796997.174777:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1788796997.174783:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb079176d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1875689374533120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788796997.174809:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb079176d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1875689374533120:12345-0@lo:400:kworker.0 Request processed in 27us (1442us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796997.174815:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1788796997.175098:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1788796997.175106:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0796c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875689374532992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788796997.175141:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0796c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875689374532992:12345-0@lo:400:kworker.0 Request processed in 37us (1272us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796997.175146:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00080000:1.0:1788796997.175164:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788796997.175183:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb077920380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3303:1875689374532992:0@lo:400:kworker.0 00000100:00100000:1.0:1788796997.175754:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb04982dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3301:1875689374533120:0@lo:400:kworker.0 00000100:00100000:1.0:1788796997.175767:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb077920700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3301:1875689374532736:0@lo:400:kworker.0 00000100:00100000:1.0:1788796997.176772:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788796997.176787:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb079174e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875689374532480:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788796997.176858:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788796997.177010:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb079174e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875689374532480:12345-0@lo:13:osp-pre-1-0.0 Request processed in 229us (6451us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796997.177018:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:2.0:1788796997.187545:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cb079174380 x1875689374532480/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788797013 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788796997.187581:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb079174380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875689374532480:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788796997.207617:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1788796997.207787:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351429376 00000100:00100000:2.0:1788796997.207804:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351429376 00000100:00100000:2.0:1788796997.207903:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 234 00000100:00100000:2.0:1788796997.207915:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb060706850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4d9d1a9-601d-459e-8721-8bfc2fdde84f+11:5611:x1875689351429376:12345-192.168.204.38@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788796997.207934:0:5820:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788796997.207954:0:5820:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cb041485200/0xca7fc0c411f935f7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7c99e04559ee0f9b expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796997.208002:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cb041485200/0xca7fc0c411f935f7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee0f9b expref: 12 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796997.208015:0:5820:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cb041485200/0xca7fc0c411f935f7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee0f9b expref: 12 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796997.208059:0:5820:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb041485200, rc 0) 00000100:00100000:2.0:1788796997.208113:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb060706850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4d9d1a9-601d-459e-8721-8bfc2fdde84f+12:5611:x1875689351429376:12345-192.168.204.38@tcp:101:ll_cfg_requeue.0 Request processed in 200us (508us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796997.208120:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 234 00000100:00100000:0.0:1788796997.228327:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1788796997.228632:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351429504 00000100:00100000:1.0:1788796997.228646:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351429504 00000100:00100000:1.0:1788796997.228720:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 235 00000100:00100000:1.0:1788796997.228731:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb060707c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4d9d1a9-601d-459e-8721-8bfc2fdde84f+12:5611:x1875689351429504:12345-192.168.204.38@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788796997.230577:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb060707c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4d9d1a9-601d-459e-8721-8bfc2fdde84f+12:5611:x1875689351429504:12345-192.168.204.38@tcp:501:ll_cfg_requeue.0 Request processed in 1832us (2249us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796997.230593:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 235 00000100:00100000:0.0:1788796997.246968:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1788796997.247242:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351429632 00000100:00100000:2.0:1788796997.247253:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351429632 00000100:00100000:2.0:1788796997.247308:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 236 00000100:00100000:2.0:1788796997.247318:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb060704850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4d9d1a9-601d-459e-8721-8bfc2fdde84f+12:5611:x1875689351429632:12345-192.168.204.38@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788796997.249153:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb060704850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4d9d1a9-601d-459e-8721-8bfc2fdde84f+12:5611:x1875689351429632:12345-192.168.204.38@tcp:503:ll_cfg_requeue.0 Request processed in 1826us (2187us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796997.249168:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 236 00000100:00100000:0.0:1788796997.267734:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1788796997.268140:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351429760 00000100:00100000:1.0:1788796997.268151:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351429760 00000100:00100000:1.0:1788796997.268207:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 237 00000100:00100000:1.0:1788796997.268218:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb060706050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4d9d1a9-601d-459e-8721-8bfc2fdde84f+12:5611:x1875689351429760:12345-192.168.204.38@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788796997.268237:0:5819:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788796997.268254:0:5819:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cb0821f0e00/0xca7fc0c411f935fe lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x7c99e04559ee0fa2 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796997.268282:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cb0821f0e00/0xca7fc0c411f935fe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee0fa2 expref: 13 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796997.268294:0:5819:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cb0821f0e00/0xca7fc0c411f935fe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee0fa2 expref: 13 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796997.268303:0:5819:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb0821f0e00, rc 0) 00000100:00100000:1.0:1788796997.268469:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb060706050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4d9d1a9-601d-459e-8721-8bfc2fdde84f+13:5611:x1875689351429760:12345-192.168.204.38@tcp:101:ll_cfg_requeue.0 Request processed in 252us (756us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796997.268492:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 237 00000100:00100000:0.0:1788796997.275213:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1788796997.275985:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351429888 00000100:00100000:3.0:1788796997.275996:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351429888 00000100:00100000:3.0:1788796997.276079:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 238 00000100:00100000:3.0:1788796997.276092:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb060707450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4d9d1a9-601d-459e-8721-8bfc2fdde84f+13:5611:x1875689351429888:12345-192.168.204.38@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788796997.276671:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb060707450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4d9d1a9-601d-459e-8721-8bfc2fdde84f+13:5611:x1875689351429888:12345-192.168.204.38@tcp:501:ll_cfg_requeue.0 Request processed in 579us (1465us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796997.276680:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 238 00000100:00100000:3.0:1788796997.282522:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1788796997.282609:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351430016 00000100:00100000:0.0:1788796997.282622:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351430016 00000100:00100000:0.0:1788796997.282691:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 239 00000100:00100000:0.0:1788796997.282703:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb060705850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4d9d1a9-601d-459e-8721-8bfc2fdde84f+13:5611:x1875689351430016:12345-192.168.204.38@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788796997.283012:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb060705850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4d9d1a9-601d-459e-8721-8bfc2fdde84f+13:5611:x1875689351430016:12345-192.168.204.38@tcp:503:ll_cfg_requeue.0 Request processed in 311us (501us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796997.283022:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 239 00010000:00010000:3.0:1788796997.426792:0:5815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788796997.619315:0:5822:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788796997.619324:0:5822:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8cb042fd2800 from 7 10000000:01000000:0.0:1788796997.619330:0:5822:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788796997.619383:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.138@tcp lock: ffff8cb079b81400/0xca7fc0c411f93605 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796997.619398:0:5822:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.138@tcp lock: ffff8cb079b81400/0xca7fc0c411f93605 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796997.619412:0:5822:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.138@tcp lock: ffff8cb079b81400/0xca7fc0c411f93605 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788796997.619452:0:5822:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb04982e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:5822:1875689374533248:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788796997.619529:0:5822:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788796997.619589:0:5822:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb069af33c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788796997.623061:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374533248 00000100:00100000:2.0:1788796997.623073:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374533248 00000100:00100000:2.0:1788796997.623139:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:2.0:1788796997.623150:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb060705050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+16:5822:x1875689374533248:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788796997.623167:0:5818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788796997.623185:0:5818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cb041484800/0xca7fc0c411f9360c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xca7fc0c411f93605 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796997.623214:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cb041484800/0xca7fc0c411f9360c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xca7fc0c411f93605 expref: 17 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796997.623226:0:5818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cb041484800/0xca7fc0c411f9360c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xca7fc0c411f93605 expref: 17 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796997.623235:0:5818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb041484800, rc 0) 00000100:00100000:2.0:1788796997.623315:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb060705050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+17:5822:x1875689374533248:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 167us (3785us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796997.623322:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:2.0:1788796997.623384:0:5822:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb04982e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:5822:1875689374533248:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788796997.623406:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.138@tcp lock: ffff8cb079b81400/0xca7fc0c411f93605 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xca7fc0c411f9360c expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796997.623417:0:5822:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.138@tcp lock: ffff8cb079b81400/0xca7fc0c411f93605 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xca7fc0c411f9360c expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788796997.623496:0:5822:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb079174380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:5822:1875689374533376:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788796997.623528:0:5822:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788796997.623562:0:5822:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb077d10240 going to sleep for 11 seconds 00000100:00100000:0.0:1788796997.623633:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374533376 00000100:00100000:0.0:1788796997.623639:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374533376 00000100:00100000:0.0:1788796997.623671:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:0.0:1788796997.623679:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb051758c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+17:5822:x1875689374533376:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788796997.623941:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb051758c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+17:5822:x1875689374533376:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 263us (413us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796997.623949:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:2.0:1788796997.625802:0:5822:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb079174380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:5822:1875689374533376:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788796997.626223:0:5822:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb079174380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:5822:1875689374533504:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788796997.626296:0:5822:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788796997.626327:0:5822:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb077d10240 going to sleep for 11 seconds 00000100:00100000:0.0:1788796997.628207:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374533504 00000100:00100000:0.0:1788796997.628228:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374533504 00000100:00100000:0.0:1788796997.628311:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:0.0:1788796997.628322:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb051758450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+17:5822:x1875689374533504:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788796997.628588:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb051758450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+17:5822:x1875689374533504:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 268us (2291us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796997.628595:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:2.0:1788796997.633695:0:5822:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb079174380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:5822:1875689374533504:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788796997.639157:0:11188:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1788796997.639349:0:5822:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1788796997.639368:0:5822:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.138@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788796997.639378:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.138@tcp lock: ffff8cb079b81400/0xca7fc0c411f93605 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xca7fc0c411f9360c expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796997.639391:0:5822:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.138@tcp lock: ffff8cb079b81400/0xca7fc0c411f93605 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xca7fc0c411f9360c expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788796997.639401:0:5822:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788796997.639404:0:5822:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8cb042fda000 from 7 10000000:01000000:3.0:1788796997.639407:0:5822:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788796997.639449:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.138@tcp lock: ffff8cb080436a00/0xca7fc0c411f93613 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796997.639473:0:5822:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.138@tcp lock: ffff8cb080436a00/0xca7fc0c411f93613 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796997.639487:0:5822:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.138@tcp lock: ffff8cb080436a00/0xca7fc0c411f93613 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788796997.639515:0:5822:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb080474e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:5822:1875689374533632:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788796997.639581:0:5822:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796997.639629:0:5822:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb042e160c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788796997.640445:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374533632 00000100:00100000:0.0:1788796997.640456:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374533632 00000100:00100000:0.0:1788796997.640504:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:0.0:1788796997.640514:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb05175ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+17:5822:x1875689374533632:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788796997.640530:0:5818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788796997.640545:0:5818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cb079b81800/0xca7fc0c411f9361a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xca7fc0c411f93613 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796997.640584:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cb079b81800/0xca7fc0c411f9361a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xca7fc0c411f93613 expref: 18 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796997.640595:0:5818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cb079b81800/0xca7fc0c411f9361a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xca7fc0c411f93613 expref: 18 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796997.640603:0:5818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb079b81800, rc 0) 00000100:00100000:0.0:1788796997.640665:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb05175ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+18:5822:x1875689374533632:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 152us (1083us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796997.640672:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:3.0:1788796997.640775:0:5822:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb080474e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:5822:1875689374533632:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788796997.640794:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.138@tcp lock: ffff8cb080436a00/0xca7fc0c411f93613 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xca7fc0c411f9361a expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796997.640804:0:5822:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.138@tcp lock: ffff8cb080436a00/0xca7fc0c411f93613 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xca7fc0c411f9361a expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788796997.640887:0:5822:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb080474e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:5822:1875689374533760:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788796997.640919:0:5822:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796997.640957:0:5822:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb042e160c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788796997.641004:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374533760 00000100:00100000:0.0:1788796997.641009:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374533760 00000100:00100000:0.0:1788796997.641061:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:0.0:1788796997.641069:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb051759450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+18:5822:x1875689374533760:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788796997.641328:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb051759450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+18:5822:x1875689374533760:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 260us (408us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796997.641335:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:3.0:1788796997.641415:0:5822:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb080474e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:5822:1875689374533760:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788796997.641445:0:5822:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb080474e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:5822:1875689374533888:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788796997.641484:0:5822:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796997.641512:0:5822:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb042e160c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788796997.645161:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374533888 00000100:00100000:0.0:1788796997.645182:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374533888 00000100:00100000:0.0:1788796997.645265:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:0.0:1788796997.645277:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb051758850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+18:5822:x1875689374533888:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788796997.645530:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb051758850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+18:5822:x1875689374533888:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 255us (4044us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796997.645537:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:3.0:1788796997.645641:0:5822:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb080474e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:5822:1875689374533888:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788796997.650880:0:11190:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1788796997.651322:0:5822:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1788796997.651347:0:5822:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.138@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788796997.651371:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.138@tcp lock: ffff8cb080436a00/0xca7fc0c411f93613 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xca7fc0c411f9361a expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796997.651383:0:5822:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.138@tcp lock: ffff8cb080436a00/0xca7fc0c411f93613 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xca7fc0c411f9361a expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788796997.651395:0:5822:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788796997.651398:0:5822:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8cb042f0b000 from 7 10000000:01000000:0.0:1788796997.651401:0:5822:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788796997.651447:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.138@tcp lock: ffff8cb079b80c00/0xca7fc0c411f93621 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796997.651458:0:5822:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.138@tcp lock: ffff8cb079b80c00/0xca7fc0c411f93621 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796997.651470:0:5822:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.138@tcp lock: ffff8cb079b80c00/0xca7fc0c411f93621 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788796997.651501:0:5822:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb04982fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:5822:1875689374534016:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788796997.651573:0:5822:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788796997.651631:0:5822:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb069af3540 going to sleep for 11 seconds 00000100:00100000:1.0:1788796997.651872:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374534016 00000100:00100000:1.0:1788796997.651881:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374534016 00000100:00100000:1.0:1788796997.651943:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:1.0:1788796997.651954:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0465dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+18:5822:x1875689374534016:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788796997.651971:0:5818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788796997.651987:0:5818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cb0821f0a00/0xca7fc0c411f93628 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xca7fc0c411f93621 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796997.652016:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cb0821f0a00/0xca7fc0c411f93628 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xca7fc0c411f93621 expref: 19 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796997.652088:0:5818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cb0821f0a00/0xca7fc0c411f93628 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xca7fc0c411f93621 expref: 19 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796997.652101:0:5818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb0821f0a00, rc 0) 00000100:00100000:1.0:1788796997.652163:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0465dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+19:5822:x1875689374534016:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 211us (589us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796997.652170:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:2.0:1788796997.652274:0:5822:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb04982fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:5822:1875689374534016:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788796997.652292:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.138@tcp lock: ffff8cb079b80c00/0xca7fc0c411f93621 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xca7fc0c411f93628 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796997.652303:0:5822:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.138@tcp lock: ffff8cb079b80c00/0xca7fc0c411f93621 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xca7fc0c411f93628 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788796997.652369:0:5822:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb079174380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:5822:1875689374534144:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788796997.652397:0:5822:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788796997.652419:0:5822:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb0484ffa80 going to sleep for 11 seconds 00000100:00100000:0.0:1788796997.652522:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374534144 00000100:00100000:0.0:1788796997.652527:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374534144 00000100:00100000:0.0:1788796997.652561:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:0.0:1788796997.652567:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0465dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+19:5822:x1875689374534144:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788796997.652897:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0465dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+19:5822:x1875689374534144:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 328us (497us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796997.652904:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:2.0:1788796997.652987:0:5822:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb079174380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:5822:1875689374534144:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788796997.653018:0:5822:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb079174380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:5822:1875689374534272:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788796997.653083:0:5822:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788796997.653098:0:5822:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb0484ffa80 going to sleep for 11 seconds 00000100:00100000:0.0:1788796997.653354:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374534272 00000100:00100000:0.0:1788796997.653365:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374534272 00000100:00100000:0.0:1788796997.653395:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:0.0:1788796997.653402:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0465dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+19:5822:x1875689374534272:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788796997.653537:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0465dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+19:5822:x1875689374534272:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 134us (452us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796997.653543:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00100000:2.0:1788796997.653650:0:5822:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb079174380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:5822:1875689374534272:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788796997.662541:0:11191:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1788796997.662717:0:5822:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1788796997.662737:0:5822:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.138@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788796997.662750:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.138@tcp lock: ffff8cb079b80c00/0xca7fc0c411f93621 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xca7fc0c411f93628 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796997.662764:0:5822:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.138@tcp lock: ffff8cb079b80c00/0xca7fc0c411f93621 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xca7fc0c411f93628 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796998.451789:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788796999.475244:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788797000.498910:0:5815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788797000.611399:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1788797000.611453:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1788797000.611484:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1788797000.611519:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351430272 00000100:00100000:3.0:1788797000.611529:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351430272 00000100:00100000:3.0:1788797000.611594:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351430400 00000100:00100000:3.0:1788797000.611597:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351430400 00000100:00100000:3.0:1788797000.611627:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 98 00000100:00100000:3.0:1788797000.611637:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb080474e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6d050bb-169e-4784-be5b-7071799bf3b0+6:2353:x1875689351430272:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:3.0:1788797000.611730:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb080474e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6d050bb-169e-4784-be5b-7071799bf3b0+6:2353:x1875689351430272:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 95us (276us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797000.611738:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 98 00000100:00100000:3.0:1788797000.613324:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 99 00000100:00100000:3.0:1788797000.613341:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb080475f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed124ec0-b908-4000-b768-8e53d5def0fc+5:2352:x1875689351430400:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:3.0:1788797000.613655:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb080475f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed124ec0-b908-4000-b768-8e53d5def0fc+5:2352:x1875689351430400:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 78us (1928us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797000.613663:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 99 00000100:00080000:3.0:1788797000.613697:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788797000.614054:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351430144 00000100:00100000:1.0:1788797000.614063:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351430144 00000100:00100000:1.0:1788797000.614111:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 249 00000100:00100000:1.0:1788797000.614120:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0465dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4d9d1a9-601d-459e-8721-8bfc2fdde84f+13:2353:x1875689351430144:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:1.0:1788797000.614169:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0465dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4d9d1a9-601d-459e-8721-8bfc2fdde84f+13:2353:x1875689351430144:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 50us (2782us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797000.614189:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 249 00000001:02000400:2.0:1788797001.434930:0:11362:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg438-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1788797001.530572:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788797001.780127:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788797001.780163:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb0796c7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875689374534400:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788797001.780239:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788797001.780467:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374534400 00000100:00100000:1.0:1788797001.780475:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374534400 00000100:00100000:1.0:1788797001.780532:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788797001.780542:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb04982ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1875689374534400:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788797001.780572:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788797001.780617:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb04982ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1875689374534400:12345-0@lo:13:osp-pre-0-0.0 Request processed in 77us (378us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797001.780624:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00010000:00080000:1.0:1788797001.780659:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cb0796c7100 x1875689374534400/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788797017 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788797001.780678:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb0796c7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875689374534400:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788797001.780810:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788797002.290859:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb079175c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3300:1875689374534784:0@lo:400:kworker.0 00000100:00100000:2.0:1788797002.290872:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb079177100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875689374534912:0@lo:400:kworker.0 00000100:00100000:0.0:1788797002.290949:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb080477100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875689374534656:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788797002.291050:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb079174380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:3302:1875689374534528:0@lo:400:kworker.0 00000100:00100000:3.0:1788797002.307837:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788797002.307929:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb077922300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875689374535296:0@lo:400:kworker.0 00000100:00100000:3.0:1788797002.307989:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788797002.308058:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374534784 00000100:00100000:3.0:1788797002.308066:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374534784 00000100:00100000:3.0:1788797002.308112:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1788797002.308130:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb080477800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1875689374534784:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788797002.308201:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb080477800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1875689374534784:12345-0@lo:400:kworker.0 Request processed in 73us (372us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797002.308209:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1788797002.308232:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374535296 00000100:00100000:3.0:1788797002.308235:0:6683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374535296 00000100:00100000:3.0:1788797002.308270:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788797002.308278:0:6683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb080475500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3300:x1875689374535296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788797002.308308:0:6683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb080475500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3300:x1875689374535296:12345-0@lo:400:kworker.0 Request processed in 32us (319us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797002.308314:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00080000:3.0:1788797002.308335:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1788797002.308360:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cb077922300 x1875689374535296/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788797018 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788797002.308374:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb077922300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875689374535296:0@lo:400:kworker.0 00000100:00100000:3.0:1788797002.308400:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb079175c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3300:1875689374534784:0@lo:400:kworker.0 00000100:00100000:0.0:1788797002.309605:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788797002.309657:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb077920380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3303:1875689374535168:0@lo:400:kworker.0 00000100:00100000:0.0:1788797002.309688:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788797002.309860:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374535168 00000100:00100000:0.0:1788797002.309867:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374535168 00000100:00100000:0.0:1788797002.309917:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1788797002.309925:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb04982fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1875689374535168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788797002.309975:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb04982fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1875689374535168:12345-0@lo:400:kworker.0 Request processed in 51us (285us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797002.309994:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00080000:0.0:1788797002.310019:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788797002.310060:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb077920380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3303:1875689374535168:0@lo:400:kworker.0 00000100:00100000:3.0:1788797002.316182:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374534656 00000100:00100000:3.0:1788797002.316200:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374534656 00000100:00100000:3.0:1788797002.316256:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788797002.316267:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb04982d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875689374534656:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788797002.316302:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788797002.316394:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb04982d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875689374534656:12345-0@lo:13:osp-pre-1-0.0 Request processed in 129us (6793us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797002.316401:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00080000:0.0:1788797002.316676:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cb080477100 x1875689374534656/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788797018 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788797002.316697:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb080477100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875689374534656:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788797002.317246:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788797002.317423:0:10829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374534912 00000100:00100000:3.0:1788797002.317430:0:10829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374534912 00000100:00100000:3.0:1788797002.317476:0:10829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788797002.317500:0:10829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb077922d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3301:x1875689374534912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788797002.317561:0:10829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb077922d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3301:x1875689374534912:12345-0@lo:400:kworker.0 Request processed in 63us (316us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797002.317568:0:10829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788797002.318290:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788797002.318331:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb077920700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3302:1875689374535040:0@lo:400:kworker.0 00000100:00100000:1.0:1788797002.318534:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788797002.318912:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374535040 00000100:00100000:0.0:1788797002.318918:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374535040 00000100:00100000:0.0:1788797002.318968:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1788797002.318975:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0796c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1875689374535040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788797002.319056:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0796c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1875689374535040:12345-0@lo:400:kworker.0 Request processed in 81us (521us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797002.319063:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00010000:00080000:2.0:1788797002.319257:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cb079177100 x1875689374534912/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788797018 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788797002.319270:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb079177100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875689374534912:0@lo:400:kworker.0 00000100:00100000:3.0:1788797002.320259:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374534528 00000100:00100000:3.0:1788797002.320268:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374534528 00000100:00100000:3.0:1788797002.320328:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:3.0:1788797002.320339:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0465de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+19:3302:x1875689374534528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788797002.320401:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0465de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+19:3302:x1875689374534528:12345-0@lo:400:kworker.0 Request processed in 64us (2111us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797002.320407:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00080000:1.0:1788797002.321202:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788797002.321239:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb079174380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:3302:1875689374534528:0@lo:400:kworker.0 00000100:00100000:1.0:1788797002.321255:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb077920700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3302:1875689374535040:0@lo:400:kworker.0 00010000:00010000:1.0:1788797002.546363:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788797003.571415:0:5815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788797004.606687:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788797005.620368:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788797005.723920:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1788797005.723956:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1788797005.723991:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1788797005.724123:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351430784 00000100:00100000:2.0:1788797005.724135:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351430784 00000100:00100000:2.0:1788797005.724211:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351430656 00000100:00100000:2.0:1788797005.724215:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351430656 00000100:00100000:2.0:1788797005.724241:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 103 00000100:00100000:2.0:1788797005.724251:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb080477480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed124ec0-b908-4000-b768-8e53d5def0fc+5:2355:x1875689351430784:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:2.0:1788797005.724329:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb080477480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed124ec0-b908-4000-b768-8e53d5def0fc+5:2355:x1875689351430784:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 77us (371us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797005.724336:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 103 00000100:00100000:2.0:1788797005.724353:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 104 00000100:00100000:2.0:1788797005.724360:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb080476a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6d050bb-169e-4784-be5b-7071799bf3b0+6:2355:x1875689351430656:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:2.0:1788797005.724384:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb080476a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6d050bb-169e-4784-be5b-7071799bf3b0+6:2355:x1875689351430656:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 25us (393us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797005.724390:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 104 00000100:00080000:3.0:1788797005.724513:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788797005.724947:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351430528 00000100:00100000:1.0:1788797005.724954:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351430528 00000100:00100000:1.0:1788797005.724996:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 251 00000100:00100000:1.0:1788797005.725067:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0465df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4d9d1a9-601d-459e-8721-8bfc2fdde84f+13:2355:x1875689351430528:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:1.0:1788797005.725116:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0465df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4d9d1a9-601d-459e-8721-8bfc2fdde84f+13:2355:x1875689351430528:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 88us (1208us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797005.725123:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 251 00000001:02000400:3.0:1788797005.949524:0:11461:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 12:03:24 (1788797004) === 00000100:00100000:3.0:1788797006.375142:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1788797006.375193:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1788797006.375361:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351430912 00000100:00100000:2.0:1788797006.375372:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351430912 00000100:00100000:2.0:1788797006.375440:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 14 00000100:00100000:2.0:1788797006.375454:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb080474000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6d050bb-169e-4784-be5b-7071799bf3b0+6:2352:x1875689351430912:12345-192.168.204.38@tcp:41:mkdir.0 00000004:00000024:2.0:1788797006.375508:0:5827:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1788797006.375626:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb080474000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6d050bb-169e-4784-be5b-7071799bf3b0+6:2352:x1875689351430912:12345-192.168.204.38@tcp:41:mkdir.0 Request processed in 175us (493us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797006.375651:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 14 00000100:00100000:0.0:1788797006.375803:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351431040 00000100:00100000:0.0:1788797006.375808:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351431040 00000100:00100000:0.0:1788797006.375845:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 0 00000100:00100000:0.0:1788797006.375852:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb080475180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:e6d050bb-169e-4784-be5b-7071799bf3b0+6:9710:x1875689351431040:12345-192.168.204.38@tcp:700:mkdir.0 00000100:00100000:0.0:1788797006.375889:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb080475180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:e6d050bb-169e-4784-be5b-7071799bf3b0+6:9710:x1875689351431040:12345-192.168.204.38@tcp:700:mkdir.0 Request processed in 38us (695us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797006.375896:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 0 00000100:00100000:2.0:1788797006.386590:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1788797006.386781:0:7636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351431296 00000100:00100000:0.0:1788797006.386796:0:7636:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351431296 00000100:00100000:0.0:1788797006.386875:0:7636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 15 00000100:00100000:0.0:1788797006.386886:0:7636:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb077923800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6d050bb-169e-4784-be5b-7071799bf3b0+6:9710:x1875689351431296:12345-192.168.204.38@tcp:36:mkdir.0 00010000:00010000:0.0:1788797006.386978:0:7636:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788797006.387081:0:7636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb079b80000/0xca7fc0c411f93510 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee0f24 expref: 6 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797006.387105:0:7636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cb058766b00) 00010000:00010000:0.0:1788797006.387120:0:7636:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788797006.387497:0:7636:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb079b80e00/0xca7fc0c411f9362f lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797006.387512:0:7636:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb079b80e00/0xca7fc0c411f9362f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797006.387523:0:7636:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb079b80e00/0xca7fc0c411f9362f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797006.387556:0:7636:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb079b81e00/0xca7fc0c411f93636 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797006.387565:0:7636:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb079b81e00/0xca7fc0c411f93636 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797006.387572:0:7636:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb079b81e00/0xca7fc0c411f93636 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788797006.388875:0:7636:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:0.0:1788797006.388890:0:7636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb079b80e00/0xca7fc0c411f9362f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797006.388898:0:7636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb079b80e00/0xca7fc0c411f9362f lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797006.388905:0:7636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb079b80e00/0xca7fc0c411f9362f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797006.388916:0:7636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb079b80e00 already unused, calling callback (ffffffffc1f014f0) 00010000:00010000:0.0:1788797006.388920:0:7636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb079b80e00/0xca7fc0c411f9362f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797006.388928:0:7636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb079b80e00/0xca7fc0c411f9362f lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797006.388941:0:7636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cb058766700) 00010000:00010000:0.0:1788797006.388945:0:7636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788797006.388949:0:7636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb079b80e00/0xca7fc0c411f9362f lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797006.388955:0:7636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb079b80e00/0xca7fc0c411f9362f lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788797006.388972:0:7636:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a20e6e11 reply state 000000008da058a1 transno 4294967297 ns: mdt-lustre-MDT0000_UUID lock: ffff8cb079b81e00/0xca7fc0c411f93636 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788797006.388981:0:7636:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788797006.389132:0:7636:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb077923800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6d050bb-169e-4784-be5b-7071799bf3b0+7:9710:x1875689351431296:12345-192.168.204.38@tcp:36:mkdir.0 Request processed in 2246us (2553us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1788797006.389142:0:7636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 15 00010000:00010000:3.0:1788797006.392411:0:3286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb079b81e00/0xca7fc0c411f93636 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797006.392432:0:3286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb079b81e00/0xca7fc0c411f93636 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797006.392440:0:3286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb079b81e00/0xca7fc0c411f93636 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797006.392447:0:3286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb079b81e00 already unused, calling callback (ffffffffc1f014f0) 00010000:00010000:3.0:1788797006.392468:0:3286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb079b81e00/0xca7fc0c411f93636 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797006.392477:0:3286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb079b81e00/0xca7fc0c411f93636 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797006.392497:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8cb058766400) 00010000:00010000:3.0:1788797006.392500:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788797006.392506:0:3286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb079b81e00/0xca7fc0c411f93636 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797006.392512:0:3286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb079b81e00/0xca7fc0c411f93636 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788797006.409770:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1788797006.410499:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351431424 00000100:00100000:0.0:1788797006.410510:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351431424 00000100:00100000:0.0:1788797006.410574:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 16 00000100:00100000:0.0:1788797006.410585:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb077920a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6d050bb-169e-4784-be5b-7071799bf3b0+6:9711:x1875689351431424:12345-192.168.204.38@tcp:101:chmod.0 00010000:00010000:0.0:1788797006.410743:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788797006.410767:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb079b80e00/0xca7fc0c411f9363d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c99e04559ee0fa9 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797006.411249:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb079b80000/0xca7fc0c411f93644 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797006.411270:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb079b80000/0xca7fc0c411f93644 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797006.411285:0:5827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb079b80000/0xca7fc0c411f93644 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788797006.411327:0:5827:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788797006.411331:0:5827:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788797006.411443:0:5827:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cb079b80000/0xca7fc0c411f93644 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797006.411471:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb079b80e00/0xca7fc0c411f9363d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee0fa9 expref: 8 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797006.411488:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb079b80000/0xca7fc0c411f93644 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee0fa9 expref: 7 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797006.411497:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cb058766700) 00010000:00010000:0.0:1788797006.411500:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788797006.411503:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb079b80000, rc 0) 00000100:00100000:0.0:1788797006.411635:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb077920a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6d050bb-169e-4784-be5b-7071799bf3b0+7:9711:x1875689351431424:12345-192.168.204.38@tcp:101:chmod.0 Request processed in 1051us (1872us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797006.411643:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 16 00000100:00100000:1.0:1788797006.420542:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1788797006.420836:0:7636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351431680 00000100:00100000:0.0:1788797006.420848:0:7636:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351431680 00000100:00100000:0.0:1788797006.420928:0:7636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 17 00000100:00100000:0.0:1788797006.420938:0:7636:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0796c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6d050bb-169e-4784-be5b-7071799bf3b0+7:9711:x1875689351431680:12345-192.168.204.38@tcp:36:chmod.0 00010000:00010000:0.0:1788797006.420996:0:7636:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788797006.421221:0:7636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb079b80000/0xca7fc0c411f93644 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee0fa9 expref: 7 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797006.421239:0:7636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cb058766700) 00010000:00010000:0.0:1788797006.421249:0:7636:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788797006.421275:0:7636:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb079b80e00/0xca7fc0c411f9364b lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797006.421287:0:7636:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb079b80e00/0xca7fc0c411f9364b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797006.421297:0:7636:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb079b80e00/0xca7fc0c411f9364b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788797006.421977:0:7636:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b867d461 reply state 000000006f1680a7 transno 4294967298 ns: mdt-lustre-MDT0000_UUID lock: ffff8cb079b80e00/0xca7fc0c411f9364b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788797006.422429:0:7636:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1788797006.422442:0:7636:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:0.0:1788797006.422558:0:7636:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0796c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6d050bb-169e-4784-be5b-7071799bf3b0+8:9711:x1875689351431680:12345-192.168.204.38@tcp:36:chmod.0 Request processed in 1619us (2023us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1788797006.422568:0:7636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 17 00010000:00010000:0.0:1788797006.428395:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb079b80e00/0xca7fc0c411f9364b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797006.428417:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb079b80e00/0xca7fc0c411f9364b lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797006.428446:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb079b80e00/0xca7fc0c411f9364b lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797006.428453:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb079b80e00 already unused, calling callback (ffffffffc1f014f0) 00010000:00010000:0.0:1788797006.428458:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb079b80e00/0xca7fc0c411f9364b lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797006.428467:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb079b80e00/0xca7fc0c411f9364b lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797006.428490:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cb058766b00) 00010000:00010000:0.0:1788797006.428493:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788797006.428499:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb079b80e00/0xca7fc0c411f9364b lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797006.428505:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb079b80e00/0xca7fc0c411f9364b lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788797006.463962:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1788797006.464432:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351431808 00000100:00100000:3.0:1788797006.464443:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351431808 00000100:00100000:3.0:1788797006.464545:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 18 00000100:00100000:3.0:1788797006.464557:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0796c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6d050bb-169e-4784-be5b-7071799bf3b0+7:9712:x1875689351431808:12345-192.168.204.38@tcp:101:chown.0 00010000:00010000:3.0:1788797006.464782:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788797006.464813:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080437a00/0xca7fc0c411f93652 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c99e04559ee0fb0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797006.464898:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080437e00/0xca7fc0c411f93659 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797006.464912:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080437e00/0xca7fc0c411f93659 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797006.464924:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080437e00/0xca7fc0c411f93659 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788797006.464979:0:5825:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788797006.464983:0:5825:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788797006.465264:0:5825:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080437e00/0xca7fc0c411f93659 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797006.465310:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080437a00/0xca7fc0c411f93652 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee0fb0 expref: 9 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797006.465329:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080437e00/0xca7fc0c411f93659 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee0fb0 expref: 8 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797006.465839:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cb065cc2c00) 00010000:00010000:3.0:1788797006.465845:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788797006.465851:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb080437e00, rc 0) 00000100:00100000:3.0:1788797006.465934:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0796c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6d050bb-169e-4784-be5b-7071799bf3b0+8:9712:x1875689351431808:12345-192.168.204.38@tcp:101:chown.0 Request processed in 1376us (2351us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797006.465945:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 18 00000100:00100000:1.0:1788797006.469546:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1788797006.469722:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351431936 00000100:00100000:0.0:1788797006.469734:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351431936 00000100:00100000:0.0:1788797006.469809:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19 00000100:00100000:0.0:1788797006.469822:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0796c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6d050bb-169e-4784-be5b-7071799bf3b0+8:9712:x1875689351431936:12345-192.168.204.38@tcp:101:chown.0 00010000:00010000:0.0:1788797006.469846:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788797006.469868:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb079b80e00/0xca7fc0c411f93660 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c99e04559ee0fb7 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797006.469940:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb079b80000/0xca7fc0c411f93667 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797006.469953:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb079b80000/0xca7fc0c411f93667 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797006.469978:0:5826:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb079b80000/0xca7fc0c411f93667 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797006.469995:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb079b81e00/0xca7fc0c411f9366e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797006.470014:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb079b81e00/0xca7fc0c411f9366e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797006.470057:0:5826:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb079b81e00/0xca7fc0c411f9366e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797006.470166:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2c00/0xca7fc0c411f93675 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797006.470175:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2c00/0xca7fc0c411f93675 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797006.470183:0:5826:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2c00/0xca7fc0c411f93675 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788797006.470214:0:5826:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788797006.470219:0:5826:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788797006.470241:0:5826:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2c00/0xca7fc0c411f93675 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797006.470253:0:5826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb079b80000/0xca7fc0c411f93667 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797006.470260:0:5826:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb079b80000/0xca7fc0c411f93667 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797006.470278:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb079b80000/0xca7fc0c411f93667 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797006.470284:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb079b80000 already unused, calling callback (ffffffffc1f014f0) 00010000:00010000:0.0:1788797006.470290:0:5826:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb079b80000/0xca7fc0c411f93667 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797006.470300:0:5826:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb079b80000/0xca7fc0c411f93667 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797006.470315:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cb065cc2c00) 00010000:00010000:0.0:1788797006.470319:0:5826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788797006.470325:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb079b80000/0xca7fc0c411f93667 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797006.470332:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb079b80000/0xca7fc0c411f93667 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797006.470349:0:5826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb079b81e00/0xca7fc0c411f9366e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797006.470355:0:5826:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb079b81e00/0xca7fc0c411f9366e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797006.470361:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb079b81e00/0xca7fc0c411f9366e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797006.470367:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb079b81e00 already unused, calling callback (ffffffffc1f014f0) 00010000:00010000:0.0:1788797006.470369:0:5826:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb079b81e00/0xca7fc0c411f9366e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797006.470385:0:5826:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb079b81e00/0xca7fc0c411f9366e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797006.470394:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8cb058766b00) 00010000:00010000:0.0:1788797006.470396:0:5826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788797006.470400:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb079b81e00/0xca7fc0c411f9366e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797006.470406:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb079b81e00/0xca7fc0c411f9366e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797006.470440:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb079b80e00/0xca7fc0c411f93660 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee0fb7 expref: 10 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797006.470455:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2c00/0xca7fc0c411f93675 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee0fb7 expref: 9 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797006.470463:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8cb058766700) 00010000:00010000:0.0:1788797006.470465:0:5826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788797006.470467:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb042ea2c00, rc 0) 00000100:00100000:0.0:1788797006.470541:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0796c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6d050bb-169e-4784-be5b-7071799bf3b0+9:9712:x1875689351431936:12345-192.168.204.38@tcp:101:chown.0 Request processed in 721us (1009us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797006.470550:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19 00000100:00100000:1.0:1788797006.476001:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1788797006.476252:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351432192 00000100:00100000:0.0:1788797006.476268:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351432192 00000100:00100000:0.0:1788797006.476337:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 20 00000100:00100000:0.0:1788797006.476350:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0796c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6d050bb-169e-4784-be5b-7071799bf3b0+9:9712:x1875689351432192:12345-192.168.204.38@tcp:36:chown.0 00010000:00010000:0.0:1788797006.476427:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788797006.476481:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2c00/0xca7fc0c411f93675 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee0fb7 expref: 9 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797006.476505:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8cb058766700) 00010000:00010000:0.0:1788797006.476521:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788797006.476554:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2200/0xca7fc0c411f9367c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797006.476571:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2200/0xca7fc0c411f9367c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797006.476594:0:5827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2200/0xca7fc0c411f9367c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788797006.535514:0:5827:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006435d8e0 reply state 0000000078ccc67f transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2200/0xca7fc0c411f9367c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788797006.535533:0:5827:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1788797006.535548:0:5827:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000100:00100000:0.0:1788797006.535653:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0796c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6d050bb-169e-4784-be5b-7071799bf3b0+10:9712:x1875689351432192:12345-192.168.204.38@tcp:36:chown.0 Request processed in 59302us (59665us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1788797006.535662:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 20 00000001:00080000:3.0:1788797006.535758:0:5848:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967299 is committed 00010000:00010000:0.0:1788797006.535815:0:3286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2200/0xca7fc0c411f9367c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797006.535823:0:3286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2200/0xca7fc0c411f9367c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797006.535831:0:3286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2200/0xca7fc0c411f9367c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797006.535837:0:3286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb042ea2200 already unused, calling callback (ffffffffc1f014f0) 00010000:00010000:0.0:1788797006.535858:0:3286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2200/0xca7fc0c411f9367c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797006.535868:0:3286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2200/0xca7fc0c411f9367c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797006.535884:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8cb058766300) 00010000:00010000:0.0:1788797006.535887:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788797006.535892:0:3286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2200/0xca7fc0c411f9367c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797006.535899:0:3286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2200/0xca7fc0c411f9367c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788797006.562261:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1788797006.562532:0:7636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351432320 00000100:00100000:2.0:1788797006.562543:0:7636:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351432320 00000100:00100000:2.0:1788797006.562624:0:7636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 21 00000100:00100000:2.0:1788797006.562636:0:7636:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0796c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6d050bb-169e-4784-be5b-7071799bf3b0+6:9713:x1875689351432320:12345-192.168.204.38@tcp:101:touch.500 00010000:00010000:2.0:1788797006.562846:0:7636:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788797006.562870:0:7636:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041485c00/0xca7fc0c411f93683 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c99e04559ee0fbe expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788797006.567198:0:7636:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 4229us 00010000:00010000:0.0:1788797006.602965:0:7636:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2200/0xca7fc0c411f9368a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797006.602990:0:7636:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2200/0xca7fc0c411f9368a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797006.603003:0:7636:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2200/0xca7fc0c411f9368a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797006.603112:0:7636:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2c00/0xca7fc0c411f93691 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797006.603120:0:7636:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2c00/0xca7fc0c411f93691 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797006.603127:0:7636:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2c00/0xca7fc0c411f93691 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797006.604583:0:7636:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2800/0xca7fc0c411f93698 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797006.605482:0:7636:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2800/0xca7fc0c411f93698 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797006.605501:0:7636:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2800/0xca7fc0c411f93698 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788797006.605771:0:7636:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788797006.605776:0:7636:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788797006.605824:0:7636:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2800/0xca7fc0c411f93698 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797006.605839:0:7636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2200/0xca7fc0c411f9368a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797006.605846:0:7636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2200/0xca7fc0c411f9368a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797006.605852:0:7636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2200/0xca7fc0c411f9368a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797006.605858:0:7636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb042ea2200 already unused, calling callback (ffffffffc1f014f0) 00010000:00010000:1.0:1788797006.605862:0:7636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2200/0xca7fc0c411f9368a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797006.605871:0:7636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2200/0xca7fc0c411f9368a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797006.605911:0:7636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cb065cc2c00) 00010000:00010000:1.0:1788797006.605915:0:7636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788797006.605921:0:7636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2200/0xca7fc0c411f9368a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797006.605927:0:7636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2200/0xca7fc0c411f9368a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797006.605941:0:7636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2c00/0xca7fc0c411f93691 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797006.605947:0:7636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2c00/0xca7fc0c411f93691 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797006.605952:0:7636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2c00/0xca7fc0c411f93691 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797006.605958:0:7636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb042ea2c00 already unused, calling callback (ffffffffc1f014f0) 00010000:00010000:1.0:1788797006.605961:0:7636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2c00/0xca7fc0c411f93691 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797006.605967:0:7636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2c00/0xca7fc0c411f93691 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797006.605975:0:7636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8cb058766300) 00010000:00010000:1.0:1788797006.605978:0:7636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788797006.605981:0:7636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2c00/0xca7fc0c411f93691 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797006.605987:0:7636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2c00/0xca7fc0c411f93691 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797006.606470:0:7636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041485c00/0xca7fc0c411f93683 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee0fbe expref: 8 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797006.606490:0:7636:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2800/0xca7fc0c411f93698 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee0fbe expref: 7 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797006.606498:0:7636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8cb058766700) 00010000:00010000:1.0:1788797006.606500:0:7636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1788797006.606503:0:7636:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb042ea2800, rc 0) 00000100:00100000:1.0:1788797006.606590:0:7636:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0796c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6d050bb-169e-4784-be5b-7071799bf3b0+7:9713:x1875689351432320:12345-192.168.204.38@tcp:101:touch.500 Request processed in 43955us (49008us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797006.606601:0:7636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 21 00000100:00100000:1.0:1788797006.612488:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1788797006.612583:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351432576 00000100:00100000:3.0:1788797006.612594:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351432576 00000100:00100000:3.0:1788797006.612664:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 22 00000100:00100000:3.0:1788797006.612675:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0774e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6d050bb-169e-4784-be5b-7071799bf3b0+7:9713:x1875689351432576:12345-192.168.204.38@tcp:101:touch.500 00010000:00010000:3.0:1788797006.612710:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788797006.612732:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080436200/0xca7fc0c411f9369f lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c99e04559ee0fc5 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797006.612986:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080437c00/0xca7fc0c411f936a6 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797006.613012:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080437c00/0xca7fc0c411f936a6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797006.613023:0:5826:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080437c00/0xca7fc0c411f936a6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797006.613081:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080436c00/0xca7fc0c411f936ad lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x4304ee36 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797006.613089:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080436c00/0xca7fc0c411f936ad lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x4304ee36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797006.613096:0:5826:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080436c00/0xca7fc0c411f936ad lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x4304ee36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788797006.613836:0:5826:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2:0x0], index 0: 0 00010000:00010000:3.0:1788797006.614180:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080436e00/0xca7fc0c411f936b4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797006.614193:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080436e00/0xca7fc0c411f936b4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797006.614202:0:5826:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080436e00/0xca7fc0c411f936b4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797006.614236:0:5826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080437c00/0xca7fc0c411f936a6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797006.614244:0:5826:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080437c00/0xca7fc0c411f936a6 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797006.614251:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080437c00/0xca7fc0c411f936a6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797006.614264:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb080437c00 already unused, calling callback (ffffffffc1f014f0) 00010000:00010000:3.0:1788797006.614268:0:5826:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080437c00/0xca7fc0c411f936a6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797006.614276:0:5826:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080437c00/0xca7fc0c411f936a6 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797006.614289:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8cb058766700) 00010000:00010000:3.0:1788797006.614292:0:5826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788797006.614296:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080437c00/0xca7fc0c411f936a6 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797006.614302:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080437c00/0xca7fc0c411f936a6 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788797006.614314:0:5826:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008536421d reply state 000000005293a220 transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080436c00/0xca7fc0c411f936ad lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x4304ee36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788797006.614322:0:5826:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1788797006.614354:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080436200/0xca7fc0c411f9369f lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee0fc5 expref: 10 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797006.614367:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080436e00/0xca7fc0c411f936b4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee0fc5 expref: 9 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797006.614374:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8cb065cc2100) 00010000:00010000:3.0:1788797006.614376:0:5826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788797006.614379:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb080436e00, rc 0) 00000100:00100000:3.0:1788797006.614451:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0774e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6d050bb-169e-4784-be5b-7071799bf3b0+10:9713:x1875689351432576:12345-192.168.204.38@tcp:101:touch.500 Request processed in 1778us (1974us total) trans 4294967300 rc 0/0 00000100:00100000:3.0:1788797006.614467:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 22 00010000:00010000:0.0:1788797006.621948:0:3286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080436c00/0xca7fc0c411f936ad lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x4304ee36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797006.621978:0:3286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080436c00/0xca7fc0c411f936ad lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x4304ee36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797006.621986:0:3286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080436c00/0xca7fc0c411f936ad lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x4304ee36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797006.621993:0:3286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb080436c00 already unused, calling callback (ffffffffc1f014f0) 00010000:00010000:0.0:1788797006.622926:0:3286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080436c00/0xca7fc0c411f936ad lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x4304ee36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797006.622954:0:3286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080436c00/0xca7fc0c411f936ad lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x4304ee36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797006.622975:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x4304ee36 (ffff8cb065cc2300) 00010000:00010000:0.0:1788797006.622978:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788797006.622985:0:3286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080436c00/0xca7fc0c411f936ad lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x4304ee36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797006.622992:0:3286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080436c00/0xca7fc0c411f936ad lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x4304ee36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788797006.623369:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1788797006.623616:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351432832 00000100:00100000:3.0:1788797006.623630:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351432832 00000100:00100000:3.0:1788797006.623711:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 23 00000100:00100000:3.0:1788797006.623723:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0774e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6d050bb-169e-4784-be5b-7071799bf3b0+10:9713:x1875689351432832:12345-192.168.204.38@tcp:36:touch.500 00010000:00010000:3.0:1788797006.623798:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788797006.623822:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080436e00/0xca7fc0c411f936b4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee0fc5 expref: 10 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797006.623839:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8cb065cc2100) 00010000:00010000:3.0:1788797006.623849:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788797006.623902:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080437a00/0xca7fc0c411f936c2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797006.623918:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080437a00/0xca7fc0c411f936c2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797006.623928:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080437a00/0xca7fc0c411f936c2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788797006.624117:0:5825:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003b53179e reply state 00000000c22a8c1a transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080437a00/0xca7fc0c411f936c2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788797006.624128:0:5825:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788797006.624858:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0774e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6d050bb-169e-4784-be5b-7071799bf3b0+11:9713:x1875689351432832:12345-192.168.204.38@tcp:36:touch.500 Request processed in 1134us (1490us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1788797006.624869:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 23 00010000:00010000:0.0:1788797006.627867:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080437a00/0xca7fc0c411f936c2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797006.627885:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080437a00/0xca7fc0c411f936c2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797006.627905:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080437a00/0xca7fc0c411f936c2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797006.627911:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb080437a00 already unused, calling callback (ffffffffc1f014f0) 00010000:00010000:0.0:1788797006.627916:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080437a00/0xca7fc0c411f936c2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797006.627925:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080437a00/0xca7fc0c411f936c2 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797006.627952:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8cb065cc2200) 00010000:00010000:0.0:1788797006.627955:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788797006.627960:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080437a00/0xca7fc0c411f936c2 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797006.627967:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080437a00/0xca7fc0c411f936c2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788797006.637265:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1788797006.637488:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351432960 00000100:00100000:0.0:1788797006.637500:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351432960 00000100:00100000:0.0:1788797006.637568:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 24 00000100:00100000:0.0:1788797006.637581:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0498ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6d050bb-169e-4784-be5b-7071799bf3b0+9:9713:x1875689351432960:12345-192.168.204.38@tcp:101:touch.500 00010000:00010000:0.0:1788797006.637613:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788797006.637653:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3400/0xca7fc0c411f936c9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c99e04559ee0fcc expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797006.637748:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3400/0xca7fc0c411f936c9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee0fcc expref: 10 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797006.637764:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3400/0xca7fc0c411f936c9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee0fcc expref: 10 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797006.637786:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8cb058766b00) 00010000:00010000:0.0:1788797006.637790:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788797006.637794:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb042ea3400, rc 0) 00000100:00100000:0.0:1788797006.637861:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0498ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6d050bb-169e-4784-be5b-7071799bf3b0+10:9713:x1875689351432960:12345-192.168.204.38@tcp:101:touch.500 Request processed in 283us (610us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797006.637868:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 24 00010000:00010000:1.0:1788797006.643994:0:5815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788797006.651074:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1788797006.651203:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351433088 00000100:00100000:1.0:1788797006.651212:0:6683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351433088 00000100:00100000:1.0:1788797006.651262:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 17 00000100:00100000:1.0:1788797006.651271:0:6683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb080474a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2351:x1875689351433088:12345-192.168.204.38@tcp:8:touch.500 00010000:00080000:1.0:1788797006.651307:0:6683:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from e6d050bb-169e-4784-be5b-7071799bf3b0@192.168.204.38@tcp t0 exp 0000000000000000 cur 295 last 0 00000020:00000080:1.0:1788797006.651344:0:6683:0:(genops.c:1384:class_connect()) connect: client e6d050bb-169e-4784-be5b-7071799bf3b0, cookie 0xca7fc0c411f936d0 00002000:00100000:1.0:1788797006.651358:0:6683:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli e6d050bb-169e-4784-be5b-7071799bf3b0/ffff8cb0779d7800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788797006.651388:0:6683:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788797006.651735:0:6683:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788797006.651779:0:6683:0:(import.c:65:import_set_state_nolock()) ffff8cb0779d6800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788797006.651869:0:6683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb080474a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e6d050bb-169e-4784-be5b-7071799bf3b0+6:2351:x1875689351433088:12345-192.168.204.38@tcp:8:touch.500 Request processed in 596us (851us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797006.651879:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 17 00000100:00100000:2.0:1788797006.661404:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1788797006.663097:0:10829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351433216 00000100:00100000:3.0:1788797006.663112:0:10829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351433216 00000100:00100000:3.0:1788797006.663201:0:10829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 18 00000100:00100000:3.0:1788797006.663212:0:10829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb077920700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e6d050bb-169e-4784-be5b-7071799bf3b0+6:0:x1875689351433216:12345-192.168.204.38@tcp:2:touch.500 00000100:00080000:1.0:1788797006.663872:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788797006.779749:0:10829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb077920700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e6d050bb-169e-4784-be5b-7071799bf3b0+7:0:x1875689351433216:12345-192.168.204.38@tcp:2:touch.500 Request processed in 116525us (118407us total) trans 4294967299 rc 0/0 00000100:00100000:1.0:1788797006.779766:0:10829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 18 00000001:00100000:1.0:1788797006.779816:0:6713:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of e6d050bb-169e-4784-be5b-7071799bf3b0 00000001:00080000:1.0:1788797006.779831:0:6713:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00000100:00100000:2.0:1788797006.788707:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1788797006.788782:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351433472 00000100:00100000:3.0:1788797006.788793:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351433472 00000100:00100000:3.0:1788797006.788854:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2 00000100:00100000:3.0:1788797006.788864:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb077920380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e6d050bb-169e-4784-be5b-7071799bf3b0+10:9713:x1875689351433472:12345-192.168.204.38@tcp:35:touch.500 00000100:00100000:0.0:1788797006.789419:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb077920380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e6d050bb-169e-4784-be5b-7071799bf3b0+11:9713:x1875689351433472:12345-192.168.204.38@tcp:35:touch.500 Request processed in 553us (729us total) trans 4294967302 rc 0/0 00000100:00100000:0.0:1788797006.789432:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2 00000100:00100000:2.0:1788797006.814424:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1788797006.816915:0:7636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351433600 00000100:00100000:1.0:1788797006.816946:0:7636:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351433600 00000100:00100000:1.0:1788797006.817062:0:7636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 25 00000100:00100000:1.0:1788797006.817077:0:7636:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb077922300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6d050bb-169e-4784-be5b-7071799bf3b0+11:9714:x1875689351433600:12345-192.168.204.38@tcp:101:rm.0 00010000:00010000:1.0:1788797006.817106:0:7636:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788797006.817135:0:7636:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb0821f0400/0xca7fc0c411f936d7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c99e04559ee0fd3 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797006.817216:0:7636:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb0821f0600/0xca7fc0c411f936de lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797006.817236:0:7636:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb0821f0600/0xca7fc0c411f936de lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797006.817251:0:7636:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb0821f0600/0xca7fc0c411f936de lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788797006.817293:0:7636:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788797006.817297:0:7636:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788797006.817371:0:7636:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cb0821f0600/0xca7fc0c411f936de lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797006.817402:0:7636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb0821f0400/0xca7fc0c411f936d7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee0fd3 expref: 13 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797006.817425:0:7636:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb0821f0600/0xca7fc0c411f936de lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee0fd3 expref: 12 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797006.817433:0:7636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8cb058766700) 00010000:00010000:1.0:1788797006.817435:0:7636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788797006.817439:0:7636:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb0821f0600, rc 0) 00000100:00100000:1.0:1788797006.818669:0:7636:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb077922300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6d050bb-169e-4784-be5b-7071799bf3b0+12:9714:x1875689351433600:12345-192.168.204.38@tcp:101:rm.0 Request processed in 436us (3093us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797006.818678:0:7636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 25 00000100:00100000:3.0:1788797006.823275:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1788797006.823489:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351433856 00000100:00100000:0.0:1788797006.823503:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351433856 00000100:00100000:0.0:1788797006.823571:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 26 00000100:00100000:0.0:1788797006.823600:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb080474700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6d050bb-169e-4784-be5b-7071799bf3b0+12:9714:x1875689351433856:12345-192.168.204.38@tcp:101:rm.0 00010000:00010000:0.0:1788797006.823628:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788797006.823652:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3800/0xca7fc0c411f936e5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c99e04559ee0fda expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788797006.823773:0:5827:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:0.0:1788797006.823958:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3800/0xca7fc0c411f936e5 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee0fda expref: 14 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797006.823983:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cb065cc2c00) 00010000:00010000:0.0:1788797006.823987:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788797006.824006:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3800/0xca7fc0c411f936e5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee0fda expref: 14 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797006.824776:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb042ea3800, rc 0) 00000100:00100000:0.0:1788797006.824905:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb080474700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6d050bb-169e-4784-be5b-7071799bf3b0+13:9714:x1875689351433856:12345-192.168.204.38@tcp:101:rm.0 Request processed in 1322us (1642us total) trans 4294967303 rc 301/301 00000100:00100000:0.0:1788797006.824915:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 26 00000100:00100000:1.0:1788797006.840445:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1788797006.840511:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351433984 00000100:00100000:0.0:1788797006.840522:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351433984 00000100:00100000:0.0:1788797006.840583:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3 00000100:00100000:0.0:1788797006.840608:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0498ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e6d050bb-169e-4784-be5b-7071799bf3b0+13:9714:x1875689351433984:12345-192.168.204.38@tcp:37:rm.0 00000100:00100000:1.0:1788797006.851167:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0498ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e6d050bb-169e-4784-be5b-7071799bf3b0+13:9714:x1875689351433984:12345-192.168.204.38@tcp:37:rm.0 Request processed in 10548us (10718us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797006.851182:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3 00000100:00100000:3.0:1788797006.860558:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1788797006.860740:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351434240 00000100:00100000:2.0:1788797006.860751:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351434240 00000100:00100000:2.0:1788797006.860809:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 4 00000100:00100000:2.0:1788797006.860820:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb050634c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e6d050bb-169e-4784-be5b-7071799bf3b0+13:9714:x1875689351434240:12345-192.168.204.38@tcp:35:rm.0 00000100:00100000:2.0:1788797006.861122:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb050634c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e6d050bb-169e-4784-be5b-7071799bf3b0+14:9714:x1875689351434240:12345-192.168.204.38@tcp:35:rm.0 Request processed in 303us (572us total) trans 4294967304 rc 0/0 00000100:00100000:2.0:1788797006.861129:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 4 00000100:00100000:2.0:1788797006.871949:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1788797006.872194:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351434496 00000100:00100000:3.0:1788797006.872206:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351434496 00000100:00100000:3.0:1788797006.872257:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 27 00000100:00100000:3.0:1788797006.872268:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb077920380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6d050bb-169e-4784-be5b-7071799bf3b0+14:9714:x1875689351434496:12345-192.168.204.38@tcp:101:rm.0 00010000:00010000:3.0:1788797006.872296:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788797006.872317:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080437600/0xca7fc0c411f936f3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c99e04559ee0fe1 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797006.872417:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080436400/0xca7fc0c411f936fa lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797006.872432:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080436400/0xca7fc0c411f936fa lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797006.872444:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080436400/0xca7fc0c411f936fa lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788797006.872456:0:5825:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:3.0:1788797006.872641:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080437600/0xca7fc0c411f936f3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee0fe1 expref: 17 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797006.872668:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080436400/0xca7fc0c411f936fa lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee0fe1 expref: 16 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797006.872678:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8cb058766700) 00010000:00010000:3.0:1788797006.873352:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788797006.873360:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb080436400, rc 0) 00000100:00100000:2.0:1788797006.873673:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb077920380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6d050bb-169e-4784-be5b-7071799bf3b0+16:9714:x1875689351434496:12345-192.168.204.38@tcp:101:rm.0 Request processed in 1401us (1729us total) trans 4294967305 rc 0/0 00000100:00100000:2.0:1788797006.873693:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 27 00000100:00100000:0.0:1788797006.878950:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1788797006.879338:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351434624 00000100:00100000:3.0:1788797006.879354:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351434624 00000100:00100000:3.0:1788797006.879430:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 28 00000100:00100000:3.0:1788797006.879444:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb04982e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6d050bb-169e-4784-be5b-7071799bf3b0+16:9714:x1875689351434624:12345-192.168.204.38@tcp:41:rm.0 00000004:00000024:3.0:1788797006.879526:0:5826:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 7719616512 avail 7715422208 00000100:00100000:3.0:1788797006.879608:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb04982e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6d050bb-169e-4784-be5b-7071799bf3b0+16:9714:x1875689351434624:12345-192.168.204.38@tcp:41:rm.0 Request processed in 167us (669us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797006.879615:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 28 00000100:00100000:3.0:1788797006.882883:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1788797006.882973:0:7636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351434752 00000100:00100000:0.0:1788797006.882983:0:7636:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351434752 00000100:00100000:0.0:1788797006.883093:0:7636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 29 00000100:00100000:0.0:1788797006.883107:0:7636:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb080476300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6d050bb-169e-4784-be5b-7071799bf3b0+16:9714:x1875689351434752:12345-192.168.204.38@tcp:101:rm.0 00010000:00010000:0.0:1788797006.883133:0:7636:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788797006.883158:0:7636:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3000/0xca7fc0c411f93708 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c99e04559ee0fe8 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797006.883233:0:7636:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3c00/0xca7fc0c411f9370f lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797006.883249:0:7636:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3c00/0xca7fc0c411f9370f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797006.883275:0:7636:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3c00/0xca7fc0c411f9370f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797006.883290:0:7636:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3200/0xca7fc0c411f93716 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x4304ee36 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797006.883298:0:7636:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3200/0xca7fc0c411f93716 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x4304ee36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797006.883304:0:7636:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3200/0xca7fc0c411f93716 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x4304ee36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797006.883414:0:7636:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2600/0xca7fc0c411f9371d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797006.883423:0:7636:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2600/0xca7fc0c411f9371d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797006.883430:0:7636:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2600/0xca7fc0c411f9371d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788797006.883459:0:7636:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2:0x0]: returning size 0 00000004:00200000:0.0:1788797006.883463:0:7636:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788797006.883481:0:7636:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2600/0xca7fc0c411f9371d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797006.883493:0:7636:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2600/0xca7fc0c411f9371d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797006.883503:0:7636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3c00/0xca7fc0c411f9370f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797006.883522:0:7636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3c00/0xca7fc0c411f9370f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797006.883528:0:7636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3c00/0xca7fc0c411f9370f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797006.883535:0:7636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb042ea3c00 already unused, calling callback (ffffffffc1f014f0) 00010000:00010000:0.0:1788797006.883539:0:7636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3c00/0xca7fc0c411f9370f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797006.883547:0:7636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3c00/0xca7fc0c411f9370f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797006.883559:0:7636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8cb058766700) 00010000:00010000:0.0:1788797006.883562:0:7636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788797006.883567:0:7636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3c00/0xca7fc0c411f9370f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797006.883573:0:7636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3c00/0xca7fc0c411f9370f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797006.883589:0:7636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3200/0xca7fc0c411f93716 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x4304ee36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797006.883595:0:7636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3200/0xca7fc0c411f93716 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x4304ee36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797006.883601:0:7636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3200/0xca7fc0c411f93716 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x4304ee36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797006.883606:0:7636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb042ea3200 already unused, calling callback (ffffffffc1f014f0) 00010000:00010000:0.0:1788797006.883615:0:7636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3200/0xca7fc0c411f93716 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x4304ee36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797006.883622:0:7636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3200/0xca7fc0c411f93716 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x4304ee36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797006.883630:0:7636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x4304ee36 (ffff8cb058766000) 00010000:00010000:0.0:1788797006.883633:0:7636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788797006.883636:0:7636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3200/0xca7fc0c411f93716 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x4304ee36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797006.883641:0:7636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3200/0xca7fc0c411f93716 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x4304ee36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797006.883671:0:7636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3000/0xca7fc0c411f93708 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee0fe8 expref: 18 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797006.883978:0:7636:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2600/0xca7fc0c411f9371d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee0fe8 expref: 17 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797006.883986:0:7636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8cb058766b00) 00010000:00010000:0.0:1788797006.884207:0:7636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788797006.884211:0:7636:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb042ea2600, rc 0) 00000100:00100000:0.0:1788797006.884322:0:7636:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb080476300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6d050bb-169e-4784-be5b-7071799bf3b0+17:9714:x1875689351434752:12345-192.168.204.38@tcp:101:rm.0 Request processed in 1218us (1447us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797006.884331:0:7636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 29 00000100:00100000:2.0:1788797006.890364:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1788797006.890467:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351435008 00000100:00100000:3.0:1788797006.890479:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351435008 00000100:00100000:3.0:1788797006.890545:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30 00000100:00100000:3.0:1788797006.890556:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb079b91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6d050bb-169e-4784-be5b-7071799bf3b0+17:9714:x1875689351435008:12345-192.168.204.38@tcp:36:rm.0 00010000:00010000:3.0:1788797006.890613:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1788797006.890643:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2600/0xca7fc0c411f9371d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee0fe8 expref: 17 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797006.890666:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3400/0xca7fc0c411f936c9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee0fcc expref: 16 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797006.890705:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8cb058766b00) 00010000:00010000:3.0:1788797006.890723:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb0821f0600/0xca7fc0c411f936de lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee0fd3 expref: 15 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797006.890733:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8cb058766700) 00010000:00010000:3.0:1788797006.890736:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788797006.890756:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080437600/0xca7fc0c411f93724 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797006.890768:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080437600/0xca7fc0c411f93724 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797006.890778:0:5826:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080437600/0xca7fc0c411f93724 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797006.890792:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080436600/0xca7fc0c411f9372b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x4304ee36 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797006.890799:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080436600/0xca7fc0c411f9372b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x4304ee36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797006.890805:0:5826:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080436600/0xca7fc0c411f9372b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x4304ee36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797006.890940:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080437c00/0xca7fc0c411f93732 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797006.890949:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080437c00/0xca7fc0c411f93732 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797006.890966:0:5826:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080437c00/0xca7fc0c411f93732 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788797006.891791:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:3.0:1788797006.891804:0:5826:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 295897774918ns, next at 296897772937ns, rc = 0 00010000:00010000:3.0:1788797006.891868:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080436200/0xca7fc0c411f93739 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797006.891880:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080436200/0xca7fc0c411f93739 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797006.891890:0:5826:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080436200/0xca7fc0c411f93739 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797006.891897:0:5826:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080436200/0xca7fc0c411f93739 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797006.891904:0:5826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080436200/0xca7fc0c411f93739 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797006.891911:0:5826:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080436200/0xca7fc0c411f93739 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797006.891939:0:5826:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788797006.891958:0:5826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080437c00/0xca7fc0c411f93732 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797006.891964:0:5826:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080437c00/0xca7fc0c411f93732 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797006.891970:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080437c00/0xca7fc0c411f93732 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797006.891983:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb080437c00 already unused, calling callback (ffffffffc1f014f0) 00010000:00010000:3.0:1788797006.891987:0:5826:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080437c00/0xca7fc0c411f93732 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797006.891995:0:5826:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080437c00/0xca7fc0c411f93732 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797006.892005:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8cb065cc2400) 00010000:00010000:3.0:1788797006.892008:0:5826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1788797006.892012:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080437c00/0xca7fc0c411f93732 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797006.892018:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080437c00/0xca7fc0c411f93732 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797006.892060:0:5826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080437600/0xca7fc0c411f93724 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797006.892067:0:5826:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080437600/0xca7fc0c411f93724 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797006.892072:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080437600/0xca7fc0c411f93724 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797006.892077:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb080437600 already unused, calling callback (ffffffffc1f014f0) 00010000:00010000:3.0:1788797006.892080:0:5826:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080437600/0xca7fc0c411f93724 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797006.892086:0:5826:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080437600/0xca7fc0c411f93724 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797006.892104:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8cb058766700) 00010000:00010000:3.0:1788797006.892106:0:5826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788797006.892109:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080437600/0xca7fc0c411f93724 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797006.892115:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080437600/0xca7fc0c411f93724 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788797006.892125:0:5826:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000260e4bb5 reply state 000000001e5ce29d transno 4294967306 ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080436600/0xca7fc0c411f9372b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x4304ee36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788797006.892133:0:5826:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788797006.892221:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb079b91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6d050bb-169e-4784-be5b-7071799bf3b0+16:9714:x1875689351435008:12345-192.168.204.38@tcp:36:rm.0 Request processed in 1665us (1868us total) trans 4294967306 rc 0/0 00000100:00100000:3.0:1788797006.892230:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30 00010000:00010000:2.0:1788797006.892857:0:8446:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788797006.892866:0:8446:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080436200/0xca7fc0c411f93739 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797006.892873:0:8446:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb080436200 already unused, calling callback (ffffffffc14d98b0) 00010000:00010000:2.0:1788797006.892877:0:8446:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080436200/0xca7fc0c411f93739 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797006.892885:0:8446:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080436200/0xca7fc0c411f93739 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797006.892900:0:8446:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8cb065cc2400) 00010000:00010000:2.0:1788797006.892903:0:8446:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788797006.892906:0:8446:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080436200/0xca7fc0c411f93739 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797006.892913:0:8446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080436200/0xca7fc0c411f93739 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797006.892933:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788797006.892935:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788797006.892937:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788797006.898909:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb0498eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875689374535424:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788797006.899001:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788797006.899475:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374535424 00000100:00100000:1.0:1788797006.899485:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374535424 00000100:00100000:1.0:1788797006.899552:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788797006.899563:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb079b92a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1875689374535424:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788797006.900005:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788797006.900368:0:3286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080436600/0xca7fc0c411f9372b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x4304ee36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797006.900381:0:3286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080436600/0xca7fc0c411f9372b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x4304ee36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797006.900389:0:3286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080436600/0xca7fc0c411f9372b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x4304ee36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797006.900418:0:3286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb080436600 already unused, calling callback (ffffffffc1f014f0) 00010000:00010000:2.0:1788797006.900423:0:3286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080436600/0xca7fc0c411f9372b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x4304ee36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797006.900432:0:3286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080436600/0xca7fc0c411f9372b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x4304ee36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797006.900448:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x4304ee36 (ffff8cb065cc2100) 00010000:00010000:2.0:1788797006.900451:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788797006.900456:0:3286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080436600/0xca7fc0c411f9372b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x4304ee36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797006.900463:0:3286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080436600/0xca7fc0c411f9372b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x4304ee36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00000024:1.0:1788797006.900552:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788797006.900656:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb079b92a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1875689374535424:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1091us (1651us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797006.900666:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00080000:2.0:1788797006.901096:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cb0498eea00 x1875689374535424/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788797022 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788797006.901117:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb0498eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875689374535424:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788797006.904314:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1788797006.904561:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351435264 00000100:00100000:1.0:1788797006.904583:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351435264 00000100:00100000:1.0:1788797006.904667:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 5 00000100:00100000:1.0:1788797006.904678:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb079b93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e6d050bb-169e-4784-be5b-7071799bf3b0+15:9714:x1875689351435264:12345-192.168.204.38@tcp:35:rm.0 00000100:00100000:1.0:1788797006.905005:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb079b93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e6d050bb-169e-4784-be5b-7071799bf3b0+16:9714:x1875689351435264:12345-192.168.204.38@tcp:35:rm.0 Request processed in 327us (698us total) trans 4294967307 rc 0/0 00000100:00100000:1.0:1788797006.905013:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 5 00000100:00100000:0.0:1788797006.921870:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1788797006.922306:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351435520 00000100:00100000:2.0:1788797006.922320:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351435520 00000100:00100000:2.0:1788797006.922396:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 31 00000100:00100000:2.0:1788797006.922408:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb04982dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6d050bb-169e-4784-be5b-7071799bf3b0+16:9714:x1875689351435520:12345-192.168.204.38@tcp:36:rm.0 00010000:00010000:2.0:1788797006.922475:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1788797006.922508:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080436400/0xca7fc0c411f936fa lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee0fe1 expref: 16 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797006.922556:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2800/0xca7fc0c411f93698 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee0fbe expref: 15 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797006.922568:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8cb058766700) 00010000:00010000:2.0:1788797006.922585:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080437e00/0xca7fc0c411f93659 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee0fb0 expref: 14 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797006.922594:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cb065cc2c00) 00010000:00010000:2.0:1788797006.922601:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788797006.922627:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484000/0xca7fc0c411f93740 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797006.922641:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484000/0xca7fc0c411f93740 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797006.922652:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484000/0xca7fc0c411f93740 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797006.922664:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484400/0xca7fc0c411f93747 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797006.922671:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484400/0xca7fc0c411f93747 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797006.922678:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484400/0xca7fc0c411f93747 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797006.924186:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484600/0xca7fc0c411f9374e lrc: 3/0,1 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797006.924217:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484600/0xca7fc0c411f9374e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797006.924229:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484600/0xca7fc0c411f9374e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788797006.924912:0:5825:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1788797006.924931:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484600/0xca7fc0c411f9374e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797006.924939:0:5825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484600/0xca7fc0c411f9374e lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797006.924946:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484600/0xca7fc0c411f9374e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797006.924952:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb041484600 already unused, calling callback (ffffffffc1f014f0) 00010000:00010000:2.0:1788797006.924957:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484600/0xca7fc0c411f9374e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797006.924964:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484600/0xca7fc0c411f9374e lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797006.924978:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8cb05088af00) 00010000:00010000:2.0:1788797006.924981:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788797006.924985:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484600/0xca7fc0c411f9374e lrc: 2/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797006.924991:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484600/0xca7fc0c411f9374e lrc: 0/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797006.925013:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484000/0xca7fc0c411f93740 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797006.925066:0:5825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484000/0xca7fc0c411f93740 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797006.925074:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484000/0xca7fc0c411f93740 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797006.925080:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb041484000 already unused, calling callback (ffffffffc1f014f0) 00010000:00010000:2.0:1788797006.925083:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484000/0xca7fc0c411f93740 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797006.925090:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484000/0xca7fc0c411f93740 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797006.925099:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cb05088aa00) 00010000:00010000:2.0:1788797006.925101:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788797006.925104:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484000/0xca7fc0c411f93740 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797006.925109:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484000/0xca7fc0c411f93740 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788797006.925122:0:5825:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000005e64be4 reply state 000000007f6d0ef0 transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484400/0xca7fc0c411f93747 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788797006.925130:0:5825:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788797006.925233:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb04982dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6d050bb-169e-4784-be5b-7071799bf3b0+15:9714:x1875689351435520:12345-192.168.204.38@tcp:36:rm.0 Request processed in 2825us (3372us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1788797006.925242:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 31 00010000:00010000:0.0:1788797006.933999:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484400/0xca7fc0c411f93747 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797006.934181:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484400/0xca7fc0c411f93747 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797006.934190:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484400/0xca7fc0c411f93747 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797006.934196:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb041484400 already unused, calling callback (ffffffffc1f014f0) 00010000:00010000:0.0:1788797006.934202:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484400/0xca7fc0c411f93747 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797006.934211:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484400/0xca7fc0c411f93747 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797006.934229:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8cb05088a800) 00010000:00010000:0.0:1788797006.934232:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788797006.934237:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484400/0xca7fc0c411f93747 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797006.934244:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484400/0xca7fc0c411f93747 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788797007.410488:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb080474380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875689374535552:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788797007.410581:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788797007.410669:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb079174380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3302:1875689374536064:0@lo:400:kworker.0 00000100:00100000:1.0:1788797007.410711:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788797007.410742:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788797007.410749:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb080476d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:3302:1875689374535680:0@lo:400:kworker.0 00000100:00100000:1.0:1788797007.410781:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788797007.410804:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb079177100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3302:1875689374536192:0@lo:400:kworker.0 00000100:00100000:1.0:1788797007.410826:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788797007.410907:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374536064 00000100:00100000:3.0:1788797007.410917:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374536064 00000100:00100000:2.0:1788797007.410934:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb080475880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3300:1875689374535808:0@lo:400:kworker.0 00000100:00100000:2.0:1788797007.410974:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788797007.410978:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374536192 00000100:00100000:3.0:1788797007.410983:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374536192 00000100:00100000:3.0:1788797007.411004:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374535808 00000100:00100000:3.0:1788797007.411008:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374535808 00000100:00100000:3.0:1788797007.411055:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1788797007.411056:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788797007.411068:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0498ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1875689374536064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788797007.411070:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb080477100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875689374535936:0@lo:400:kworker.0 00000100:00100000:2.0:1788797007.411101:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788797007.411134:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374535680 00000100:00100000:2.0:1788797007.411138:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374535680 00000100:00100000:3.0:1788797007.411150:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0498ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1875689374536064:12345-0@lo:400:kworker.0 Request processed in 85us (436us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797007.411158:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1788797007.411169:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:2.0:1788797007.411175:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0465dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+19:3302:x1875689374535680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788797007.411206:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0465dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+19:3302:x1875689374535680:12345-0@lo:400:kworker.0 Request processed in 31us (424us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797007.411212:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:2.0:1788797007.411241:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374535936 00000100:00100000:2.0:1788797007.411244:0:6683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374535936 00000100:00080000:1.0:1788797007.411248:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788797007.411269:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788797007.411276:0:6683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb079b91500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3300:x1875689374535936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788797007.411298:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374535552 00000100:00100000:1.0:1788797007.411304:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374535552 00000100:00100000:2.0:1788797007.411308:0:6683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb079b91500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3300:x1875689374535936:12345-0@lo:400:kworker.0 Request processed in 31us (205us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797007.411316:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788797007.411348:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00010000:00080000:2.0:1788797007.411356:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cb080477100 x1875689374535936/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788797023 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788797007.411360:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0498ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875689374535552:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788797007.411378:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb080477100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875689374535936:0@lo:400:kworker.0 00000100:00100000:2.0:1788797007.411409:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb080476d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:3302:1875689374535680:0@lo:400:kworker.0 00002000:00000024:1.0:1788797007.411416:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788797007.411423:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb079174380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3302:1875689374536064:0@lo:400:kworker.0 00000100:00100000:1.0:1788797007.411465:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0498ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875689374535552:12345-0@lo:13:osp-pre-1-0.0 Request processed in 110us (885us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797007.411472:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00080000:2.0:1788797007.411492:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cb080474380 x1875689374535552/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788797023 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788797007.411493:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788797007.411507:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1788797007.411511:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb080474380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875689374535552:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788797007.411524:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0498eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1875689374536192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788797007.411571:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0498eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1875689374536192:12345-0@lo:400:kworker.0 Request processed in 51us (744us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797007.411577:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1788797007.411592:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1788797007.411597:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb079b91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1875689374535808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788797007.411625:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb079b91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1875689374535808:12345-0@lo:400:kworker.0 Request processed in 28us (652us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797007.411630:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1788797007.412154:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb080475880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3300:1875689374535808:0@lo:400:kworker.0 00000100:00100000:2.0:1788797007.412179:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb079177100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3302:1875689374536192:0@lo:400:kworker.0 00010000:00010000:1.0:1788797007.666599:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788797008.695100:0:5815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788797009.715609:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788797010.742425:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788797010.837821:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1788797010.837877:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1788797010.837910:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351435648 00000100:00100000:0.0:1788797010.837925:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1788797010.837936:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351435648 00000100:00100000:0.0:1788797010.837998:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1788797010.838004:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 253 00000100:00100000:3.0:1788797010.838019:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0465dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4d9d1a9-601d-459e-8721-8bfc2fdde84f+13:2355:x1875689351435648:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:0.0:1788797010.838085:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351435776 00000100:00100000:0.0:1788797010.838091:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351435776 00000100:00100000:3.0:1788797010.838150:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0465dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4d9d1a9-601d-459e-8721-8bfc2fdde84f+13:2355:x1875689351435648:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 135us (344us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797010.838158:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 253 00000100:00100000:2.0:1788797010.838328:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351436032 00000100:00100000:2.0:1788797010.838333:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351436032 00000100:00100000:2.0:1788797010.838381:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 108 00000100:00100000:2.0:1788797010.838390:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb04982ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed124ec0-b908-4000-b768-8e53d5def0fc+5:2355:x1875689351436032:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:2.0:1788797010.838425:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb04982ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed124ec0-b908-4000-b768-8e53d5def0fc+5:2355:x1875689351436032:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 37us (429us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797010.838432:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 108 00000100:00100000:0.0:1788797010.838506:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 109 00000100:00100000:0.0:1788797010.838515:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb04982ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6d050bb-169e-4784-be5b-7071799bf3b0+14:2355:x1875689351435776:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:0.0:1788797010.838555:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb04982ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6d050bb-169e-4784-be5b-7071799bf3b0+14:2355:x1875689351435776:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 42us (642us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797010.838562:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 109 00000100:00100000:1.0:1788797010.838787:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351435904 00000100:00100000:1.0:1788797010.838793:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351435904 00000100:00100000:1.0:1788797010.838835:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 42 00000100:00100000:1.0:1788797010.838842:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb04982f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e6d050bb-169e-4784-be5b-7071799bf3b0+5:2355:x1875689351435904:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:1.0:1788797010.838869:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb04982f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e6d050bb-169e-4784-be5b-7071799bf3b0+5:2355:x1875689351435904:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 28us (994us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797010.838877:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 42 00000100:00080000:1.0:1788797010.838900:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788797010.838905:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:3.0:1788797011.608800:0:5848:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967303 is committed 00000001:00080000:3.0:1788797011.608826:0:5848:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967307 is committed 00000001:00080000:3.0:1788797011.608834:0:5848:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967308 is committed 00000004:00080000:3.0:1788797011.608846:0:5848:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000100:00100000:3.0:1788797011.609754:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788797011.609785:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb0498ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875689374536320:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788797011.610195:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788797011.610333:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374536320 00000100:00100000:2.0:1788797011.610341:0:6683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374536320 00000100:00100000:2.0:1788797011.610449:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788797011.610461:0:6683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb079175c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3301:x1875689374536320:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1788797011.610506:0:6683:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:2 count 1 00002000:00010000:2.0:1788797011.610560:0:6683:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 0, mtime: 0x6a9ee04f, atime: 0x6a9ee04f, ctime: 0x6a9ee04f, blocks: 0x1 00010000:00010000:2.0:1788797011.610570:0:6683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002b02d6cb/0xca7fc0c411f93755 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797011.610601:0:6683:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=300s v=(0 0) 00010000:00010000:2.0:1788797011.610606:0:6683:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788797011.610614:0:6683:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002b02d6cb/0xca7fc0c411f93755 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797011.610635:0:6683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002b02d6cb/0xca7fc0c411f93755 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797011.610672:0:6683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002b02d6cb/0xca7fc0c411f93755 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797011.610682:0:6683:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002b02d6cb/0xca7fc0c411f93755 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797011.610706:0:6683:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788797011.612227:0:6683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb079175c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3301:x1875689374536320:12345-0@lo:6:osp-syn-0-0.0 Request processed in 1763us (2093us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1788797011.612242:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00010000:2.0:1788797011.612291:0:5815:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788797011.612299:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002b02d6cb/0xca7fc0c411f93755 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797011.612312:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb041484c00 already unused, calling callback (ffffffffc14d98b0) 00010000:00010000:2.0:1788797011.612317:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002b02d6cb/0xca7fc0c411f93755 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797011.612328:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002b02d6cb/0xca7fc0c411f93755 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797011.612350:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002b02d6cb/0xca7fc0c411f93755 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797011.612357:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002b02d6cb/0xca7fc0c411f93755 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797011.612384:0:5815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788797011.612386:0:5815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788797011.612388:0:5815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1788797011.612426:0:3301:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8cb0498ef480/2, rc 0, transno 4294967300 00000100:00100000:2.0:1788797011.612433:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb0498ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875689374536320:0@lo:6:osp-syn-0-0.0 00000100:00080000:1.0:1788797011.613323:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788797011.764249:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788797011.978840:0:11612:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00000100:00100000:2.0:1788797012.027544:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb0498ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875689374536448:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788797012.027629:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788797012.031961:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374536448 00000100:00100000:0.0:1788797012.031977:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374536448 00000100:00100000:0.0:1788797012.032068:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788797012.032080:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb080475880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3301:x1875689374536448:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788797012.032115:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788797012.032200:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb080475880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3301:x1875689374536448:12345-0@lo:13:osp-pre-0-0.0 Request processed in 123us (4570us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797012.032208:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788797012.039188:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb0498ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875689374536448:0@lo:13:osp-pre-0-0.0 00000001:00080000:3.0:1788797012.169281:0:6713:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967300 is committed 00000100:00100000:2.0:1788797012.530360:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788797012.530389:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb080474380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875689374536576:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788797012.530458:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788797012.530526:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374536576 00000100:00100000:2.0:1788797012.530533:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374536576 00000100:00100000:2.0:1788797012.530597:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788797012.530606:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb080476d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875689374536576:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788797012.530645:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788797012.530692:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb080476d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875689374536576:12345-0@lo:13:osp-pre-1-0.0 Request processed in 87us (233us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797012.530699:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00010000:00080000:2.0:1788797012.530738:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cb080474380 x1875689374536576/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788797028 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788797012.530756:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb080474380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875689374536576:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1788797012.531342:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788797012.532762:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788797012.532780:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb0498ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:3302:1875689374536704:0@lo:400:kworker.0 00000100:00100000:0.0:1788797012.532840:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788797012.532931:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374536704 00000100:00100000:2.0:1788797012.532939:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374536704 00000100:00100000:2.0:1788797012.532981:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:2.0:1788797012.533004:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0465df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+19:3302:x1875689374536704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788797012.533083:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0465df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+19:3302:x1875689374536704:12345-0@lo:400:kworker.0 Request processed in 81us (243us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797012.533103:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:2.0:1788797012.533157:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb0498ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:3302:1875689374536704:0@lo:400:kworker.0 00000100:00100000:1.0:1788797012.543128:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb06ef1df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3301:1875689374536960:0@lo:400:kworker.0 00000100:00100000:1.0:1788797012.543205:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788797012.543237:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb06ef1ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3300:1875689374536832:0@lo:400:kworker.0 00000100:00100000:1.0:1788797012.543264:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb06ef1d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3302:1875689374537088:0@lo:400:kworker.0 00000100:00100000:0.0:1788797012.543274:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788797012.543312:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788797012.547106:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374536960 00000100:00100000:0.0:1788797012.547124:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374536960 00000100:00100000:0.0:1788797012.547210:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374536832 00000100:00100000:0.0:1788797012.547214:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374536832 00000100:00100000:2.0:1788797012.547215:0:7636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374537088 00000100:00100000:2.0:1788797012.547219:0:7636:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374537088 00000100:00100000:0.0:1788797012.547236:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1788797012.547246:0:7636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1788797012.547246:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb06ef1d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1875689374536960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788797012.547252:0:7636:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb04982e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1875689374536832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788797012.547368:0:7636:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb04982e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1875689374536832:12345-0@lo:400:kworker.0 Request processed in 115us (4093us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797012.547375:0:7636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1788797012.547402:0:7636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1788797012.547408:0:7636:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb04945f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1875689374537088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788797012.547432:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb06ef1d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1875689374536960:12345-0@lo:400:kworker.0 Request processed in 189us (4228us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797012.547445:0:7636:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb04945f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1875689374537088:12345-0@lo:400:kworker.0 Request processed in 38us (4134us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797012.547450:0:7636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1788797012.547460:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1788797012.547506:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb06ef1ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3300:1875689374536832:0@lo:400:kworker.0 00000100:00100000:2.0:1788797012.547569:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb06ef1d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3302:1875689374537088:0@lo:400:kworker.0 00000100:00100000:1.0:1788797012.547592:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb06ef1df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3301:1875689374536960:0@lo:400:kworker.0 00000100:00080000:2.0:1788797012.547613:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788797012.787817:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788797013.249476:0:11661:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fffb2725c60 20000000:00000080:2.0:1788797013.249498:0:11661:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8cb08044fc00 uarg=0000000000000000 20000000:01000000:2.0:1788797013.249538:0:11661:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:2.0:1788797013.249547:0:11661:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:2.0:1788797013.249552:0:11661:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:0.0:1788797013.252691:0:11662:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:2.0:1788797013.253425:0:11661:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:2.0:1788797013.271232:0:11661:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:2.0:1788797013.271339:0:11661:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:2.0:1788797013.271431:0:11661:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:2.0:1788797013.271451:0:11661:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1788797013.271479:0:11661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cb041485600/0xca7fc0c411f9375c lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797013.271505:0:11661:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cb041485200/0xca7fc0c411f935f7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee0f9b expref: 12 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797013.271514:0:11661:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cb0821f0e00/0xca7fc0c411f935fe lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee0fa2 expref: 12 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797013.271522:0:11661:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cb041484800/0xca7fc0c411f9360c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xca7fc0c411f93605 expref: 18 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797013.271530:0:11661:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cb079b81800/0xca7fc0c411f9361a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xca7fc0c411f93613 expref: 18 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797013.271539:0:11661:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cb0821f0a00/0xca7fc0c411f93628 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xca7fc0c411f93621 expref: 18 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797013.271546:0:11661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8cb041485600/0xca7fc0c411f9375c lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797013.271623:0:11661:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cb0821f0a00/0xca7fc0c411f93628 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xca7fc0c411f93621 expref: 18 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797013.271645:0:11661:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cb0821f0a00/0xca7fc0c411f93628 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xca7fc0c411f93621 expref: 18 pid: 5818 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788797013.271687:0:11661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb080474380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11661:1875689374537216:0@lo:104: 00000100:00100000:2.0:1788797013.271785:0:11661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788797013.272454:0:11661:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cb079b81800/0xca7fc0c411f9361a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xca7fc0c411f93613 expref: 18 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797013.272465:0:11661:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cb079b81800/0xca7fc0c411f9361a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xca7fc0c411f93613 expref: 18 pid: 5818 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788797013.272476:0:11661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb06ef1df80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11661:1875689374537344:0@lo:104: 00000100:00100000:2.0:1788797013.272505:0:11661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788797013.273616:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374537216 00000100:00100000:0.0:1788797013.273630:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374537216 00010000:00010000:2.0:1788797013.273667:0:11661:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cb041484800/0xca7fc0c411f9360c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xca7fc0c411f93605 expref: 18 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797013.273681:0:11661:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cb041484800/0xca7fc0c411f9360c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xca7fc0c411f93605 expref: 18 pid: 5818 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788797013.273693:0:11661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb06ef1ce00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11661:1875689374537472:0@lo:104: 00000100:00100000:0.0:1788797013.273710:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374537344 00000100:00100000:0.0:1788797013.273716:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374537344 00000100:00100000:0.0:1788797013.273736:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788797013.273746:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb080477100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+4:11661:x1875689374537216:12345-0@lo:104: 00010000:00010000:0.0:1788797013.273763:0:6697:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.138@tcp lock: ffff8cb079b80c00/0xca7fc0c411f93621 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xca7fc0c411f93628 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797013.273829:0:6697:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788797013.273836:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb080477100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+4:11661:x1875689374537216:12345-0@lo:104: Request processed in 91us (2052us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797013.273843:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788797013.273864:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788797013.273870:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb06ef1d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+3:11661:x1875689374537344:12345-0@lo:104: 00010000:00010000:0.0:1788797013.273877:0:6697:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.138@tcp lock: ffff8cb080436a00/0xca7fc0c411f93613 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xca7fc0c411f9361a expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797013.273917:0:6697:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788797013.273922:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb06ef1d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+3:11661:x1875689374537344:12345-0@lo:104: Request processed in 52us (1416us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797013.273928:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00010000:0.0:1788797013.273948:0:5815:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788797013.273964:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.138@tcp lock: ffff8cb079b80c00/0xca7fc0c411f93621 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xca7fc0c411f93628 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797013.273997:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb079b80c00 already unused, calling callback (ffffffffc1adac20) 10000000:00010000:0.0:1788797013.274002:0:5815:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.138@tcp lock: ffff8cb079b80c00/0xca7fc0c411f93621 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xca7fc0c411f93628 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797013.274013:0:5815:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.138@tcp lock: ffff8cb079b80c00/0xca7fc0c411f93621 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xca7fc0c411f93628 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788797013.274021:0:5815:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.138@tcp lock: ffff8cb079b80c00/0xca7fc0c411f93621 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xca7fc0c411f93628 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788797013.274058:0:5815:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:2.0:1788797013.274197:0:11661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788797013.274238:0:11661:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cb0821f0e00/0xca7fc0c411f935fe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee0fa2 expref: 12 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797013.274251:0:11661:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8cb0821f0e00/0xca7fc0c411f935fe lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee0fa2 expref: 12 pid: 5819 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788797013.274264:0:11661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb0498ee680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11661:1875689374537600:192.168.204.38@tcp:104: 00000100:00100000:1.0:1788797013.274308:0:5810:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1788797013.274324:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374537472 00000100:00100000:1.0:1788797013.274328:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374537472 00000100:00100000:1.0:1788797013.274355:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788797013.274364:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb080445450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+3:11661:x1875689374537472:12345-0@lo:104: 00010000:00010000:2.0:1788797013.274375:0:11661:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cb041485200/0xca7fc0c411f935f7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee0f9b expref: 12 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797013.274412:0:11661:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8cb041485200/0xca7fc0c411f935f7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee0f9b expref: 12 pid: 5820 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788797013.274421:0:11661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb080662680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11661:1875689374537728:192.168.204.38@tcp:104: 00000100:00100000:2.0:1788797013.274452:0:11661:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb069af30c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788797013.274481:0:11661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb080474380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11661:1875689374537216:0@lo:104: 00000100:00100000:2.0:1788797013.274491:0:11661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb06ef1df80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11661:1875689374537344:0@lo:104: 00010000:00010000:1.0:1788797013.274827:0:5810:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.138@tcp lock: ffff8cb079b81400/0xca7fc0c411f93605 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xca7fc0c411f9360c expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797013.274905:0:5810:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788797013.274912:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb080445450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+3:11661:x1875689374537472:12345-0@lo:104: Request processed in 550us (716us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797013.274920:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00010000:0.0:1788797013.274998:0:5815:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.138@tcp lock: ffff8cb079b80c00/0xca7fc0c411f93621 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca7fc0c411f93628 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797013.275006:0:5815:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788797013.275054:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.138@tcp lock: ffff8cb079b80c00/0xca7fc0c411f93621 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca7fc0c411f93628 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797013.275062:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.138@tcp lock: ffff8cb079b80c00/0xca7fc0c411f93621 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca7fc0c411f93628 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797013.275089:0:5815:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788797013.275094:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.138@tcp lock: ffff8cb080436a00/0xca7fc0c411f93613 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xca7fc0c411f9361a expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797013.275100:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb080436a00 already unused, calling callback (ffffffffc1adac20) 10000000:00010000:0.0:1788797013.275104:0:5815:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.138@tcp lock: ffff8cb080436a00/0xca7fc0c411f93613 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xca7fc0c411f9361a expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797013.275126:0:5815:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.138@tcp lock: ffff8cb080436a00/0xca7fc0c411f93613 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xca7fc0c411f9361a expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788797013.275134:0:5815:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.138@tcp lock: ffff8cb080436a00/0xca7fc0c411f93613 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xca7fc0c411f9361a expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788797013.275140:0:5815:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788797013.275158:0:5815:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.138@tcp lock: ffff8cb080436a00/0xca7fc0c411f93613 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca7fc0c411f9361a expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797013.275165:0:5815:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788797013.275183:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.138@tcp lock: ffff8cb080436a00/0xca7fc0c411f93613 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca7fc0c411f9361a expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797013.275191:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.138@tcp lock: ffff8cb080436a00/0xca7fc0c411f93613 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca7fc0c411f9361a expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797013.275202:0:5815:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788797013.275206:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.138@tcp lock: ffff8cb079b81400/0xca7fc0c411f93605 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xca7fc0c411f9360c expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797013.275212:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb079b81400 already unused, calling callback (ffffffffc1adac20) 10000000:00010000:0.0:1788797013.275216:0:5815:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.138@tcp lock: ffff8cb079b81400/0xca7fc0c411f93605 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xca7fc0c411f9360c expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797013.275222:0:5815:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.138@tcp lock: ffff8cb079b81400/0xca7fc0c411f93605 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xca7fc0c411f9360c expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788797013.275227:0:5815:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.138@tcp lock: ffff8cb079b81400/0xca7fc0c411f93605 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xca7fc0c411f9360c expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788797013.275238:0:5815:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788797013.275251:0:5815:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.138@tcp lock: ffff8cb079b81400/0xca7fc0c411f93605 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca7fc0c411f9360c expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797013.275256:0:5815:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788797013.275261:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.138@tcp lock: ffff8cb079b81400/0xca7fc0c411f93605 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca7fc0c411f9360c expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797013.275267:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.138@tcp lock: ffff8cb079b81400/0xca7fc0c411f93605 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca7fc0c411f9360c expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797013.275280:0:5815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788797013.275281:0:5815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788797013.275317:0:11661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb06ef1ce00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11661:1875689374537472:0@lo:104: 00010000:00010000:3.0:1788797013.275833:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788797013.276281:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb04982f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:3300:1875689374537984:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788797013.276368:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788797013.276387:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788797013.276402:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb04982df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:3303:1875689374537856:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788797013.276438:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb04982c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:3301:1875689374538112:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788797013.276584:0:5815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788797013.276628:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374537984 00000100:00100000:0.0:1788797013.276637:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374537984 00010000:00010000:0.0:1788797013.276683:0:6698:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cb079b81800/0xca7fc0c411f9361a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xca7fc0c411f93613 expref: 19 pid: 5818 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788797013.276866:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788797013.276945:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374537856 00000100:00100000:0.0:1788797013.276949:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374537856 00010000:00010000:0.0:1788797013.276964:0:6698:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cb0821f0a00/0xca7fc0c411f93628 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xca7fc0c411f93621 expref: 20 pid: 5818 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788797013.276987:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788797013.276996:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb080663b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+20:3300:x1875689374537984:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788797013.277012:0:6698:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788797013.277017:0:6698:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cb079b81800/0xca7fc0c411f9361a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xca7fc0c411f93613 expref: 20 pid: 5818 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788797013.277209:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788797013.277218:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb079177100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+20:3303:x1875689374537856:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788797013.277226:0:5811:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788797013.277230:0:5811:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cb0821f0a00/0xca7fc0c411f93628 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xca7fc0c411f93621 expref: 20 pid: 5818 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797013.277254:0:6698:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cb079b81800/0xca7fc0c411f9361a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xca7fc0c411f93613 expref: 20 pid: 5818 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788797013.277309:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788797013.277343:0:5812:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 4 min 3 max 56 00000100:00100000:2.0:1788797013.277354:0:5812:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_004' 00010000:00010000:3.0:1788797013.277383:0:5811:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cb0821f0a00/0xca7fc0c411f93628 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xca7fc0c411f93621 expref: 20 pid: 5818 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797013.277401:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cb0821f0a00/0xca7fc0c411f93628 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xca7fc0c411f93621 expref: 20 pid: 5818 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797013.277430:0:5811:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788797013.277480:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb079177100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+19:3303:x1875689374537856:12345-0@lo:103:ldlm_bl.0 Request processed in 264us (614us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797013.277488:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788797013.277506:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374538112 00000100:00100000:3.0:1788797013.277510:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374538112 00010000:00010000:3.0:1788797013.277523:0:5811:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cb041484800/0xca7fc0c411f9360c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xca7fc0c411f93605 expref: 19 pid: 5818 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788797013.277536:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788797013.277541:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb042edb850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+19:3301:x1875689374538112:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788797013.277549:0:5811:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788797013.277553:0:5811:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cb041484800/0xca7fc0c411f9360c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xca7fc0c411f93605 expref: 19 pid: 5818 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797013.277803:0:5811:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cb041484800/0xca7fc0c411f9360c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xca7fc0c411f93605 expref: 19 pid: 5818 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797013.277816:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cb041484800/0xca7fc0c411f9360c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xca7fc0c411f93605 expref: 19 pid: 5818 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797013.277824:0:5811:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788797013.277857:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb042edb850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+18:3301:x1875689374538112:12345-0@lo:103:ldlm_bl.0 Request processed in 316us (549us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797013.277864:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788797013.277904:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb04982df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:3303:1875689374537856:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788797013.277931:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb04982c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:3301:1875689374538112:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788797013.278355:0:6698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cb079b81800/0xca7fc0c411f9361a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xca7fc0c411f93613 expref: 17 pid: 5818 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797013.278368:0:6698:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788797013.278407:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb080663b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+16:3300:x1875689374537984:12345-0@lo:103:ldlm_bl.0 Request processed in 1412us (2040us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797013.278414:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788797013.280012:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb04982f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:3300:1875689374537984:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788797013.289347:0:11661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb0498ee680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11661:1875689374537600:192.168.204.38@tcp:104: 00000100:00100000:2.0:1788797013.289377:0:11661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb080662680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11661:1875689374537728:192.168.204.38@tcp:104: 00010000:00010000:2.0:1788797013.289424:0:11661:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8cb041485600/0xca7fc0c411f9375c lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788797013.295936:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1788797013.296091:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351436288 00000100:00100000:1.0:1788797013.296107:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351436288 00010000:00010000:1.0:1788797013.296165:0:5811:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cb041485200/0xca7fc0c411f935f7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee0f9b expref: 13 pid: 5820 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788797013.296210:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 33 00000100:00100000:1.0:1788797013.296221:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb079174380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b4d9d1a9-601d-459e-8721-8bfc2fdde84f+13:2354:x1875689351436288:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788797013.296241:0:5811:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788797013.296266:0:5811:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cb041485200/0xca7fc0c411f935f7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee0f9b expref: 13 pid: 5820 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797013.296280:0:5811:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cb041485200/0xca7fc0c411f935f7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee0f9b expref: 13 pid: 5820 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797013.296306:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cb041485200/0xca7fc0c411f935f7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee0f9b expref: 13 pid: 5820 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797013.296334:0:5811:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788797013.296425:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb079174380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b4d9d1a9-601d-459e-8721-8bfc2fdde84f+12:2354:x1875689351436288:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 206us (506us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797013.296433:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 33 00000100:00100000:0.0:1788797013.300306:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1788797013.300794:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351436160 00000100:00100000:2.0:1788797013.300808:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351436160 00010000:00010000:2.0:1788797013.300862:0:5813:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cb0821f0e00/0xca7fc0c411f935fe lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee0fa2 expref: 12 pid: 5819 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788797013.300970:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 34 00000100:00100000:2.0:1788797013.300983:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb04982f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b4d9d1a9-601d-459e-8721-8bfc2fdde84f+12:2355:x1875689351436160:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788797013.301022:0:5813:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788797013.301054:0:5813:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cb0821f0e00/0xca7fc0c411f935fe lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee0fa2 expref: 12 pid: 5819 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797013.301070:0:5813:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cb0821f0e00/0xca7fc0c411f935fe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee0fa2 expref: 12 pid: 5819 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797013.301109:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cb0821f0e00/0xca7fc0c411f935fe lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee0fa2 expref: 12 pid: 5819 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797013.301131:0:5813:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8cb041485600/0xca7fc0c411f9375c lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797013.301142:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cb041485600/0xca7fc0c411f9375c lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797013.301163:0:5813:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cb041485600/0xca7fc0c411f9375c lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797013.301170:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cb041485600/0xca7fc0c411f9375c lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797013.301177:0:5813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cb041485600/0xca7fc0c411f9375c lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797013.301183:0:5813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cb041485600/0xca7fc0c411f9375c lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797013.301189:0:5813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb041485600 already unused, calling callback (ffffffffc14d98b0) 00010000:00010000:2.0:1788797013.301194:0:5813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cb041485600/0xca7fc0c411f9375c lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797013.301213:0:5813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cb041485600/0xca7fc0c411f9375c lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797013.301240:0:5813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cb041485600/0xca7fc0c411f9375c lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797013.301252:0:5813:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788797013.301336:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb04982f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b4d9d1a9-601d-459e-8721-8bfc2fdde84f+11:2355:x1875689351436160:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 355us (1048us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797013.301343:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 34 00010000:00010000:3.0:1788797013.306736:0:11661:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8cb041485600/0xca7fc0c411f9375c lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797013.306760:0:11661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cb041485600/0xca7fc0c411f9375c lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797013.306768:0:11661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cb041485600/0xca7fc0c411f9375c lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797013.810365:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788797014.835487:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788797014.900019:0:5822:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788797014.900046:0:5822:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8cb042fd2800 from 7 10000000:01000000:2.0:1788797014.900051:0:5822:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788797014.900102:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.138@tcp lock: ffff8cb041484600/0xca7fc0c411f93763 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797014.900115:0:5822:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.138@tcp lock: ffff8cb041484600/0xca7fc0c411f93763 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797014.900126:0:5822:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.138@tcp lock: ffff8cb041484600/0xca7fc0c411f93763 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788797014.900156:0:5822:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb080662680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:5822:1875689374538240:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788797014.900319:0:5822:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788797014.900388:0:5822:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb069af30c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788797014.901194:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374538240 00000100:00100000:3.0:1788797014.901208:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374538240 00000100:00100000:3.0:1788797014.901273:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:3.0:1788797014.901283:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0465ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+16:5822:x1875689374538240:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788797014.901306:0:5818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788797014.901324:0:5818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cb080437600/0xca7fc0c411f9376a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xca7fc0c411f93763 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797014.901354:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cb080437600/0xca7fc0c411f9376a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xca7fc0c411f93763 expref: 17 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797014.901365:0:5818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cb080437600/0xca7fc0c411f9376a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xca7fc0c411f93763 expref: 17 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797014.901374:0:5818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb080437600, rc 0) 00000100:00100000:3.0:1788797014.901433:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0465ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+17:5822:x1875689374538240:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 151us (1180us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797014.901439:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:0.0:1788797014.901715:0:5822:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb080662680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:5822:1875689374538240:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788797014.901734:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.138@tcp lock: ffff8cb041484600/0xca7fc0c411f93763 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xca7fc0c411f9376a expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797014.901744:0:5822:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.138@tcp lock: ffff8cb041484600/0xca7fc0c411f93763 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xca7fc0c411f9376a expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788797014.901810:0:5822:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb04982c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:5822:1875689374538368:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788797014.901841:0:5822:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788797014.901889:0:5822:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb0484fa3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788797014.902167:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374538368 00000100:00100000:3.0:1788797014.902173:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374538368 00000100:00100000:3.0:1788797014.902207:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:3.0:1788797014.902214:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb06cfc5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+17:5822:x1875689374538368:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788797014.908328:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb06cfc5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+17:5822:x1875689374538368:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 6105us (6477us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797014.908343:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:0.0:1788797014.909095:0:5822:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb04982c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:5822:1875689374538368:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788797014.909158:0:5822:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb04982c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:5822:1875689374538496:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788797014.909226:0:5822:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788797014.909273:0:5822:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb0484fa3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788797014.911865:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374538496 00000100:00100000:3.0:1788797014.911893:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374538496 00000100:00100000:3.0:1788797014.911966:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:3.0:1788797014.911976:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0585b2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+17:5822:x1875689374538496:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788797014.912266:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0585b2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+17:5822:x1875689374538496:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 291us (3040us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797014.912275:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:0.0:1788797014.913457:0:5822:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb04982c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:5822:1875689374538496:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788797014.916006:0:11675:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb080660e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:11675:1875689374538624:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788797014.916130:0:11675:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788797014.916176:0:11675:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb069af39c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788797014.916775:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374538624 00000100:00100000:3.0:1788797014.916789:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374538624 00000100:00100000:3.0:1788797014.916859:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:3.0:1788797014.916868:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0585b2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+17:11675:x1875689374538624:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788797014.917453:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0585b2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+17:11675:x1875689374538624:12345-0@lo:502:llog_process_th.0 Request processed in 585us (1321us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797014.917463:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:2.0:1788797014.918149:0:11675:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb080660e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:11675:1875689374538624:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788797014.918201:0:11675:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788797014.918214:0:11675:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788797014.918216:0:11675:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788797014.918223:0:11675:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8cb042fd2800 00000020:00000080:2.0:1788797014.918227:0:11675:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788797014.918363:0:11675:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb080660e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:11675:1875689374538752:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788797014.918434:0:11675:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788797014.918484:0:11675:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb069af39c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788797014.918571:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374538752 00000100:00100000:1.0:1788797014.918578:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374538752 00000100:00100000:1.0:1788797014.918635:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:1.0:1788797014.918645:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0585b0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+17:11675:x1875689374538752:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788797014.918891:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0585b0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+17:11675:x1875689374538752:12345-0@lo:502:llog_process_th.0 Request processed in 247us (456us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797014.918900:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:2.0:1788797014.919849:0:11675:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb080660e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:11675:1875689374538752:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788797014.919897:0:11675:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788797014.919905:0:11675:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788797014.919908:0:11675:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1788797014.919913:0:11675:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:1.0:1788797014.924585:0:5822:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:1.0:1788797014.924638:0:5822:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.138@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788797014.924650:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.138@tcp lock: ffff8cb041484600/0xca7fc0c411f93763 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xca7fc0c411f9376a expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797014.924665:0:5822:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.138@tcp lock: ffff8cb041484600/0xca7fc0c411f93763 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xca7fc0c411f9376a expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788797014.924704:0:5822:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788797014.924707:0:5822:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8cb042fda000 from 7 10000000:01000000:1.0:1788797014.924710:0:5822:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788797014.924761:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.138@tcp lock: ffff8cb0821f0600/0xca7fc0c411f93771 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797014.924771:0:5822:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.138@tcp lock: ffff8cb0821f0600/0xca7fc0c411f93771 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797014.924782:0:5822:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.138@tcp lock: ffff8cb0821f0600/0xca7fc0c411f93771 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788797014.924814:0:5822:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb04945d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:5822:1875689374538880:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788797014.924901:0:5822:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788797014.924955:0:5822:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb081353e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788797014.925157:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374538880 00000100:00100000:3.0:1788797014.925165:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374538880 00000100:00100000:3.0:1788797014.925223:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:3.0:1788797014.925235:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0585b2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+17:5822:x1875689374538880:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788797014.925252:0:5819:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788797014.925286:0:5819:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cb080436400/0xca7fc0c411f93778 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xca7fc0c411f93771 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797014.925330:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cb080436400/0xca7fc0c411f93778 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xca7fc0c411f93771 expref: 18 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797014.925343:0:5819:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cb080436400/0xca7fc0c411f93778 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xca7fc0c411f93771 expref: 18 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797014.925353:0:5819:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb080436400, rc 0) 00000100:00100000:3.0:1788797014.925400:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0585b2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+18:5822:x1875689374538880:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 167us (499us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797014.925407:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:1.0:1788797014.926913:0:5822:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb04945d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:5822:1875689374538880:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788797014.926936:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.138@tcp lock: ffff8cb0821f0600/0xca7fc0c411f93771 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xca7fc0c411f93778 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797014.926946:0:5822:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.138@tcp lock: ffff8cb0821f0600/0xca7fc0c411f93771 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xca7fc0c411f93778 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788797014.927095:0:5822:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb04945d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:5822:1875689374539008:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788797014.927137:0:5822:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788797014.927170:0:5822:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb081353e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788797014.927509:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374539008 00000100:00100000:3.0:1788797014.927517:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374539008 00000100:00100000:3.0:1788797014.927578:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:3.0:1788797014.927597:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0585b0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+18:5822:x1875689374539008:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788797014.927885:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0585b0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+18:5822:x1875689374539008:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 289us (736us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797014.927893:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:1.0:1788797014.928601:0:5822:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb04945d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:5822:1875689374539008:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788797014.928654:0:5822:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb04945d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:5822:1875689374539136:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788797014.928738:0:5822:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788797014.928985:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374539136 00000100:00100000:2.0:1788797014.928994:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374539136 00000100:00100000:2.0:1788797014.929078:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:2.0:1788797014.929089:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0585b1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+18:5822:x1875689374539136:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788797014.929655:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0585b1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+18:5822:x1875689374539136:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 209us (557us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797014.929665:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:1.0:1788797014.930266:0:5822:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb081353e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788797014.930415:0:5822:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb04945d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:5822:1875689374539136:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788797014.933376:0:11677:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb079177100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:11677:1875689374539264:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788797014.933476:0:11677:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788797014.933580:0:11677:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb04a0bf540 going to sleep for 11 seconds 00000100:00100000:1.0:1788797014.939408:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374539264 00000100:00100000:1.0:1788797014.939426:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374539264 00000100:00100000:1.0:1788797014.939658:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:1.0:1788797014.939671:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0585b0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+18:11677:x1875689374539264:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788797014.939968:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0585b0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+18:11677:x1875689374539264:12345-0@lo:502:llog_process_th.0 Request processed in 300us (6490us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797014.939976:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:0.0:1788797014.940261:0:11677:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb079177100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:11677:1875689374539264:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788797014.941431:0:11677:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788797014.941465:0:11677:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788797014.941467:0:11677:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788797014.941476:0:11677:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8cb042fda000 00000020:00000080:0.0:1788797014.941479:0:11677:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788797014.944405:0:11677:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb04982c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:11677:1875689374539392:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788797014.944492:0:11677:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788797014.954268:0:11677:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb0484fa0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788797014.956750:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374539392 00000100:00100000:3.0:1788797014.956772:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374539392 00000100:00100000:3.0:1788797014.956863:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:3.0:1788797014.956875:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0585b3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+18:11677:x1875689374539392:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788797014.957236:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0585b3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+18:11677:x1875689374539392:12345-0@lo:502:llog_process_th.0 Request processed in 364us (12744us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797014.957253:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:0.0:1788797014.957543:0:11677:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb04982c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:11677:1875689374539392:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788797014.957578:0:11677:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788797014.957586:0:11677:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788797014.957589:0:11677:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1788797014.957604:0:11677:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000040:00080000:2.0:1788797014.959983:0:11679:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:01000000:3.0:1788797014.961423:0:5822:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:3.0:1788797014.961457:0:5822:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.138@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788797014.961470:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.138@tcp lock: ffff8cb0821f0600/0xca7fc0c411f93771 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xca7fc0c411f93778 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797014.961485:0:5822:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.138@tcp lock: ffff8cb0821f0600/0xca7fc0c411f93771 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xca7fc0c411f93778 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788797014.961496:0:5822:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788797014.961499:0:5822:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8cb042f0b000 from 7 10000000:01000000:3.0:1788797014.961502:0:5822:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788797014.961563:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.138@tcp lock: ffff8cb080437e00/0xca7fc0c411f9377f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797014.961572:0:5822:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.138@tcp lock: ffff8cb080437e00/0xca7fc0c411f9377f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797014.961583:0:5822:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.138@tcp lock: ffff8cb080437e00/0xca7fc0c411f9377f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788797014.961622:0:5822:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb079177100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:5822:1875689374539520:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788797014.961685:0:5822:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788797014.961738:0:5822:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb04a0bfc00 going to sleep for 11 seconds 00000100:00100000:0.0:1788797014.961994:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374539520 00000100:00100000:0.0:1788797014.962002:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374539520 00000100:00100000:0.0:1788797014.962072:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:0.0:1788797014.962082:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0585b2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+18:5822:x1875689374539520:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788797014.962096:0:5820:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788797014.962109:0:5820:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cb042ea2e00/0xca7fc0c411f93786 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xca7fc0c411f9377f expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797014.962133:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cb042ea2e00/0xca7fc0c411f93786 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xca7fc0c411f9377f expref: 19 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797014.962144:0:5820:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cb042ea2e00/0xca7fc0c411f93786 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xca7fc0c411f9377f expref: 19 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797014.962168:0:5820:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb042ea2e00, rc 0) 00000100:00100000:0.0:1788797014.962214:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0585b2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+19:5822:x1875689374539520:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 134us (529us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797014.962221:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:3.0:1788797014.966890:0:5822:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb079177100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:5822:1875689374539520:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788797014.966925:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.138@tcp lock: ffff8cb080437e00/0xca7fc0c411f9377f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xca7fc0c411f93786 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797014.966939:0:5822:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.138@tcp lock: ffff8cb080437e00/0xca7fc0c411f9377f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xca7fc0c411f93786 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788797014.967105:0:5822:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb079177100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:5822:1875689374539648:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788797014.967189:0:5822:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788797014.967246:0:5822:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb04a0bfc00 going to sleep for 11 seconds 00000100:00100000:3.0:1788797014.967271:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374539648 00000100:00100000:3.0:1788797014.967279:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374539648 00000100:00100000:3.0:1788797014.967340:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:3.0:1788797014.967350:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0585b3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+19:5822:x1875689374539648:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788797014.968506:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0585b3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+19:5822:x1875689374539648:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1151us (1311us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797014.970296:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:3.0:1788797014.970421:0:5822:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb079177100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:5822:1875689374539648:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788797014.970482:0:5822:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb079177100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:5822:1875689374539776:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788797014.973323:0:5822:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788797014.973368:0:5822:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb05005ef00 going to sleep for 11 seconds 00000100:00100000:3.0:1788797014.974951:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374539776 00000100:00100000:3.0:1788797014.974968:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374539776 00000100:00100000:3.0:1788797014.975048:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:3.0:1788797014.975060:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0585b1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+19:5822:x1875689374539776:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788797014.976465:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0585b1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+19:5822:x1875689374539776:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1400us (3143us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797014.976478:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:2.0:1788797014.977430:0:5822:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb079177100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:5822:1875689374539776:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788797014.977698:0:11681:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb080660e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:11681:1875689374539904:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788797014.977770:0:11681:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788797014.977808:0:11681:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb069af30c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788797014.980207:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374539904 00000100:00100000:3.0:1788797014.980221:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374539904 00000100:00100000:3.0:1788797014.980269:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:3.0:1788797014.980279:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0585b1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+19:11681:x1875689374539904:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788797014.980573:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0585b1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+19:11681:x1875689374539904:12345-0@lo:502:llog_process_th.0 Request processed in 295us (2804us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797014.980581:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:1.0:1788797014.980943:0:11681:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb080660e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:11681:1875689374539904:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788797014.980988:0:11681:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788797014.981000:0:11681:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788797014.981002:0:11681:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788797014.981010:0:11681:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8cb042f0b000 00000020:00000080:1.0:1788797014.981013:0:11681:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1788797014.981251:0:11681:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb04945d500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:11681:1875689374540032:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788797014.981326:0:11681:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788797014.981362:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374540032 00000100:00100000:1.0:1788797014.981368:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374540032 00000100:00100000:1.0:1788797014.981408:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:1.0:1788797014.981417:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0585b3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+19:11681:x1875689374540032:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788797014.983187:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0585b3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+19:11681:x1875689374540032:12345-0@lo:502:llog_process_th.0 Request processed in 1765us (1854us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797014.983202:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:1.0:1788797014.983308:0:11681:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb081353cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788797014.983340:0:11681:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb04945d500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:11681:1875689374540032:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788797014.983376:0:11681:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788797014.983384:0:11681:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788797014.983386:0:11681:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1788797014.983392:0:11681:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:1.0:1788797014.983555:0:5822:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:1.0:1788797014.983576:0:5822:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.138@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788797014.983586:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.138@tcp lock: ffff8cb080437e00/0xca7fc0c411f9377f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xca7fc0c411f93786 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797014.986004:0:5822:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.138@tcp lock: ffff8cb080437e00/0xca7fc0c411f9377f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xca7fc0c411f93786 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788797015.123513:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1788797015.123954:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351436416 00000100:00100000:0.0:1788797015.123965:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351436416 00000100:00100000:0.0:1788797015.124018:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 270 00000100:00100000:0.0:1788797015.124069:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0585b1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4d9d1a9-601d-459e-8721-8bfc2fdde84f+11:5611:x1875689351436416:12345-192.168.204.38@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788797015.124085:0:5819:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788797015.124102:0:5819:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cb042ea2000/0xca7fc0c411f9378d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x7c99e04559ee0fef expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797015.124133:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cb042ea2000/0xca7fc0c411f9378d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee0fef expref: 12 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797015.124150:0:5819:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cb042ea2000/0xca7fc0c411f9378d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee0fef expref: 12 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797015.124159:0:5819:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb042ea2000, rc 0) 00000100:00100000:0.0:1788797015.124245:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0585b1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4d9d1a9-601d-459e-8721-8bfc2fdde84f+12:5611:x1875689351436416:12345-192.168.204.38@tcp:101:ll_cfg_requeue.0 Request processed in 217us (741us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797015.124253:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 270 00000100:00100000:0.0:1788797015.130900:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1788797015.131128:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351436544 00000100:00100000:3.0:1788797015.131139:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351436544 00000100:00100000:3.0:1788797015.131199:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 271 00000100:00100000:3.0:1788797015.131210:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0585b3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4d9d1a9-601d-459e-8721-8bfc2fdde84f+12:5611:x1875689351436544:12345-192.168.204.38@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788797015.131517:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0585b3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4d9d1a9-601d-459e-8721-8bfc2fdde84f+12:5611:x1875689351436544:12345-192.168.204.38@tcp:501:ll_cfg_requeue.0 Request processed in 300us (618us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797015.131534:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 271 00000100:00100000:3.0:1788797015.135762:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1788797015.135920:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351436672 00000100:00100000:1.0:1788797015.135931:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351436672 00000100:00100000:1.0:1788797015.136814:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 272 00000100:00100000:1.0:1788797015.136827:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0585b0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4d9d1a9-601d-459e-8721-8bfc2fdde84f+12:5611:x1875689351436672:12345-192.168.204.38@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788797015.138116:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0585b0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4d9d1a9-601d-459e-8721-8bfc2fdde84f+12:5611:x1875689351436672:12345-192.168.204.38@tcp:503:ll_cfg_requeue.0 Request processed in 1286us (2359us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797015.138137:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 272 00000100:00100000:1.0:1788797015.148086:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1788797015.148204:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351436800 00000100:00100000:0.0:1788797015.148218:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351436800 00000100:00100000:0.0:1788797015.148284:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 273 00000100:00100000:0.0:1788797015.148297:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb04886ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4d9d1a9-601d-459e-8721-8bfc2fdde84f+12:9985:x1875689351436800:12345-192.168.204.38@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788797015.148594:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb04886ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4d9d1a9-601d-459e-8721-8bfc2fdde84f+12:9985:x1875689351436800:12345-192.168.204.38@tcp:502:llog_process_th.0 Request processed in 300us (572us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797015.148602:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 273 00000100:00100000:0.0:1788797015.158938:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1788797015.159283:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351436928 00000100:00100000:1.0:1788797015.159294:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351436928 00000100:00100000:1.0:1788797015.159349:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 274 00000100:00100000:1.0:1788797015.159360:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb048868450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4d9d1a9-601d-459e-8721-8bfc2fdde84f+12:9985:x1875689351436928:12345-192.168.204.38@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788797015.159637:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb048868450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4d9d1a9-601d-459e-8721-8bfc2fdde84f+12:9985:x1875689351436928:12345-192.168.204.38@tcp:502:llog_process_th.0 Request processed in 278us (707us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797015.159652:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 274 00000100:00100000:1.0:1788797015.166845:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1788797015.167576:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351437056 00000100:00100000:3.0:1788797015.167588:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351437056 00000100:00100000:3.0:1788797015.167668:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 275 00000100:00100000:3.0:1788797015.167681:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb048869450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4d9d1a9-601d-459e-8721-8bfc2fdde84f+12:5611:x1875689351437056:12345-192.168.204.38@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788797015.167700:0:5820:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788797015.167721:0:5820:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cb080436c00/0xca7fc0c411f93794 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x7c99e04559ee0ff6 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797015.167748:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cb080436c00/0xca7fc0c411f93794 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee0ff6 expref: 13 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797015.167758:0:5820:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cb080436c00/0xca7fc0c411f93794 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee0ff6 expref: 13 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797015.167766:0:5820:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb080436c00, rc 0) 00000100:00100000:3.0:1788797015.167853:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb048869450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4d9d1a9-601d-459e-8721-8bfc2fdde84f+13:5611:x1875689351437056:12345-192.168.204.38@tcp:101:ll_cfg_requeue.0 Request processed in 173us (1021us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797015.167912:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 275 00000100:00100000:3.0:1788797015.171874:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1788797015.180853:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351437184 00000100:00100000:0.0:1788797015.180869:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351437184 00000100:00100000:2.0:1788797015.181080:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 276 00000100:00100000:2.0:1788797015.181096:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb048868c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4d9d1a9-601d-459e-8721-8bfc2fdde84f+13:5611:x1875689351437184:12345-192.168.204.38@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788797015.181479:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb048868c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4d9d1a9-601d-459e-8721-8bfc2fdde84f+13:5611:x1875689351437184:12345-192.168.204.38@tcp:501:ll_cfg_requeue.0 Request processed in 385us (9613us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797015.181487:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 276 00000100:00100000:0.0:1788797015.190559:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1788797015.190677:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351437312 00000100:00100000:1.0:1788797015.190689:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351437312 00000100:00100000:1.0:1788797015.190758:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 277 00000100:00100000:1.0:1788797015.190769:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb048868850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4d9d1a9-601d-459e-8721-8bfc2fdde84f+13:5611:x1875689351437312:12345-192.168.204.38@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788797015.191236:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb048868850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4d9d1a9-601d-459e-8721-8bfc2fdde84f+13:5611:x1875689351437312:12345-192.168.204.38@tcp:503:ll_cfg_requeue.0 Request processed in 468us (689us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797015.191244:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 277 00000100:00100000:1.0:1788797015.203284:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1788797015.203595:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351437440 00000100:00100000:3.0:1788797015.203606:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351437440 00000100:00100000:3.0:1788797015.203860:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 278 00000100:00100000:3.0:1788797015.203882:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb04886bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4d9d1a9-601d-459e-8721-8bfc2fdde84f+13:9988:x1875689351437440:12345-192.168.204.38@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788797015.204261:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb04886bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4d9d1a9-601d-459e-8721-8bfc2fdde84f+13:9988:x1875689351437440:12345-192.168.204.38@tcp:502:llog_process_th.0 Request processed in 391us (990us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797015.204286:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 278 00000100:00100000:3.0:1788797015.208742:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1788797015.210191:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351437568 00000100:00100000:1.0:1788797015.210206:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351437568 00000100:00100000:1.0:1788797015.210274:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 279 00000100:00100000:1.0:1788797015.210285:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb04886a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4d9d1a9-601d-459e-8721-8bfc2fdde84f+13:9988:x1875689351437568:12345-192.168.204.38@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788797015.210599:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb04886a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4d9d1a9-601d-459e-8721-8bfc2fdde84f+13:9988:x1875689351437568:12345-192.168.204.38@tcp:502:llog_process_th.0 Request processed in 315us (1866us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797015.210608:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 279 00010000:00010000:0.0:1788797015.858349:0:5815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788797015.974139:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1788797015.974182:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1788797015.974207:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1788797015.974235:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1788797015.974269:0:7636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351437824 00000100:00100000:2.0:1788797015.974281:0:7636:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351437824 00000100:00100000:2.0:1788797015.974346:0:7636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351438080 00000100:00100000:2.0:1788797015.974349:0:7636:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351438080 00000100:00100000:2.0:1788797015.974375:0:7636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 113 00000100:00100000:2.0:1788797015.974385:0:7636:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb080663100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6d050bb-169e-4784-be5b-7071799bf3b0+5:2353:x1875689351437824:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:2.0:1788797015.974463:0:7636:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb080663100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6d050bb-169e-4784-be5b-7071799bf3b0+5:2353:x1875689351437824:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 79us (255us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797015.974470:0:7636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 113 00000100:00100000:2.0:1788797015.974487:0:7636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 114 00000100:00100000:2.0:1788797015.974493:0:7636:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb080663800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed124ec0-b908-4000-b768-8e53d5def0fc+5:2353:x1875689351438080:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:2.0:1788797015.974528:0:7636:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb080663800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed124ec0-b908-4000-b768-8e53d5def0fc+5:2353:x1875689351438080:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 35us (292us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797015.974533:0:7636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 114 00000100:00080000:2.0:1788797015.974571:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788797015.974753:0:10829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351437952 00000100:00100000:3.0:1788797015.974759:0:10829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351437952 00000100:00100000:3.0:1788797015.974808:0:10829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 43 00000100:00100000:3.0:1788797015.974825:0:10829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb080661f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e6d050bb-169e-4784-be5b-7071799bf3b0+5:2353:x1875689351437952:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:3.0:1788797015.974856:0:10829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb080661f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e6d050bb-169e-4784-be5b-7071799bf3b0+5:2353:x1875689351437952:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 41us (673us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797015.974862:0:10829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 43 00000100:00080000:2.0:1788797015.975416:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788797015.975548:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351437696 00000100:00100000:1.0:1788797015.975556:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351437696 00000100:00100000:1.0:1788797015.975605:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 280 00000100:00100000:1.0:1788797015.975613:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb04886b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4d9d1a9-601d-459e-8721-8bfc2fdde84f+13:2353:x1875689351437696:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:1.0:1788797015.975668:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb04886b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4d9d1a9-601d-459e-8721-8bfc2fdde84f+13:2353:x1875689351437696:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 56us (1543us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797015.975674:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 280 00000040:00080000:2.0:1788797015.987397:0:11679:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788797016.882221:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788797017.138677:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb04945d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875689374540160:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788797017.138790:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788797017.139365:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374540160 00000100:00100000:0.0:1788797017.139378:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374540160 00000100:00100000:0.0:1788797017.139452:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788797017.139462:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb080661500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875689374540160:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788797017.139510:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788797017.139572:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb080661500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875689374540160:12345-0@lo:13:osp-pre-0-0.0 Request processed in 112us (782us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797017.139581:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788797017.141968:0:3302:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967300 gen 2 00000004:00080000:0.0:1788797017.141983:0:3302:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8cb0498ef480, transno 4294967300 00000100:00100000:0.0:1788797017.142054:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb04945d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875689374540160:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788797017.142197:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788797017.652939:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb080663480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875689374540288:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788797017.653080:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788797017.654552:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374540288 00000100:00100000:2.0:1788797017.654576:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374540288 00000100:00100000:2.0:1788797017.654710:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788797017.654724:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb04982c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875689374540288:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788797017.654771:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788797017.654854:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb04982c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875689374540288:12345-0@lo:13:osp-pre-1-0.0 Request processed in 134us (1774us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797017.654862:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00010000:00080000:2.0:1788797017.654909:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cb080663480 x1875689374540288/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788797033 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788797017.654931:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb080663480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875689374540288:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788797017.655550:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb080663480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:3300:1875689374540416:0@lo:400:kworker.0 00000100:00100000:1.0:1788797017.655605:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788797017.655748:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb080662a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3301:1875689374540544:0@lo:400:kworker.0 00000100:00100000:3.0:1788797017.655785:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788797017.655826:0:7636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374540544 00000100:00100000:3.0:1788797017.655831:0:7636:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374540544 00000100:00100000:3.0:1788797017.655866:0:7636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1788797017.655873:0:7636:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb079177100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1875689374540544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788797017.655934:0:7636:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb079177100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1875689374540544:12345-0@lo:400:kworker.0 Request processed in 61us (148us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797017.655941:0:7636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1788797017.655971:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb080662a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3301:1875689374540544:0@lo:400:kworker.0 00000100:00080000:0.0:1788797017.658255:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788797017.658318:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374540416 00000100:00100000:0.0:1788797017.658335:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374540416 00000100:00100000:0.0:1788797017.658427:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 281 00000100:00100000:0.0:1788797017.658437:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb048869850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+19:3300:x1875689374540416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788797017.664607:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb080660000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3302:1875689374540672:0@lo:400:kworker.0 00000100:00100000:3.0:1788797017.664711:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788797017.664915:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb048869850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+19:3300:x1875689374540416:12345-0@lo:400:kworker.0 Request processed in 6476us (9305us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797017.664928:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 281 00000100:00100000:0.0:1788797017.665002:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb080661180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3303:1875689374540800:0@lo:400:kworker.0 00000100:00100000:0.0:1788797017.665055:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788797017.665100:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374540672 00000100:00100000:0.0:1788797017.665107:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374540672 00000100:00100000:0.0:1788797017.665156:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374540800 00000100:00100000:0.0:1788797017.665159:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374540800 00000100:00100000:0.0:1788797017.665183:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1788797017.665194:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb049408e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1875689374540672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788797017.668572:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb080663480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:3300:1875689374540416:0@lo:400:kworker.0 00000100:00080000:1.0:1788797017.668658:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788797017.668716:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1788797017.668738:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb04982df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1875689374540800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788797017.668862:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb04982df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1875689374540800:12345-0@lo:400:kworker.0 Request processed in 136us (3806us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797017.668881:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1788797017.668936:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb080661180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3303:1875689374540800:0@lo:400:kworker.0 00000100:00100000:0.0:1788797017.671257:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb049408e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1875689374540672:12345-0@lo:400:kworker.0 Request processed in 6048us (6531us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797017.671275:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1788797017.671425:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb080660000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3302:1875689374540672:0@lo:400:kworker.0 00010000:00010000:1.0:1788797017.908291:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788797018.930892:0:5815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788797019.958805:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788797020.978783:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788797021.077466:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1788797021.077519:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1788797021.077575:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1788797021.077611:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1788797021.077654:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351438464 00000100:00100000:2.0:1788797021.077665:0:6683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351438464 00000100:00100000:0.0:1788797021.077686:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351438208 00000100:00100000:0.0:1788797021.077700:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351438208 00000100:00100000:2.0:1788797021.077749:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 44 00000100:00100000:2.0:1788797021.077767:0:6683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb080662300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e6d050bb-169e-4784-be5b-7071799bf3b0+5:2352:x1875689351438464:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:0.0:1788797021.077778:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 282 00000100:00100000:0.0:1788797021.077793:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb04886b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4d9d1a9-601d-459e-8721-8bfc2fdde84f+13:2352:x1875689351438208:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:2.0:1788797021.077856:0:6683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb080662300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e6d050bb-169e-4784-be5b-7071799bf3b0+5:2352:x1875689351438464:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 93us (240us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797021.077868:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb04886b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4d9d1a9-601d-459e-8721-8bfc2fdde84f+13:2352:x1875689351438208:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 78us (299us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797021.077877:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 282 00000100:00100000:2.0:1788797021.077899:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 44 00000100:00080000:0.0:1788797021.077980:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788797021.078060:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351438336 00000100:00100000:1.0:1788797021.078067:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351438336 00000100:00100000:1.0:1788797021.078108:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351438592 00000100:00100000:1.0:1788797021.078111:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351438592 00000100:00080000:0.0:1788797021.078152:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788797021.078160:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 118 00000100:00100000:1.0:1788797021.078173:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb080660a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6d050bb-169e-4784-be5b-7071799bf3b0+5:2352:x1875689351438336:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:0.0:1788797021.078195:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 119 00000100:00100000:0.0:1788797021.078209:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb080660700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed124ec0-b908-4000-b768-8e53d5def0fc+5:2352:x1875689351438592:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:1.0:1788797021.078226:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb080660a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6d050bb-169e-4784-be5b-7071799bf3b0+5:2352:x1875689351438336:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 53us (773us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797021.078245:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 118 00000100:00100000:0.0:1788797021.078285:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb080660700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed124ec0-b908-4000-b768-8e53d5def0fc+5:2352:x1875689351438592:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 79us (764us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797021.078295:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 119 00010000:00010000:0.0:1788797022.002445:0:5815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788797022.258610:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788797022.258649:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb04945f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875689374540928:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788797022.258754:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788797022.258882:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374540928 00000100:00100000:0.0:1788797022.258892:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374540928 00000100:00100000:0.0:1788797022.258964:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788797022.258975:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb04940b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1875689374540928:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788797022.259013:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788797022.259086:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb04940b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1875689374540928:12345-0@lo:13:osp-pre-0-0.0 Request processed in 113us (331us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797022.259093:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788797022.259140:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb04945f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875689374540928:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788797022.259499:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788797022.770472:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb04945dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875689374541312:0@lo:400:kworker.0 00000100:00100000:1.0:1788797022.770561:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788797022.770646:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1788797022.770653:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb04945ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:3303:1875689374541184:0@lo:400:kworker.0 00000100:00100000:1.0:1788797022.770706:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788797022.770731:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb04945d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875689374541696:0@lo:400:kworker.0 00000100:00100000:1.0:1788797022.770757:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788797022.770790:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374541312 00000100:00100000:1.0:1788797022.770800:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374541312 00000100:00100000:1.0:1788797022.770854:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1788797022.770864:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0796c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875689374541312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788797022.770928:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0796c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875689374541312:12345-0@lo:400:kworker.0 Request processed in 55us (357us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797022.770936:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1788797022.770985:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb04945dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875689374541312:0@lo:400:kworker.0 00000100:00100000:0.0:1788797022.771685:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb080660380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875689374541056:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788797022.771735:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788797022.771768:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb04945f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3301:1875689374541568:0@lo:400:kworker.0 00000100:00100000:0.0:1788797022.771793:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788797022.771822:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788797022.771828:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb04945e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3301:1875689374541440:0@lo:400:kworker.0 00000100:00100000:0.0:1788797022.771875:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788797022.771908:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374541184 00000100:00100000:0.0:1788797022.771913:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374541184 00000100:00100000:0.0:1788797022.771958:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283 00000100:00100000:0.0:1788797022.771965:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb048869c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+19:3303:x1875689374541184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788797022.772014:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb048869c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+19:3303:x1875689374541184:12345-0@lo:400:kworker.0 Request processed in 48us (1307us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797022.772058:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283 00000100:00100000:0.0:1788797022.772090:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374541568 00000100:00100000:0.0:1788797022.772094:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374541568 00000100:00100000:0.0:1788797022.772128:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374541440 00000100:00100000:0.0:1788797022.772131:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374541440 00000100:00100000:0.0:1788797022.772146:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1788797022.772151:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb077921180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1875689374541568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788797022.772185:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb077921180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1875689374541568:12345-0@lo:400:kworker.0 Request processed in 33us (391us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797022.772192:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1788797022.772203:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1788797022.772209:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb077f08380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1875689374541440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788797022.772235:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb077f08380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1875689374541440:12345-0@lo:400:kworker.0 Request processed in 27us (361us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797022.772241:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00080000:0.0:1788797022.772260:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788797022.772290:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb04945e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3301:1875689374541440:0@lo:400:kworker.0 00000100:00100000:0.0:1788797022.772301:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb04945f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3301:1875689374541568:0@lo:400:kworker.0 00000100:00100000:0.0:1788797022.772328:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb04945ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:3303:1875689374541184:0@lo:400:kworker.0 00000100:00100000:2.0:1788797022.772666:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374541056 00000100:00100000:2.0:1788797022.772671:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374541056 00000100:00100000:2.0:1788797022.772717:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788797022.772725:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb077920000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1875689374541056:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788797022.772754:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788797022.772799:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb077920000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1875689374541056:12345-0@lo:13:osp-pre-1-0.0 Request processed in 76us (1064us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797022.772805:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00010000:00080000:2.0:1788797022.772842:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cb080660380 x1875689374541056/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788797038 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788797022.772859:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb080660380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875689374541056:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788797022.773548:0:10829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374541696 00000100:00100000:3.0:1788797022.773555:0:10829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374541696 00000100:00100000:3.0:1788797022.773589:0:10829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788797022.773597:0:10829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0796c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3303:x1875689374541696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788797022.773771:0:10829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0796c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3303:x1875689374541696:12345-0@lo:400:kworker.0 Request processed in 175us (3013us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797022.773777:0:10829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:2.0:1788797022.775622:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cb04945d500 x1875689374541696/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788797038 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788797022.775653:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb04945d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875689374541696:0@lo:400:kworker.0 00000100:00080000:0.0:1788797022.776831:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1788797023.026289:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788797024.050389:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788797025.074282:0:5815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788797025.203961:0:11679:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788797026.098923:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788797026.203705:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1788797026.203788:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351438720 00000100:00100000:0.0:1788797026.203803:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351438720 00000100:00100000:0.0:1788797026.203875:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 284 00000100:00100000:2.0:1788797026.203883:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1788797026.203889:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb04886b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4d9d1a9-601d-459e-8721-8bfc2fdde84f+13:2353:x1875689351438720:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:2.0:1788797026.203929:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1788797026.204003:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb04886b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4d9d1a9-601d-459e-8721-8bfc2fdde84f+13:2353:x1875689351438720:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 119us (310us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797026.204013:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 284 00000100:00100000:3.0:1788797026.204018:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351438976 00000100:00100000:3.0:1788797026.204024:0:6683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351438976 00000100:00100000:3.0:1788797026.204104:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 46 00000100:00100000:3.0:1788797026.204114:0:6683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb080660380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e6d050bb-169e-4784-be5b-7071799bf3b0+5:2353:x1875689351438976:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:1.0:1788797026.204253:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351438848 00000100:00100000:1.0:1788797026.204258:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351438848 00000100:00100000:1.0:1788797026.204291:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 123 00000100:00100000:1.0:1788797026.204299:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb080662d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6d050bb-169e-4784-be5b-7071799bf3b0+5:2353:x1875689351438848:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:2.0:1788797026.208816:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1788797026.208894:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351439104 00000100:00100000:2.0:1788797026.208907:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351439104 00000100:00100000:3.0:1788797026.208941:0:6683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb080660380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e6d050bb-169e-4784-be5b-7071799bf3b0+5:2353:x1875689351438976:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 4825us (5055us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797026.208975:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 46 00000100:00100000:2.0:1788797026.208986:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 124 00000100:00100000:2.0:1788797026.208996:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb080661880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed124ec0-b908-4000-b768-8e53d5def0fc+5:2353:x1875689351439104:12345-192.168.204.38@tcp:400:kworker.0 00000100:00080000:3.0:1788797026.209010:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788797026.209015:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788797026.209070:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb080661880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed124ec0-b908-4000-b768-8e53d5def0fc+5:2353:x1875689351439104:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 76us (267us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797026.209084:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 124 00000100:00100000:1.0:1788797026.212718:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb080662d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6d050bb-169e-4784-be5b-7071799bf3b0+5:2353:x1875689351438848:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 8407us (8777us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797026.212794:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 123 00010000:00010000:1.0:1788797027.122596:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788797027.378992:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788797027.379022:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb0796c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875689374541824:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788797027.379128:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788797027.379218:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374541824 00000100:00100000:1.0:1788797027.379225:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374541824 00000100:00100000:1.0:1788797027.379276:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788797027.379320:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb04945d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875689374541824:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788797027.379354:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788797027.379399:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb04945d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875689374541824:12345-0@lo:13:osp-pre-0-0.0 Request processed in 82us (271us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797027.379406:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00080000:3.0:1788797027.381889:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788797027.382515:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb0796c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875689374541824:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788797027.890358:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb04945dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3303:1875689374542336:0@lo:400:kworker.0 00000100:00100000:1.0:1788797027.890446:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788797027.890535:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788797027.890549:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb04945e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3303:1875689374542208:0@lo:400:kworker.0 00000100:00100000:1.0:1788797027.890571:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788797027.890608:0:7636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374542336 00000100:00100000:1.0:1788797027.890616:0:7636:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374542336 00000100:00100000:1.0:1788797027.890664:0:7636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374542208 00000100:00100000:1.0:1788797027.890668:0:7636:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374542208 00000100:00100000:1.0:1788797027.890691:0:7636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1788797027.890699:0:7636:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb080474380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1875689374542336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788797027.890753:0:7636:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb080474380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1875689374542336:12345-0@lo:400:kworker.0 Request processed in 53us (307us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797027.890761:0:7636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1788797027.890787:0:7636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1788797027.890794:0:7636:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb080475c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875689374542208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788797027.890822:0:7636:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb080475c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875689374542208:12345-0@lo:400:kworker.0 Request processed in 29us (250us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797027.890828:0:7636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1788797027.890866:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb04945e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3303:1875689374542208:0@lo:400:kworker.0 00000100:00100000:1.0:1788797027.890896:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb04945dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3303:1875689374542336:0@lo:400:kworker.0 00000100:00100000:3.0:1788797027.891345:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb04945ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:3300:1875689374541952:0@lo:400:kworker.0 00000100:00100000:3.0:1788797027.891394:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788797027.891441:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb0796c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875689374542464:0@lo:400:kworker.0 00000100:00100000:3.0:1788797027.891470:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788797027.891495:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788797027.891502:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb04945f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3300:1875689374542080:0@lo:400:kworker.0 00000100:00100000:3.0:1788797027.891683:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788797027.891724:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374542080 00000100:00100000:3.0:1788797027.891731:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374542080 00000100:00100000:3.0:1788797027.891772:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1788797027.891802:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb04940aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1875689374542080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788797027.891843:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb04940aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1875689374542080:12345-0@lo:400:kworker.0 Request processed in 51us (160us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797027.891850:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1788797027.891878:0:10829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374542464 00000100:00100000:3.0:1788797027.891881:0:10829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374542464 00000100:00100000:3.0:1788797027.891911:0:10829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788797027.891918:0:10829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb04940b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3300:x1875689374542464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788797027.891950:0:10829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb04940b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3300:x1875689374542464:12345-0@lo:400:kworker.0 Request processed in 33us (479us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797027.891955:0:10829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00080000:3.0:1788797027.891976:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788797027.891992:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788797027.892022:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb04945f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3300:1875689374542080:0@lo:400:kworker.0 00010000:00080000:3.0:1788797027.892075:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cb0796c5880 x1875689374542464/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788797043 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788797027.892086:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb0796c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875689374542464:0@lo:400:kworker.0 00000100:00100000:2.0:1788797027.892750:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb049408000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875689374542592:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788797027.892854:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788797027.892933:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374542592 00000100:00100000:3.0:1788797027.892939:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374542592 00000100:00100000:3.0:1788797027.892981:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788797027.892989:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb080661c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1875689374542592:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788797027.893022:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788797027.893142:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374541952 00000100:00100000:1.0:1788797027.893147:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374541952 00000100:00100000:1.0:1788797027.893184:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:1.0:1788797027.893191:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb048868050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+19:3300:x1875689374541952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788797027.893234:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb048868050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+19:3300:x1875689374541952:12345-0@lo:400:kworker.0 Request processed in 43us (1839us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797027.893240:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00000100:00100000:1.0:1788797027.893295:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb04945ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:3300:1875689374541952:0@lo:400:kworker.0 00000100:00100000:3.0:1788797027.894191:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb080661c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1875689374542592:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1199us (1333us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797027.894201:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00010000:00080000:2.0:1788797027.896518:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cb049408000 x1875689374542592/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788797043 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788797027.896657:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb049408000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875689374542592:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788797028.146279:0:5815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788797029.171010:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788797030.194586:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788797031.218725:0:5815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788797031.317939:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1788797031.318009:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1788797031.318157:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351439360 00000100:00100000:3.0:1788797031.318168:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351439360 00000100:00100000:3.0:1788797031.318268:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 128 00000100:00100000:3.0:1788797031.318281:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb080660000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6d050bb-169e-4784-be5b-7071799bf3b0+5:2355:x1875689351439360:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:3.0:1788797031.318389:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb080660000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6d050bb-169e-4784-be5b-7071799bf3b0+5:2355:x1875689351439360:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 111us (379us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797031.318398:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 128 00000100:00080000:0.0:1788797031.318636:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788797031.318951:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351439232 00000100:00100000:1.0:1788797031.318958:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351439232 00000100:00100000:1.0:1788797031.319004:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 286 00000100:00100000:1.0:1788797031.319013:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb04886a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4d9d1a9-601d-459e-8721-8bfc2fdde84f+13:2355:x1875689351439232:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:1.0:1788797031.319087:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb04886a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4d9d1a9-601d-459e-8721-8bfc2fdde84f+13:2355:x1875689351439232:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 75us (1162us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797031.319093:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 286 00000100:00100000:2.0:1788797031.344303:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1788797031.344357:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1788797031.344492:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351439616 00000100:00100000:1.0:1788797031.344504:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351439616 00000100:00100000:1.0:1788797031.344604:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 129 00000100:00100000:1.0:1788797031.344616:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb080663480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed124ec0-b908-4000-b768-8e53d5def0fc+5:2355:x1875689351439616:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:1.0:1788797031.344706:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb080663480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed124ec0-b908-4000-b768-8e53d5def0fc+5:2355:x1875689351439616:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 93us (347us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797031.344714:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 129 00000100:00100000:3.0:1788797031.345737:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351439488 00000100:00100000:3.0:1788797031.345748:0:6683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351439488 00000100:00100000:3.0:1788797031.345804:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 20 00000100:00100000:3.0:1788797031.345815:0:6683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb080661180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e6d050bb-169e-4784-be5b-7071799bf3b0+5:2351:x1875689351439488:12345-192.168.204.38@tcp:9:kworker.0 00000100:00080000:0.0:1788797031.345847:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00000080:3.0:1788797031.345854:0:6683:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xca7fc0c411f936d0 00000100:00080000:0.0:1788797031.345856:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788797031.345883:0:6683:0:(import.c:65:import_set_state_nolock()) ffff8cb0779d6800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788797031.345940:0:6683:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967300 00000100:00100000:3.0:1788797031.346742:0:6683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb080661180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e6d050bb-169e-4784-be5b-7071799bf3b0+2:2351:x1875689351439488:12345-192.168.204.38@tcp:9:kworker.0 Request processed in 927us (2449us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797031.346752:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 20 00010000:00010000:1.0:1788797031.347280:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788797032.242312:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788797032.499223:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb080476680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875689374542720:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788797032.499302:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788797032.499505:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374542720 00000100:00100000:1.0:1788797032.499514:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374542720 00000100:00100000:1.0:1788797032.499584:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788797032.499605:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb077f0ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875689374542720:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788797032.499639:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788797032.499688:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb077f0ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875689374542720:12345-0@lo:13:osp-pre-0-0.0 Request processed in 96us (387us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797032.499695:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00080000:0.0:1788797032.499950:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788797032.499990:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb080476680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875689374542720:0@lo:13:osp-pre-0-0.0 00000001:00100000:0.0:1788797032.588945:0:6713:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of e6d050bb-169e-4784-be5b-7071799bf3b0 00000020:00000080:0.0:1788797032.588957:0:6713:0:(genops.c:885:class_export_put()) final put ffff8cb0779d7800/e6d050bb-169e-4784-be5b-7071799bf3b0 00000020:00000080:3.0:1788797032.589082:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8cb0779d7800/e6d050bb-169e-4784-be5b-7071799bf3b0 for lustre-OST0000 00000020:00000080:3.0:1788797032.589168:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8cb0779d6800 for lustre-OST0000 00000100:00100000:0.0:1788797033.010447:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788797033.010476:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb049408a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875689374542848:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788797033.010554:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788797033.015240:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374542848 00000100:00100000:1.0:1788797033.015258:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374542848 00000100:00100000:1.0:1788797033.015345:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788797033.015358:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb077f09880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875689374542848:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788797033.015400:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788797033.015482:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb077f09880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875689374542848:12345-0@lo:13:osp-pre-1-0.0 Request processed in 129us (4927us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797033.015488:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788797033.015819:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb077978700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3303:1875689374543360:0@lo:400:kworker.0 00000100:00100000:3.0:1788797033.015860:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788797033.015917:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788797033.015925:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb0796c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875689374543232:0@lo:400:kworker.0 00000100:00100000:3.0:1788797033.015949:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788797033.015982:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374543360 00000100:00100000:3.0:1788797033.015986:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374543360 00000100:00100000:3.0:1788797033.016020:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1788797033.016047:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb07797b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875689374543360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788797033.016083:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb07797b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875689374543360:12345-0@lo:400:kworker.0 Request processed in 58us (223us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797033.016089:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1788797033.016109:0:10829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374543232 00000100:00100000:3.0:1788797033.016112:0:10829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374543232 00000100:00100000:3.0:1788797033.016134:0:10829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788797033.016140:0:10829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb077978e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3303:x1875689374543232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788797033.016166:0:10829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb077978e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3303:x1875689374543232:12345-0@lo:400:kworker.0 Request processed in 26us (216us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797033.016183:0:10829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788797033.016226:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb0796c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875689374543232:0@lo:400:kworker.0 00000100:00100000:3.0:1788797033.016266:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb077978700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3303:1875689374543360:0@lo:400:kworker.0 00000100:00100000:2.0:1788797033.016506:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb049408000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3301:1875689374543104:0@lo:400:kworker.0 00000100:00100000:2.0:1788797033.016539:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788797033.016570:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1788797033.016575:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb049409180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:3301:1875689374542976:0@lo:400:kworker.0 00000100:00100000:2.0:1788797033.016602:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788797033.016627:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb07797a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3301:1875689374543488:0@lo:400:kworker.0 00000100:00100000:2.0:1788797033.016647:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788797033.016672:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374543104 00000100:00100000:2.0:1788797033.016676:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374543104 00000100:00100000:2.0:1788797033.016699:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374543488 00000100:00100000:2.0:1788797033.016702:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374543488 00000100:00100000:2.0:1788797033.016722:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1788797033.016728:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb080662a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1875689374543104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788797033.016766:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb080662a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1875689374543104:12345-0@lo:400:kworker.0 Request processed in 38us (226us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797033.016782:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1788797033.016796:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1788797033.016802:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb080660e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1875689374543488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788797033.016831:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb080660e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1875689374543488:12345-0@lo:400:kworker.0 Request processed in 30us (183us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797033.016837:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1788797033.016861:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb07797a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3301:1875689374543488:0@lo:400:kworker.0 00000100:00100000:2.0:1788797033.016870:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb049408000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3301:1875689374543104:0@lo:400:kworker.0 00000100:00080000:0.0:1788797033.016953:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788797033.016958:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788797033.016969:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374542976 00000100:00100000:0.0:1788797033.016973:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374542976 00000100:00100000:0.0:1788797033.017011:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287 00000100:00100000:0.0:1788797033.017019:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb04886a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+19:3301:x1875689374542976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788797033.017083:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb04886a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+19:3301:x1875689374542976:12345-0@lo:400:kworker.0 Request processed in 66us (480us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797033.017089:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287 00010000:00080000:0.0:1788797033.017138:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cb049408a80 x1875689374542848/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788797049 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788797033.017155:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb049408a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875689374542848:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788797033.017192:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb049409180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:3301:1875689374542976:0@lo:400:kworker.0 00010000:00010000:0.0:1788797033.266316:0:5815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788797034.293599:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788797035.319792:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788797035.448383:0:11679:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788797036.341887:0:5815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788797036.443294:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1788797036.443350:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1788797036.443383:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1788797036.443527:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351439744 00000100:00100000:1.0:1788797036.443539:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351439744 00000100:00100000:1.0:1788797036.443602:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 288 00000100:00100000:3.0:1788797036.443603:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351439872 00000100:00100000:3.0:1788797036.443607:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351439872 00000100:00100000:1.0:1788797036.443612:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb060707850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4d9d1a9-601d-459e-8721-8bfc2fdde84f+13:2354:x1875689351439744:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:3.0:1788797036.443645:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351440000 00000100:00100000:3.0:1788797036.443647:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351440000 00000100:00100000:3.0:1788797036.443669:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 133 00000100:00100000:3.0:1788797036.443675:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb080662680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6d050bb-169e-4784-be5b-7071799bf3b0+5:2355:x1875689351439872:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:1.0:1788797036.443685:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb060707850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4d9d1a9-601d-459e-8721-8bfc2fdde84f+13:2354:x1875689351439744:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 76us (335us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797036.443692:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 288 00000100:00100000:3.0:1788797036.443708:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb080662680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6d050bb-169e-4784-be5b-7071799bf3b0+5:2355:x1875689351439872:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 33us (428us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797036.443713:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 133 00000100:00100000:3.0:1788797036.443724:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 134 00000100:00100000:3.0:1788797036.443730:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb080663b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed124ec0-b908-4000-b768-8e53d5def0fc+5:2354:x1875689351440000:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:3.0:1788797036.443750:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb080663b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed124ec0-b908-4000-b768-8e53d5def0fc+5:2354:x1875689351440000:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 21us (368us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797036.443755:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 134 00000100:00080000:3.0:1788797036.443773:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788797037.364454:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788797037.618233:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788797037.618260:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb077f09c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875689374543616:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788797037.618357:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788797037.618443:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374543616 00000100:00100000:0.0:1788797037.618452:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374543616 00000100:00100000:0.0:1788797037.618528:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788797037.618537:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb077f0a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1875689374543616:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788797037.618578:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:1.0:1788797037.618776:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788797037.619092:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb077f0a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1875689374543616:12345-0@lo:13:osp-pre-0-0.0 Request processed in 546us (726us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797037.619101:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788797037.619151:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb077f09c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875689374543616:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788797038.132049:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788797038.132095:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb077f09f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3301:1875689374544128:0@lo:400:kworker.0 00000100:00100000:0.0:1788797038.132112:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb077f09c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:3302:1875689374543744:0@lo:400:kworker.0 00000100:00100000:2.0:1788797038.138716:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788797038.138816:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb077f08e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875689374544000:0@lo:400:kworker.0 00000100:00100000:2.0:1788797038.138863:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788797038.138899:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788797038.138906:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb077f09500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875689374544512:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788797038.138933:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788797038.138990:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374544512 00000100:00100000:2.0:1788797038.138997:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374544512 00000100:00100000:2.0:1788797038.139071:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788797038.139096:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb049408000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1875689374544512:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788797038.139141:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788797038.139210:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb049408000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1875689374544512:12345-0@lo:13:osp-pre-1-0.0 Request processed in 114us (274us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797038.139217:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00080000:2.0:1788797038.139256:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1788797038.139289:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cb077f09500 x1875689374544512/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788797054 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788797038.139312:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb077f09500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875689374544512:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788797038.142931:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb077f0bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875689374543872:0@lo:400:kworker.0 00000100:00100000:2.0:1788797038.143057:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788797038.143129:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb077f0b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875689374544384:0@lo:400:kworker.0 00000100:00100000:2.0:1788797038.143164:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788797038.143240:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374544000 00000100:00100000:2.0:1788797038.143249:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374544000 00000100:00100000:0.0:1788797038.143392:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788797038.146090:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374544384 00000100:00100000:2.0:1788797038.146109:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374544384 00000100:00100000:2.0:1788797038.146151:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788797038.146164:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb049408a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3301:x1875689374544000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788797038.146309:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb049408a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3301:x1875689374544000:12345-0@lo:400:kworker.0 Request processed in 148us (7445us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797038.146317:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788797038.146337:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788797038.146344:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0498ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1875689374544384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788797038.146383:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0498ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1875689374544384:12345-0@lo:400:kworker.0 Request processed in 39us (3217us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797038.146389:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00080000:2.0:1788797038.146458:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cb077f0b800 x1875689374544384/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788797054 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788797038.146489:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb077f0b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875689374544384:0@lo:400:kworker.0 00000100:00100000:2.0:1788797038.146530:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb077f08e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875689374544000:0@lo:400:kworker.0 00000100:00100000:0.0:1788797038.147431:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb077f0b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3302:1875689374544256:0@lo:400:kworker.0 00000100:00100000:0.0:1788797038.147487:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788797038.148715:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374543744 00000100:00100000:2.0:1788797038.148729:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374543744 00000100:00100000:3.0:1788797038.148763:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374544128 00000100:00100000:3.0:1788797038.148768:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374544128 00000100:00100000:3.0:1788797038.148807:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374543872 00000100:00100000:3.0:1788797038.148811:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374543872 00000100:00100000:3.0:1788797038.148823:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374544256 00000100:00100000:3.0:1788797038.148825:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374544256 00000100:00100000:3.0:1788797038.148844:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1788797038.148852:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb049409180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1875689374544128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788797038.148938:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb049409180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1875689374544128:12345-0@lo:400:kworker.0 Request processed in 86us (10233us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797038.148954:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1788797038.148974:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1788797038.148980:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0498ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875689374543872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788797038.149018:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0498ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875689374543872:12345-0@lo:400:kworker.0 Request processed in 39us (5961us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797038.149024:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1788797038.149055:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1788797038.149062:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb077f0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1875689374544256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788797038.149111:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb077f0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1875689374544256:12345-0@lo:400:kworker.0 Request processed in 50us (1624us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797038.149117:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00080000:3.0:1788797038.149155:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788797038.149190:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb077f09f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3301:1875689374544128:0@lo:400:kworker.0 00000100:00100000:3.0:1788797038.149220:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb077f0b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3302:1875689374544256:0@lo:400:kworker.0 00000100:00100000:3.0:1788797038.149255:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb077f0bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875689374543872:0@lo:400:kworker.0 00000100:00100000:2.0:1788797038.149388:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 289 00000100:00100000:2.0:1788797038.149397:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb060705c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+19:3302:x1875689374543744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788797038.149689:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb060705c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+19:3302:x1875689374543744:12345-0@lo:400:kworker.0 Request processed in 293us (6297us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797038.149696:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 289 00000100:00100000:3.0:1788797038.149746:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb077f09c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:3302:1875689374543744:0@lo:400:kworker.0 00010000:00010000:1.0:1788797038.387666:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788797038.644489:0:11845:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 12:03:57 (1788797037) 00010000:00010000:0.0:1788797039.413240:0:5815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788797040.434553:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788797040.664983:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1788797040.666642:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351440128 00000100:00100000:3.0:1788797040.666655:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351440128 00000100:00100000:3.0:1788797040.666803:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 32 00000100:00100000:3.0:1788797040.666816:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb080477100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6d050bb-169e-4784-be5b-7071799bf3b0+5:10256:x1875689351440128:12345-192.168.204.38@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788797040.666838:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788797040.666865:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080437a00/0xca7fc0c411f9379b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c99e04559ee0ffd expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797040.666957:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080437c00/0xca7fc0c411f937a2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797040.666971:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080437c00/0xca7fc0c411f937a2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797040.666985:0:5827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080437c00/0xca7fc0c411f937a2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788797040.667055:0:5827:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788797040.667059:0:5827:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788797040.667101:0:5827:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080437c00/0xca7fc0c411f937a2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797040.667127:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080437a00/0xca7fc0c411f9379b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee0ffd expref: 7 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797040.667147:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080437c00/0xca7fc0c411f937a2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee0ffd expref: 6 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797040.667156:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cb065cc2500) 00010000:00010000:3.0:1788797040.667159:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788797040.667163:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb080437c00, rc 0) 00000100:00100000:3.0:1788797040.667249:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb080477100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6d050bb-169e-4784-be5b-7071799bf3b0+6:10256:x1875689351440128:12345-192.168.204.38@tcp:101:lhsmtool_posix.0 Request processed in 436us (2279us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797040.667257:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 32 00000100:00080000:2.0:1788797040.674565:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788797040.685343:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1788797040.685599:0:7636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351440256 00000100:00100000:3.0:1788797040.685611:0:7636:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351440256 00000100:00100000:3.0:1788797040.685698:0:7636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 33 00000100:00100000:3.0:1788797040.685710:0:7636:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb077f0aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6d050bb-169e-4784-be5b-7071799bf3b0+6:10257:x1875689351440256:12345-192.168.204.38@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788797040.685733:0:7636:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788797040.685767:0:7636:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080437a00/0xca7fc0c411f937a9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c99e04559ee1004 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797040.685839:0:7636:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080436600/0xca7fc0c411f937b0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797040.685856:0:7636:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080436600/0xca7fc0c411f937b0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797040.685869:0:7636:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080436600/0xca7fc0c411f937b0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797040.685884:0:7636:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080436a00/0xca7fc0c411f937b7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797040.685890:0:7636:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080436a00/0xca7fc0c411f937b7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797040.685897:0:7636:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080436a00/0xca7fc0c411f937b7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797040.686195:0:7636:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080436200/0xca7fc0c411f937be lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797040.686205:0:7636:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080436200/0xca7fc0c411f937be lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797040.686212:0:7636:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080436200/0xca7fc0c411f937be lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788797040.686259:0:7636:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788797040.686262:0:7636:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788797040.686281:0:7636:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080436200/0xca7fc0c411f937be lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797040.686303:0:7636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080436600/0xca7fc0c411f937b0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797040.686310:0:7636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080436600/0xca7fc0c411f937b0 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797040.686316:0:7636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080436600/0xca7fc0c411f937b0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797040.686321:0:7636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb080436600 already unused, calling callback (ffffffffc1f014f0) 00010000:00010000:3.0:1788797040.686325:0:7636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080436600/0xca7fc0c411f937b0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797040.686332:0:7636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080436600/0xca7fc0c411f937b0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797040.686550:0:7636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cb065cc2500) 00010000:00010000:3.0:1788797040.686553:0:7636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788797040.686559:0:7636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080436600/0xca7fc0c411f937b0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797040.686565:0:7636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080436600/0xca7fc0c411f937b0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797040.686578:0:7636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080436a00/0xca7fc0c411f937b7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797040.686594:0:7636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080436a00/0xca7fc0c411f937b7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797040.686601:0:7636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080436a00/0xca7fc0c411f937b7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797040.686606:0:7636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb080436a00 already unused, calling callback (ffffffffc1f014f0) 00010000:00010000:3.0:1788797040.686609:0:7636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080436a00/0xca7fc0c411f937b7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797040.686615:0:7636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080436a00/0xca7fc0c411f937b7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797040.686623:0:7636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff8cb065cc2d00) 00010000:00010000:3.0:1788797040.686626:0:7636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788797040.686628:0:7636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080436a00/0xca7fc0c411f937b7 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797040.686634:0:7636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080436a00/0xca7fc0c411f937b7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797040.686672:0:7636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080437a00/0xca7fc0c411f937a9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1004 expref: 8 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797040.686687:0:7636:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080436200/0xca7fc0c411f937be lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1004 expref: 7 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797040.686694:0:7636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8cb065cc2f00) 00010000:00010000:3.0:1788797040.686697:0:7636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788797040.686705:0:7636:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb080436200, rc 0) 00000100:00100000:3.0:1788797040.686781:0:7636:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb077f0aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6d050bb-169e-4784-be5b-7071799bf3b0+7:10257:x1875689351440256:12345-192.168.204.38@tcp:101:lhsmtool_posix.0 Request processed in 1072us (1459us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797040.686790:0:7636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 33 00000100:00100000:1.0:1788797040.694069:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1788797040.696971:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351440512 00000100:00100000:3.0:1788797040.697084:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351440512 00000100:00100000:2.0:1788797040.697878:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 34 00000100:00100000:2.0:1788797040.697891:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb080476680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6d050bb-169e-4784-be5b-7071799bf3b0+7:10257:x1875689351440512:12345-192.168.204.38@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788797040.697916:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788797040.697942:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484c00/0xca7fc0c411f937c5 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c99e04559ee100b expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797040.698065:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484400/0xca7fc0c411f937cc lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797040.698081:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484400/0xca7fc0c411f937cc lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797040.698094:0:5827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484400/0xca7fc0c411f937cc lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797040.698112:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484000/0xca7fc0c411f937d3 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797040.698140:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484000/0xca7fc0c411f937d3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797040.698149:0:5827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484000/0xca7fc0c411f937d3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797040.699620:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041485600/0xca7fc0c411f937da lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797040.699642:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041485600/0xca7fc0c411f937da lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797040.699653:0:5827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041485600/0xca7fc0c411f937da lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788797040.699666:0:5827:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:2.0:1788797040.703429:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484400/0xca7fc0c411f937cc lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797040.703453:0:5827:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484400/0xca7fc0c411f937cc lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797040.703462:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484400/0xca7fc0c411f937cc lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797040.704002:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb041484400 already unused, calling callback (ffffffffc1f014f0) 00010000:00010000:2.0:1788797040.704009:0:5827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484400/0xca7fc0c411f937cc lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797040.704021:0:5827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484400/0xca7fc0c411f937cc lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797040.704116:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8cb065cc2f00) 00010000:00010000:2.0:1788797040.704118:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788797040.704124:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484400/0xca7fc0c411f937cc lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797040.704130:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484400/0xca7fc0c411f937cc lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797040.704154:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484000/0xca7fc0c411f937d3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797040.704160:0:5827:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484000/0xca7fc0c411f937d3 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797040.704166:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484000/0xca7fc0c411f937d3 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797040.704171:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb041484000 already unused, calling callback (ffffffffc1f014f0) 00010000:00010000:2.0:1788797040.704173:0:5827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484000/0xca7fc0c411f937d3 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797040.704179:0:5827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484000/0xca7fc0c411f937d3 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797040.704186:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8cb05088a900) 00010000:00010000:2.0:1788797040.704188:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788797040.704190:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484000/0xca7fc0c411f937d3 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797040.704195:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484000/0xca7fc0c411f937d3 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797040.708170:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484c00/0xca7fc0c411f937c5 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee100b expref: 10 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797040.708207:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041485600/0xca7fc0c411f937da lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee100b expref: 9 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797040.708217:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8cb05088a400) 00010000:00010000:2.0:1788797040.708220:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788797040.708223:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb041485600, rc 0) 00000100:00100000:2.0:1788797040.708327:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb080476680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6d050bb-169e-4784-be5b-7071799bf3b0+9:10257:x1875689351440512:12345-192.168.204.38@tcp:101:lhsmtool_posix.0 Request processed in 10438us (14316us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1788797040.711308:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 34 00000100:00100000:1.0:1788797040.721923:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1788797040.722130:0:7636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351440640 00000100:00100000:3.0:1788797040.722148:0:7636:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351440640 00000100:00100000:3.0:1788797040.722241:0:7636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 35 00000100:00100000:3.0:1788797040.722253:0:7636:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb04945ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6d050bb-169e-4784-be5b-7071799bf3b0+9:10257:x1875689351440640:12345-192.168.204.38@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1788797040.722412:0:7636:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb04945ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6d050bb-169e-4784-be5b-7071799bf3b0+9:10257:x1875689351440640:12345-192.168.204.38@tcp:59:lhsmtool_posix.0 Request processed in 160us (505us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797040.722421:0:7636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 35 00010000:00010000:1.0:1788797041.458228:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788797041.562080:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1788797041.562128:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1788797041.562150:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1788797041.562216:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351440768 00000100:00100000:2.0:1788797041.562229:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351440768 00000100:00100000:2.0:1788797041.562314:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 290 00000100:00100000:2.0:1788797041.562345:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb060707050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4d9d1a9-601d-459e-8721-8bfc2fdde84f+13:2354:x1875689351440768:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:2.0:1788797041.562439:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb060707050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4d9d1a9-601d-459e-8721-8bfc2fdde84f+13:2354:x1875689351440768:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 107us (309us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797041.562447:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 290 00000100:00100000:2.0:1788797041.562488:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351440896 00000100:00100000:2.0:1788797041.562501:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351440896 00000100:00100000:2.0:1788797041.562527:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351441024 00000100:00100000:2.0:1788797041.562530:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351441024 00000100:00100000:2.0:1788797041.562565:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 138 00000100:00100000:2.0:1788797041.562573:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb04945f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6d050bb-169e-4784-be5b-7071799bf3b0+9:2354:x1875689351440896:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:2.0:1788797041.562626:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb04945f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6d050bb-169e-4784-be5b-7071799bf3b0+9:2354:x1875689351440896:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 54us (558us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797041.562633:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 138 00000100:00100000:2.0:1788797041.562646:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 139 00000100:00100000:2.0:1788797041.562652:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb04945dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed124ec0-b908-4000-b768-8e53d5def0fc+5:2354:x1875689351441024:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:2.0:1788797041.562674:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb04945dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed124ec0-b908-4000-b768-8e53d5def0fc+5:2354:x1875689351441024:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 22us (523us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797041.562680:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 139 00000100:00080000:2.0:1788797041.562696:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:1.0:1788797041.589180:0:11679:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000001:00080000:1.0:1788797042.298535:0:5848:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967309 is committed 00010000:00010000:0.0:1788797042.486312:0:5815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788797042.739392:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788797042.739420:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb04945e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875689374544640:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788797042.739519:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788797042.739594:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374544640 00000100:00100000:1.0:1788797042.739603:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374544640 00000100:00100000:1.0:1788797042.739663:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788797042.739673:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb06ef1ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1875689374544640:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788797042.739713:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788797042.739759:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb06ef1ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1875689374544640:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (239us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797042.739766:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00080000:1.0:1788797042.739789:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788797042.739856:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb04945e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875689374544640:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788797043.135903:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1788797043.135987:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351441152 00000100:00100000:3.0:1788797043.135998:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351441152 00000100:00100000:3.0:1788797043.136092:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 36 00000100:00100000:3.0:1788797043.136115:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb080686a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6d050bb-169e-4784-be5b-7071799bf3b0+8:10300:x1875689351441152:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1788797043.136134:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788797043.136153:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080436600/0xca7fc0c411f937e8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c99e04559ee1012 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797043.136216:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080436a00/0xca7fc0c411f937ef lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797043.136235:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080436a00/0xca7fc0c411f937ef lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797043.136249:0:5827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080436a00/0xca7fc0c411f937ef lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797043.136275:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080437a00/0xca7fc0c411f937f6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797043.136283:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080437a00/0xca7fc0c411f937f6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797043.136290:0:5827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080437a00/0xca7fc0c411f937f6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797043.136472:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080436a00/0xca7fc0c411f937ef lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797043.136479:0:5827:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080436a00/0xca7fc0c411f937ef lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797043.136485:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080436a00/0xca7fc0c411f937ef lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797043.136490:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb080436a00 already unused, calling callback (ffffffffc1f014f0) 00010000:00010000:3.0:1788797043.136494:0:5827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080436a00/0xca7fc0c411f937ef lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797043.136501:0:5827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080436a00/0xca7fc0c411f937ef lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797043.136512:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cb065cc2500) 00010000:00010000:3.0:1788797043.136515:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788797043.136519:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080436a00/0xca7fc0c411f937ef lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797043.136525:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080436a00/0xca7fc0c411f937ef lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797043.136540:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080437a00/0xca7fc0c411f937f6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797043.136546:0:5827:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080437a00/0xca7fc0c411f937f6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797043.136550:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080437a00/0xca7fc0c411f937f6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797043.136555:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb080437a00 already unused, calling callback (ffffffffc1f014f0) 00010000:00010000:3.0:1788797043.136557:0:5827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080437a00/0xca7fc0c411f937f6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797043.136562:0:5827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080437a00/0xca7fc0c411f937f6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797043.136569:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8cb065cc2000) 00010000:00010000:3.0:1788797043.136572:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788797043.136575:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080437a00/0xca7fc0c411f937f6 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797043.136580:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080437a00/0xca7fc0c411f937f6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797043.136611:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080436600/0xca7fc0c411f937e8 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1012 expref: 9 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797043.136621:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cb065cc2500) 00010000:00010000:3.0:1788797043.136624:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788797043.136634:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080436600/0xca7fc0c411f937e8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1012 expref: 9 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797043.136643:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb080436600, rc 0) 00000100:00100000:3.0:1788797043.136701:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb080686a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6d050bb-169e-4784-be5b-7071799bf3b0+8:10300:x1875689351441152:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 589us (812us total) trans 0 rc 301/301 00000100:00100000:3.0:1788797043.136708:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 36 00000100:00080000:1.0:1788797043.136951:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788797043.144682:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1788797043.144778:0:7636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351441408 00000100:00100000:3.0:1788797043.144792:0:7636:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351441408 00000100:00100000:3.0:1788797043.144865:0:7636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 37 00000100:00100000:3.0:1788797043.144876:0:7636:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb080684000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6d050bb-169e-4784-be5b-7071799bf3b0+8:10300:x1875689351441408:12345-192.168.204.38@tcp:36:lfs.0 00010000:00010000:3.0:1788797043.144934:0:7636:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788797043.144964:0:7636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080437c00/0xca7fc0c411f937a2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee0ffd expref: 8 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797043.144993:0:7636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cb065cc2500) 00010000:00010000:3.0:1788797043.145005:0:7636:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788797043.145267:0:7636:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080436600/0xca7fc0c411f937fd lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797043.145281:0:7636:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080436600/0xca7fc0c411f937fd lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797043.145291:0:7636:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080436600/0xca7fc0c411f937fd lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797043.145302:0:7636:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080437a00/0xca7fc0c411f93804 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797043.145308:0:7636:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080437a00/0xca7fc0c411f93804 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797043.145320:0:7636:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080437a00/0xca7fc0c411f93804 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788797043.147490:0:7636:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:2.0:1788797043.147511:0:7636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080436600/0xca7fc0c411f937fd lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797043.147530:0:7636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080436600/0xca7fc0c411f937fd lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797043.147538:0:7636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080436600/0xca7fc0c411f937fd lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797043.147544:0:7636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb080436600 already unused, calling callback (ffffffffc1f014f0) 00010000:00010000:2.0:1788797043.147549:0:7636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080436600/0xca7fc0c411f937fd lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797043.147556:0:7636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080436600/0xca7fc0c411f937fd lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797043.147572:0:7636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cb065cc2000) 00010000:00010000:2.0:1788797043.147580:0:7636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788797043.147586:0:7636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080436600/0xca7fc0c411f937fd lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797043.147593:0:7636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080436600/0xca7fc0c411f937fd lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788797043.147617:0:7636:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000519c8d22 reply state 00000000b4e09f85 transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080437a00/0xca7fc0c411f93804 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788797043.147627:0:7636:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788797043.147913:0:7636:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb080684000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6d050bb-169e-4784-be5b-7071799bf3b0+9:10300:x1875689351441408:12345-192.168.204.38@tcp:36:lfs.0 Request processed in 3032us (3234us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1788797043.147923:0:7636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 37 00010000:00010000:0.0:1788797043.150275:0:3286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080437a00/0xca7fc0c411f93804 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797043.150292:0:3286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080437a00/0xca7fc0c411f93804 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797043.150301:0:3286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080437a00/0xca7fc0c411f93804 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797043.150307:0:3286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb080437a00 already unused, calling callback (ffffffffc1f014f0) 00010000:00010000:0.0:1788797043.150313:0:3286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080437a00/0xca7fc0c411f93804 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797043.150321:0:3286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080437a00/0xca7fc0c411f93804 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797043.150339:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8cb065cc2d00) 00010000:00010000:0.0:1788797043.150342:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788797043.150347:0:3286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080437a00/0xca7fc0c411f93804 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797043.150355:0:3286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080437a00/0xca7fc0c411f93804 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788797043.251260:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb04945e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875689374545152:0@lo:400:kworker.0 00000100:00100000:1.0:1788797043.251441:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788797043.251508:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1788797043.251514:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb06ef1d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3301:1875689374545024:0@lo:400:kworker.0 00000100:00100000:1.0:1788797043.251540:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788797043.251557:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb07902a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875689374545536:0@lo:400:kworker.0 00000100:00100000:1.0:1788797043.251577:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788797043.251613:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374545152 00000100:00100000:1.0:1788797043.251620:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374545152 00000100:00100000:1.0:1788797043.251663:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374545536 00000100:00100000:1.0:1788797043.251666:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374545536 00000100:00100000:1.0:1788797043.251695:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788797043.251703:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb07902bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3301:x1875689374545152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788797043.251754:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb07902bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3301:x1875689374545152:12345-0@lo:400:kworker.0 Request processed in 51us (313us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797043.251761:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788797043.251776:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788797043.251782:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb079029f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3301:x1875689374545536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788797043.251806:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb079029f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3301:x1875689374545536:12345-0@lo:400:kworker.0 Request processed in 25us (228us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797043.251812:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788797043.251841:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374545024 00000100:00100000:1.0:1788797043.251845:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374545024 00000100:00100000:1.0:1788797043.251871:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1788797043.251878:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb079028e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1875689374545024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788797043.251908:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb079028e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1875689374545024:12345-0@lo:400:kworker.0 Request processed in 31us (367us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797043.251913:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00080000:1.0:1788797043.251934:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788797043.251984:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb06ef1d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3301:1875689374545024:0@lo:400:kworker.0 00010000:00080000:1.0:1788797043.251997:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cb07902a680 x1875689374545536/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788797059 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788797043.252006:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb07902a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875689374545536:0@lo:400:kworker.0 00000100:00100000:1.0:1788797043.252014:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb04945e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875689374545152:0@lo:400:kworker.0 00000100:00100000:0.0:1788797043.253134:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb06ef1df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:3303:1875689374544896:0@lo:400:kworker.0 00000100:00100000:0.0:1788797043.253200:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788797043.253249:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb079029c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3303:1875689374545408:0@lo:400:kworker.0 00000100:00100000:0.0:1788797043.253274:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788797043.253302:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1788797043.253317:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb077f08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875689374544768:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788797043.253343:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788797043.253359:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb079029880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3303:1875689374545280:0@lo:400:kworker.0 00000100:00100000:0.0:1788797043.253380:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788797043.253422:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374545408 00000100:00100000:0.0:1788797043.253430:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374545408 00000100:00100000:0.0:1788797043.253479:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374545280 00000100:00100000:0.0:1788797043.253482:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374545280 00000100:00100000:0.0:1788797043.253504:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1788797043.253512:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb077f09180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1875689374545408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788797043.253564:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb077f09180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1875689374545408:12345-0@lo:400:kworker.0 Request processed in 52us (288us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797043.253570:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1788797043.253588:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1788797043.253594:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb077f08700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875689374545280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788797043.253620:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb077f08700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875689374545280:12345-0@lo:400:kworker.0 Request processed in 26us (238us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797043.253626:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1788797043.253661:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb079029880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3303:1875689374545280:0@lo:400:kworker.0 00000100:00100000:0.0:1788797043.253671:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb079029c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3303:1875689374545408:0@lo:400:kworker.0 00000100:00100000:1.0:1788797043.253815:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374544896 00000100:00100000:1.0:1788797043.253820:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374544896 00000100:00100000:1.0:1788797043.253872:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 291 00000100:00100000:1.0:1788797043.253880:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb060704050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+19:3303:x1875689374544896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788797043.253922:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb060704050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+19:3303:x1875689374544896:12345-0@lo:400:kworker.0 Request processed in 43us (723us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797043.253927:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 291 00000100:00100000:1.0:1788797043.253957:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374544768 00000100:00100000:1.0:1788797043.253960:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374544768 00000100:00100000:1.0:1788797043.253996:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788797043.254004:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb077f08a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875689374544768:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788797043.254052:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788797043.254083:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb077f08a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875689374544768:12345-0@lo:13:osp-pre-1-0.0 Request processed in 80us (738us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797043.254090:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00080000:1.0:1788797043.254111:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1788797043.254134:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cb077f08000 x1875689374544768/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788797059 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788797043.254151:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb077f08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875689374544768:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788797043.254159:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb06ef1df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:3303:1875689374544896:0@lo:400:kworker.0 00000100:00100000:1.0:1788797043.258224:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1788797043.258331:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351441536 00000100:00100000:3.0:1788797043.258343:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351441536 00000100:00100000:3.0:1788797043.258412:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 38 00000100:00100000:3.0:1788797043.258424:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb07902a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6d050bb-169e-4784-be5b-7071799bf3b0+8:10308:x1875689351441536:12345-192.168.204.38@tcp:101:lctl.0 00010000:00010000:3.0:1788797043.258451:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788797043.258477:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080437c00/0xca7fc0c411f9380b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c99e04559ee1019 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797043.258554:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080437a00/0xca7fc0c411f93812 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797043.258571:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080437a00/0xca7fc0c411f93812 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797043.258584:0:5826:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080437a00/0xca7fc0c411f93812 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788797043.258632:0:5826:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788797043.258636:0:5826:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788797043.258675:0:5826:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080437a00/0xca7fc0c411f93812 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797043.258706:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080437c00/0xca7fc0c411f9380b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1019 expref: 10 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797043.258735:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080437a00/0xca7fc0c411f93812 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1019 expref: 9 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797043.258755:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cb065cc2500) 00010000:00010000:3.0:1788797043.258758:0:5826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788797043.258762:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb080437a00, rc 0) 00000100:00100000:3.0:1788797043.258823:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb07902a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6d050bb-169e-4784-be5b-7071799bf3b0+9:10308:x1875689351441536:12345-192.168.204.38@tcp:101:lctl.0 Request processed in 401us (612us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797043.258840:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 38 00000100:00100000:3.0:1788797043.329809:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1788797043.329916:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351441664 00000100:00100000:1.0:1788797043.329927:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351441664 00000100:00100000:1.0:1788797043.330004:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 39 00000100:00100000:1.0:1788797043.330016:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb077978700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6d050bb-169e-4784-be5b-7071799bf3b0+9:10314:x1875689351441664:12345-192.168.204.38@tcp:101:bash.0 00010000:00010000:1.0:1788797043.330085:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788797043.330109:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb0821f1000/0xca7fc0c411f93819 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c99e04559ee1020 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797043.330182:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb0821f0400/0xca7fc0c411f93820 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797043.330196:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb0821f0400/0xca7fc0c411f93820 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797043.330209:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb0821f0400/0xca7fc0c411f93820 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797043.330228:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb0821f1200/0xca7fc0c411f93827 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797043.330235:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb0821f1200/0xca7fc0c411f93827 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797043.330241:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb0821f1200/0xca7fc0c411f93827 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797043.330415:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb0821f0e00/0xca7fc0c411f9382e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797043.330423:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb0821f0e00/0xca7fc0c411f9382e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797043.330444:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb0821f0e00/0xca7fc0c411f9382e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788797043.330475:0:5825:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:1.0:1788797043.330479:0:5825:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788797043.330520:0:5825:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cb0821f0e00/0xca7fc0c411f9382e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797043.330534:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb0821f0400/0xca7fc0c411f93820 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797043.330540:0:5825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb0821f0400/0xca7fc0c411f93820 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797043.330546:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb0821f0400/0xca7fc0c411f93820 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797043.330552:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb0821f0400 already unused, calling callback (ffffffffc1f014f0) 00010000:00010000:1.0:1788797043.330557:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb0821f0400/0xca7fc0c411f93820 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797043.330565:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb0821f0400/0xca7fc0c411f93820 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797043.330578:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cb065cc2500) 00010000:00010000:1.0:1788797043.330791:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788797043.330798:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb0821f0400/0xca7fc0c411f93820 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797043.330805:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb0821f0400/0xca7fc0c411f93820 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797043.330829:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb0821f1200/0xca7fc0c411f93827 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797043.330835:0:5825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb0821f1200/0xca7fc0c411f93827 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797043.330840:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb0821f1200/0xca7fc0c411f93827 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797043.330846:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb0821f1200 already unused, calling callback (ffffffffc1f014f0) 00010000:00010000:1.0:1788797043.330849:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb0821f1200/0xca7fc0c411f93827 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797043.330854:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb0821f1200/0xca7fc0c411f93827 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797043.330862:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8cb06ce84c00) 00010000:00010000:1.0:1788797043.330864:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788797043.330867:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb0821f1200/0xca7fc0c411f93827 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797043.330871:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb0821f1200/0xca7fc0c411f93827 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797043.330913:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb0821f1000/0xca7fc0c411f93819 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1020 expref: 11 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797043.330927:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb0821f0e00/0xca7fc0c411f9382e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1020 expref: 10 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797043.330946:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8cb06ce84d00) 00010000:00010000:1.0:1788797043.330949:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1788797043.330951:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb0821f0e00, rc 0) 00000100:00100000:3.0:1788797043.331659:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb077978700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6d050bb-169e-4784-be5b-7071799bf3b0+10:10314:x1875689351441664:12345-192.168.204.38@tcp:101:bash.0 Request processed in 1638us (1857us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797043.331669:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 39 00000100:00100000:3.0:1788797043.334737:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1788797043.334811:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351441920 00000100:00100000:0.0:1788797043.334823:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351441920 00000100:00100000:0.0:1788797043.334889:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 40 00000100:00100000:0.0:1788797043.334902:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb07797b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6d050bb-169e-4784-be5b-7071799bf3b0+10:10314:x1875689351441920:12345-192.168.204.38@tcp:101:bash.0 00010000:00010000:0.0:1788797043.334929:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788797043.334986:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3000/0xca7fc0c411f93835 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c99e04559ee1027 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797043.335165:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3200/0xca7fc0c411f9383c lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797043.335184:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3200/0xca7fc0c411f9383c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797043.335197:0:5826:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3200/0xca7fc0c411f9383c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797043.335260:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3c00/0xca7fc0c411f93843 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797043.335268:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3c00/0xca7fc0c411f93843 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797043.335275:0:5826:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3c00/0xca7fc0c411f93843 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788797043.335895:0:5826:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2:0x0], index 1: 0 00010000:00010000:0.0:1788797043.336150:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3600/0xca7fc0c411f9384a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797043.336162:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3600/0xca7fc0c411f9384a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797043.336173:0:5826:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3600/0xca7fc0c411f9384a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797043.336214:0:5826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3200/0xca7fc0c411f9383c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797043.336233:0:5826:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3200/0xca7fc0c411f9383c lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797043.336239:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3200/0xca7fc0c411f9383c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797043.336246:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb042ea3200 already unused, calling callback (ffffffffc1f014f0) 00010000:00010000:0.0:1788797043.336250:0:5826:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3200/0xca7fc0c411f9383c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797043.336258:0:5826:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3200/0xca7fc0c411f9383c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797043.336273:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8cb06ce84d00) 00010000:00010000:0.0:1788797043.336276:0:5826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788797043.336281:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3200/0xca7fc0c411f9383c lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797043.336288:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3200/0xca7fc0c411f9383c lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788797043.336302:0:5826:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003930ccca reply state 000000008eb81f3d transno 4294967311 ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3c00/0xca7fc0c411f93843 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788797043.336311:0:5826:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788797043.336347:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3000/0xca7fc0c411f93835 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1027 expref: 13 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797043.336363:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3600/0xca7fc0c411f9384a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1027 expref: 12 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797043.336382:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cb058766100) 00010000:00010000:0.0:1788797043.336385:0:5826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788797043.336388:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb042ea3600, rc 0) 00000100:00100000:0.0:1788797043.336468:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb07797b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6d050bb-169e-4784-be5b-7071799bf3b0+13:10314:x1875689351441920:12345-192.168.204.38@tcp:101:bash.0 Request processed in 1568us (1740us total) trans 4294967311 rc 0/0 00000100:00100000:0.0:1788797043.336476:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 40 00010000:00010000:2.0:1788797043.338426:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3c00/0xca7fc0c411f93843 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797043.338443:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3c00/0xca7fc0c411f93843 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797043.338450:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3c00/0xca7fc0c411f93843 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797043.338456:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb042ea3c00 already unused, calling callback (ffffffffc1f014f0) 00010000:00010000:2.0:1788797043.338460:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3c00/0xca7fc0c411f93843 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797043.338468:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3c00/0xca7fc0c411f93843 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797043.338486:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8cb058766500) 00010000:00010000:2.0:1788797043.338489:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788797043.338508:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3c00/0xca7fc0c411f93843 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797043.338514:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3c00/0xca7fc0c411f93843 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788797043.342822:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1788797043.343247:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351442048 00000100:00100000:1.0:1788797043.343259:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351442048 00000100:00100000:1.0:1788797043.343326:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 21 00000100:00100000:1.0:1788797043.343335:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb077978a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2351:x1875689351442048:12345-192.168.204.38@tcp:8:bash.0 00010000:00080000:1.0:1788797043.343372:0:6684:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from e6d050bb-169e-4784-be5b-7071799bf3b0@192.168.204.38@tcp t0 exp 0000000000000000 cur 332 last 0 00000020:00000080:1.0:1788797043.343407:0:6684:0:(genops.c:1384:class_connect()) connect: client e6d050bb-169e-4784-be5b-7071799bf3b0, cookie 0xca7fc0c411f93858 00002000:00100000:1.0:1788797043.343419:0:6684:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli e6d050bb-169e-4784-be5b-7071799bf3b0/ffff8cb04630c800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788797043.343430:0:6684:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788797043.343725:0:6684:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1788797043.343763:0:6684:0:(import.c:65:import_set_state_nolock()) ffff8cb046308000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788797043.343844:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb077978a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e6d050bb-169e-4784-be5b-7071799bf3b0+6:2351:x1875689351442048:12345-192.168.204.38@tcp:8:bash.0 Request processed in 507us (1033us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797043.343853:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 21 00000100:00100000:1.0:1788797043.346266:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1788797043.346469:0:10829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351442176 00000100:00100000:3.0:1788797043.346480:0:10829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351442176 00000100:00080000:1.0:1788797043.346614:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788797043.346658:0:10829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 22 00000100:00100000:3.0:1788797043.346670:0:10829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb07902b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e6d050bb-169e-4784-be5b-7071799bf3b0+6:0:x1875689351442176:12345-192.168.204.38@tcp:101:bash.0 00010000:00010000:3.0:1788797043.346691:0:10829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788797043.346718:0:10829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009198ce1b/0xca7fc0c411f9385f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7c99e04559ee102e expref: -99 pid: 10829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788797043.346749:0:10829:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788797043.346774:0:10829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=332s v=(0 0) 00010000:00010000:3.0:1788797043.346778:0:10829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788797043.346787:0:10829:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009198ce1b/0xca7fc0c411f9385f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee102e expref: 7 pid: 10829 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797043.346835:0:10829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000009198ce1b/0xca7fc0c411f9385f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee102e expref: 7 pid: 10829 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797043.346850:0:10829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb080436a00, rc 0) 00000100:00100000:3.0:1788797043.346918:0:10829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb07902b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e6d050bb-169e-4784-be5b-7071799bf3b0+7:0:x1875689351442176:12345-192.168.204.38@tcp:101:bash.0 Request processed in 250us (662us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797043.346925:0:10829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 22 00000100:00100000:0.0:1788797043.350002:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1788797043.350113:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351442304 00000100:00100000:1.0:1788797043.350125:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351442304 00000100:00100000:1.0:1788797043.350195:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 23 00000100:00100000:1.0:1788797043.350207:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb077f0a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e6d050bb-169e-4784-be5b-7071799bf3b0+7:10314:x1875689351442304:12345-192.168.204.38@tcp:101:bash.0 00010000:00010000:1.0:1788797043.350228:0:6684:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788797043.350252:0:6684:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004b1423c6/0xca7fc0c411f93866 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7c99e04559ee1035 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797043.350319:0:6684:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000009198ce1b/0xca7fc0c411f9385f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee102e expref: 8 pid: 10829 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797043.350329:0:6684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788797043.350333:0:6684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788797043.350339:0:6684:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004b1423c6/0xca7fc0c411f93866 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1035 expref: 8 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797043.350375:0:6684:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000009198ce1b/0xca7fc0c411f9385f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee102e expref: 8 pid: 10829 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797043.350393:0:6684:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000009198ce1b/0xca7fc0c411f9385f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee102e expref: 8 pid: 10829 timeout: 432 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788797043.350408:0:6684:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb07902b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6684:1875689374545664:192.168.204.38@tcp:104: 00000100:00100000:1.0:1788797043.350499:0:6684:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb0465d49c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788797043.352767:0:6684:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb07902b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6684:1875689374545664:192.168.204.38@tcp:104: 00010000:00010000:1.0:1788797043.352815:0:6684:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000004b1423c6/0xca7fc0c411f93866 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1035 expref: 8 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797043.352834:0:6684:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb0821f1000, rc 0) 00000100:00100000:1.0:1788797043.352888:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb077f0a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e6d050bb-169e-4784-be5b-7071799bf3b0+8:10314:x1875689351442304:12345-192.168.204.38@tcp:101:bash.0 Request processed in 2683us (2897us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797043.352897:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 23 00000100:00100000:1.0:1788797043.355368:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1788797043.355535:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351442432 00000100:00100000:3.0:1788797043.355546:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351442432 00010000:00010000:3.0:1788797043.355604:0:5811:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009198ce1b/0xca7fc0c411f9385f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee102e expref: 8 pid: 10829 timeout: 432 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788797043.355645:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 35 00000100:00100000:3.0:1788797043.355655:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb07902b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e6d050bb-169e-4784-be5b-7071799bf3b0+8:2355:x1875689351442432:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788797043.355672:0:5811:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788797043.355695:0:5811:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000009198ce1b/0xca7fc0c411f9385f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee102e expref: 8 pid: 10829 timeout: 432 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797043.355708:0:5811:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009198ce1b/0xca7fc0c411f9385f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee102e expref: 8 pid: 10829 timeout: 432 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797043.355736:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009198ce1b/0xca7fc0c411f9385f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee102e expref: 8 pid: 10829 timeout: 432 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797043.355771:0:5811:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788797043.355775:0:5811:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788797043.355785:0:5811:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000004b1423c6/0xca7fc0c411f93866 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1035 expref: 7 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797043.355796:0:5811:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004b1423c6/0xca7fc0c411f93866 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1035 expref: 7 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797043.355838:0:5811:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000004b1423c6/0xca7fc0c411f93866 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1035 expref: 7 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788797043.355853:0:5811:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb077979180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5811:1875689374545792:192.168.204.38@tcp:105: 00000100:00100000:3.0:1788797043.355939:0:5811:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb050ee0000 going to sleep for 11 seconds 00000100:00100000:3.0:1788797043.361386:0:5811:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb077979180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5811:1875689374545792:192.168.204.38@tcp:105: 00010000:00010000:3.0:1788797043.361415:0:5811:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788797043.361478:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb07902b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e6d050bb-169e-4784-be5b-7071799bf3b0+7:2355:x1875689351442432:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 5824us (6119us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797043.361489:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 35 00000100:00100000:1.0:1788797043.368329:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1788797043.368454:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351442688 00000100:00100000:0.0:1788797043.368465:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351442688 00000100:00100000:0.0:1788797043.368567:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 6 00000100:00100000:0.0:1788797043.368578:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb079029500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e6d050bb-169e-4784-be5b-7071799bf3b0+12:10314:x1875689351442688:12345-192.168.204.38@tcp:35:bash.0 00000100:00100000:0.0:1788797043.368947:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb079029500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e6d050bb-169e-4784-be5b-7071799bf3b0+13:10314:x1875689351442688:12345-192.168.204.38@tcp:35:bash.0 Request processed in 370us (627us total) trans 4294967312 rc 0/0 00000100:00100000:0.0:1788797043.368954:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 6 00000100:00100000:2.0:1788797043.459773:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1788797043.459876:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351442944 00000100:00100000:1.0:1788797043.459889:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351442944 00000100:00100000:1.0:1788797043.459965:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 41 00000100:00100000:1.0:1788797043.459987:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb080685180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6d050bb-169e-4784-be5b-7071799bf3b0+13:10324:x1875689351442944:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1788797043.460010:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788797043.460073:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb0821f1200/0xca7fc0c411f9386d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c99e04559ee103c expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788797043.460168:0:5827:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:1.0:1788797043.460289:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb0821f1200/0xca7fc0c411f9386d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee103c expref: 15 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797043.460304:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cb065cc2500) 00010000:00010000:1.0:1788797043.460414:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788797043.460421:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb0821f1200/0xca7fc0c411f9386d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee103c expref: 15 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797043.460438:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb0821f1200, rc 0) 00000100:00100000:1.0:1788797043.460639:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb080685180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6d050bb-169e-4784-be5b-7071799bf3b0+14:10324:x1875689351442944:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 653us (877us total) trans 4294967313 rc 301/301 00000100:00100000:1.0:1788797043.460647:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 41 00000100:00100000:1.0:1788797043.469539:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1788797043.469647:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351443200 00000100:00100000:2.0:1788797043.469660:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351443200 00000100:00100000:2.0:1788797043.469729:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 7 00000100:00100000:2.0:1788797043.469743:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb07902b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e6d050bb-169e-4784-be5b-7071799bf3b0+14:10324:x1875689351443200:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:2.0:1788797043.469998:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb07902b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e6d050bb-169e-4784-be5b-7071799bf3b0+15:10324:x1875689351443200:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 258us (471us total) trans 4294967314 rc 0/0 00000100:00100000:2.0:1788797043.470007:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 7 00010000:00010000:1.0:1788797043.507768:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788797043.544103:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1788797043.544187:0:7636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351443328 00000100:00100000:1.0:1788797043.544198:0:7636:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351443328 00000100:00100000:1.0:1788797043.544258:0:7636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 42 00000100:00100000:1.0:1788797043.544292:0:7636:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb077f08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6d050bb-169e-4784-be5b-7071799bf3b0+15:10330:x1875689351443328:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1788797043.544324:0:7636:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788797043.544345:0:7636:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb0821f1200/0xca7fc0c411f9387b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c99e04559ee1043 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797043.544414:0:7636:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb0821f0400/0xca7fc0c411f93882 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797043.544428:0:7636:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb0821f0400/0xca7fc0c411f93882 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797043.544440:0:7636:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb0821f0400/0xca7fc0c411f93882 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788797043.544474:0:7636:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:1.0:1788797043.544477:0:7636:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788797043.544493:0:7636:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cb0821f0400/0xca7fc0c411f93882 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797043.544515:0:7636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb0821f1200/0xca7fc0c411f9387b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1043 expref: 17 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797043.544532:0:7636:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb0821f0400/0xca7fc0c411f93882 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1043 expref: 16 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797043.544540:0:7636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8cb06ce84d00) 00010000:00010000:1.0:1788797043.544545:0:7636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788797043.544548:0:7636:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb0821f0400, rc 0) 00000100:00100000:1.0:1788797043.544613:0:7636:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb077f08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6d050bb-169e-4784-be5b-7071799bf3b0+16:10330:x1875689351443328:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 333us (520us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797043.544628:0:7636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 42 00000100:00100000:1.0:1788797043.549726:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1788797043.549815:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351443584 00000100:00100000:2.0:1788797043.549826:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351443584 00000100:00100000:2.0:1788797043.549890:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 43 00000100:00100000:2.0:1788797043.549900:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb07902aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6d050bb-169e-4784-be5b-7071799bf3b0+16:10330:x1875689351443584:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1788797043.549920:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788797043.549942:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041485200/0xca7fc0c411f93889 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c99e04559ee104a expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797043.550079:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484400/0xca7fc0c411f93890 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797043.550094:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484400/0xca7fc0c411f93890 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797043.550107:0:5827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484400/0xca7fc0c411f93890 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788797043.550132:0:5827:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1788797043.550267:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041485200/0xca7fc0c411f93889 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee104a expref: 19 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797043.550304:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484400/0xca7fc0c411f93890 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee104a expref: 18 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797043.550313:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cb058766100) 00010000:00010000:2.0:1788797043.550315:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788797043.550319:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb041484400, rc 0) 00000100:00100000:2.0:1788797043.550441:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb07902aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6d050bb-169e-4784-be5b-7071799bf3b0+18:10330:x1875689351443584:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 542us (724us total) trans 4294967315 rc 0/0 00000100:00100000:2.0:1788797043.550448:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 43 00000100:00100000:2.0:1788797043.554616:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1788797043.554669:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1788797043.554787:0:7636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351443840 00000100:00100000:1.0:1788797043.554798:0:7636:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351443840 00000100:00100000:1.0:1788797043.554855:0:7636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 44 00000100:00100000:1.0:1788797043.554866:0:7636:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb080684a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6d050bb-169e-4784-be5b-7071799bf3b0+18:10330:x1875689351443840:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1788797043.554891:0:7636:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788797043.554911:0:7636:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb0821f1200/0xca7fc0c411f9389e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c99e04559ee1051 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797043.555012:0:7636:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb0821f0a00/0xca7fc0c411f938a5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797043.555060:0:7636:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb0821f0a00/0xca7fc0c411f938a5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797043.555074:0:7636:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb0821f0a00/0xca7fc0c411f938a5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788797043.555087:0:7636:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:1.0:1788797043.555215:0:7636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb0821f1200/0xca7fc0c411f9389e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1051 expref: 21 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797043.555234:0:7636:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb0821f0a00/0xca7fc0c411f938a5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1051 expref: 20 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797043.555243:0:7636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cb058766100) 00010000:00010000:1.0:1788797043.555245:0:7636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1788797043.555262:0:7636:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb0821f0a00, rc 0) 00000100:00100000:1.0:1788797043.555332:0:7636:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb080684a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6d050bb-169e-4784-be5b-7071799bf3b0+20:10330:x1875689351443840:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 468us (727us total) trans 4294967316 rc 0/0 00000100:00100000:1.0:1788797043.555340:0:7636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 44 00000100:00100000:0.0:1788797043.555878:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351443968 00000100:00100000:0.0:1788797043.555885:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351443968 00000100:00100000:0.0:1788797043.555931:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2 00000100:00100000:0.0:1788797043.555942:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb080684700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e6d050bb-169e-4784-be5b-7071799bf3b0+20:2354:x1875689351443968:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788797043.555955:0:5812:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788797043.555983:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484400/0xca7fc0c411f93890 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee104a expref: 20 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797043.555996:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cb058766100) 00010000:00010000:0.0:1788797043.556006:0:5812:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788797043.556067:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb080684700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e6d050bb-169e-4784-be5b-7071799bf3b0+19:2354:x1875689351443968:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 127us (1396us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797043.556074:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2 00000100:00100000:2.0:1788797043.560556:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1788797043.560799:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351444096 00000100:00100000:1.0:1788797043.560811:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351444096 00000100:00100000:1.0:1788797043.560868:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 24 00000100:00100000:1.0:1788797043.560878:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb080686300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e6d050bb-169e-4784-be5b-7071799bf3b0+7:2352:x1875689351444096:12345-192.168.204.38@tcp:1:lfs.0 00010000:00010000:1.0:1788797043.560921:0:6681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000be7b1247/0xca7fc0c411f938b3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797043.560943:0:6681:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000004b1423c6/0xca7fc0c411f93866 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1035 expref: 7 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797043.560952:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788797043.560956:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788797043.560961:0:6681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000be7b1247/0xca7fc0c411f938b3 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797043.561007:0:6681:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000004b1423c6/0xca7fc0c411f93866 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1035 expref: 7 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797043.561021:0:6681:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000004b1423c6/0xca7fc0c411f93866 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1035 expref: 7 pid: 6684 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788797043.561068:0:6681:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb079028000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6681:1875689374545920:192.168.204.38@tcp:104: 00000100:00100000:1.0:1788797043.561152:0:6681:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb0465d4540 going to sleep for 11 seconds 00000100:00100000:1.0:1788797043.563918:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1788797043.564329:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351444224 00000100:00100000:3.0:1788797043.564339:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351444224 00002000:00100000:3.0:1788797043.564384:0:6687:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2:0x0] (0->12) req@ffff8cb079029180 x1875689351444224/t0(0) o4->e6d050bb-169e-4784-be5b-7071799bf3b0@192.168.204.38@tcp:469/0 lens 504/0 e 0 to 0 dl 1788797054 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788797043.564396:0:6687:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8cb079029180 with x1875689351444224 ext(0->12) 00010000:00010000:3.0:1788797043.564404:0:6687:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000004b1423c6/0xca7fc0c411f93866 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1035 expref: 8 pid: 6684 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797043.564434:0:6687:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000004b1423c6/0xca7fc0c411f93866 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1035 expref: 8 pid: 6684 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788797043.564442:0:6687:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8cb079029180 00000100:00100000:3.0:1788797043.564470:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 0 00000100:00100000:3.0:1788797043.564480:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb079029180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e6d050bb-169e-4784-be5b-7071799bf3b0+8:2355:x1875689351444224:12345-192.168.204.38@tcp:4:lfs.0 00000100:00100000:2.0:1788797043.565252:0:6681:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb079028000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6681:1875689374545920:192.168.204.38@tcp:104: 00010000:00010000:2.0:1788797043.565308:0:6681:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000be7b1247/0xca7fc0c411f938b3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00100000:1.0:1788797043.587576:0:7640:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of e6d050bb-169e-4784-be5b-7071799bf3b0 00000100:00100000:3.0:1788797043.588438:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb079029180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e6d050bb-169e-4784-be5b-7071799bf3b0+9:2355:x1875689351444224:12345-192.168.204.38@tcp:4:lfs.0 Request processed in 23822us (24391us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1788797043.588452:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 0 00002000:00100000:3.0:1788797043.588464:0:6687:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2:0x0] (0->12) req@ffff8cb079029180 x1875689351444224/t4294967299(0) o4->e6d050bb-169e-4784-be5b-7071799bf3b0@192.168.204.38@tcp:469/0 lens 504/448 e 0 to 0 dl 1788797054 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788797043.588475:0:6687:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8cb079029180 with x1875689351444224 ext(0->12) 00010000:00010000:3.0:1788797043.588486:0:6687:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000004b1423c6/0xca7fc0c411f93866 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1035 expref: 9 pid: 6684 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797043.588507:0:6687:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000004b1423c6/0xca7fc0c411f93866 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1035 expref: 9 pid: 6684 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788797043.588516:0:6687:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8cb079029180 00000100:00100000:2.0:1788797043.591168:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1788797043.591819:0:11663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351444352 00000100:00100000:1.0:1788797043.591830:0:11663:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351444352 00010000:00010000:1.0:1788797043.591870:0:11663:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000004b1423c6/0xca7fc0c411f93866 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1035 expref: 9 pid: 6684 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788797043.591946:0:11663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 36 00000100:00100000:1.0:1788797043.591956:0:11663:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb080684380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e6d050bb-169e-4784-be5b-7071799bf3b0+9:2355:x1875689351444352:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788797043.591982:0:11663:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1788797043.592000:0:11663:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1788797043.592004:0:11663:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb mtime from disk: 0 -> 1788797043 00002000:00010000:1.0:1788797043.592006:0:11663:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb atime from disk: 0 -> 1788797043 00002000:00010000:1.0:1788797043.592008:0:11663:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb ctime from disk: 0 -> 1788797043 00010000:00010000:1.0:1788797043.592014:0:11663:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000004b1423c6/0xca7fc0c411f93866 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1035 expref: 9 pid: 6684 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797043.592056:0:11663:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000004b1423c6/0xca7fc0c411f93866 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1035 expref: 9 pid: 6684 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797043.592083:0:11663:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004b1423c6/0xca7fc0c411f93866 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1035 expref: 9 pid: 6684 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797043.592100:0:11663:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788797043.592104:0:11663:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788797043.592109:0:11663:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000be7b1247/0xca7fc0c411f938b3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797043.592137:0:11663:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000be7b1247/0xca7fc0c411f938b3 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797043.592170:0:11663:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788797043.592224:0:11663:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb080684380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e6d050bb-169e-4784-be5b-7071799bf3b0+8:2355:x1875689351444352:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 268us (1064us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797043.592231:0:11663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 36 00010000:00010000:2.0:1788797043.592514:0:6681:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000be7b1247/0xca7fc0c411f938b3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797043.592525:0:6681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000be7b1247/0xca7fc0c411f938b3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797043.592560:0:6681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000be7b1247/0xca7fc0c411f938b3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797043.592569:0:6681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000be7b1247/0xca7fc0c411f938b3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797043.592578:0:6681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000be7b1247/0xca7fc0c411f938b3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797043.592598:0:6681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb082044200 already unused, calling callback (ffffffffc14d98b0) 00010000:00010000:2.0:1788797043.592602:0:6681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000be7b1247/0xca7fc0c411f938b3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797043.592611:0:6681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000be7b1247/0xca7fc0c411f938b3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797043.592625:0:6681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000be7b1247/0xca7fc0c411f938b3 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797043.592633:0:6681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000be7b1247/0xca7fc0c411f938b3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788797043.592700:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb080686300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e6d050bb-169e-4784-be5b-7071799bf3b0+7:2352:x1875689351444096:12345-192.168.204.38@tcp:1:lfs.0 Request processed in 31823us (32152us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797043.592707:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 24 00000100:00100000:2.0:1788797043.595857:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1788797043.595939:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351444608 00000100:00100000:0.0:1788797043.595950:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351444608 00000100:00100000:0.0:1788797043.596176:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 8 00000100:00100000:0.0:1788797043.596187:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb080686d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e6d050bb-169e-4784-be5b-7071799bf3b0+19:10330:x1875689351444608:12345-192.168.204.38@tcp:35:lfs.0 00000004:00010000:0.0:1788797043.596254:0:5828:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cb0821f0a00/0xca7fc0c411f938a5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1051 expref: 19 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788797043.596748:0:5828:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967317 00000001:00080000:0.0:1788797043.596804:0:5828:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967318 00000001:00080000:0.0:1788797043.597686:0:5828:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00010000:00010000:0.0:1788797043.597748:0:5828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2400/0xca7fc0c411f938ba lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797043.597765:0:5828:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3600/0xca7fc0c411f9384a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1027 expref: 23 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797043.597774:0:5828:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2400/0xca7fc0c411f938ba lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797043.597811:0:5828:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3600/0xca7fc0c411f9384a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1027 expref: 23 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797043.597827:0:5828:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3600/0xca7fc0c411f9384a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1027 expref: 23 pid: 5826 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788797043.597855:0:5828:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb077f09c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5828:1875689374546048:192.168.204.38@tcp:104: 00000100:00100000:0.0:1788797043.598012:0:5828:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb0452accc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788797043.601163:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1788797043.601284:0:5828:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb077f09c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5828:1875689374546048:192.168.204.38@tcp:104: 00010000:00010000:0.0:1788797043.601321:0:5828:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2400/0xca7fc0c411f938ba lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788797043.601607:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351444736 00000100:00100000:1.0:1788797043.601615:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351444736 00010000:00010000:1.0:1788797043.601648:0:5811:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3600/0xca7fc0c411f9384a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1027 expref: 24 pid: 5826 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788797043.601684:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 37 00000100:00100000:1.0:1788797043.601693:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb077979180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e6d050bb-169e-4784-be5b-7071799bf3b0+24:2355:x1875689351444736:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788797043.601709:0:5811:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788797043.601716:0:5811:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3600/0xca7fc0c411f9384a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1027 expref: 24 pid: 5826 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797043.601728:0:5811:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3600/0xca7fc0c411f9384a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1027 expref: 24 pid: 5826 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797043.601751:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3600/0xca7fc0c411f9384a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1027 expref: 24 pid: 5826 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797043.601768:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cb058766100) 00010000:00010000:1.0:1788797043.601788:0:5811:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2400/0xca7fc0c411f938ba lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797043.601798:0:5811:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2400/0xca7fc0c411f938ba lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797043.601805:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2400/0xca7fc0c411f938ba lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797043.601836:0:5811:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788797043.601894:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb077979180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e6d050bb-169e-4784-be5b-7071799bf3b0+23:2355:x1875689351444736:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 202us (743us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797043.601902:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 37 00010000:00010000:2.0:1788797043.601978:0:5828:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2400/0xca7fc0c411f938ba lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797043.601986:0:5828:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2400/0xca7fc0c411f938ba lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788797043.602136:0:5828:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:2.0:1788797043.602343:0:5828:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00000100:00100000:2.0:1788797043.602466:0:5828:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb080685880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5828:1875689374546176:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1788797043.602515:0:5828:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788797043.602546:0:5828:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb046b36840 going to sleep for 11 seconds 00000100:00100000:1.0:1788797043.602865:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374546176 00000100:00100000:1.0:1788797043.602872:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374546176 00000100:00100000:1.0:1788797043.602917:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788797043.602926:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb080685c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5828:x1875689374546176:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1788797043.603046:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb080685c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5828:x1875689374546176:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 102us (510us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797043.603053:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788797043.603720:0:5828:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb080685880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5828:1875689374546176:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1788797043.604539:0:5828:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000100:00100000:2.0:1788797043.604755:0:5828:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb080685880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5828:1875689374546304:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1788797043.604811:0:5828:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788797043.604894:0:5828:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb046b36540 going to sleep for 11 seconds 00000100:00100000:1.0:1788797043.606013:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374546304 00000100:00100000:1.0:1788797043.606131:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374546304 00000100:00100000:1.0:1788797043.606226:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788797043.606237:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb080686680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5828:x1875689374546304:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1788797043.606528:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb080686680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5828:x1875689374546304:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 292us (1715us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1788797043.606537:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788797043.606759:0:5828:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb080685880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5828:1875689374546304:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1788797043.606828:0:5828:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00010000:00010000:3.0:1788797043.606876:0:5828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2400/0xca7fc0c411f938ba lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797043.606901:0:5828:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2400/0xca7fc0c411f938ba lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797043.606909:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2400/0xca7fc0c411f938ba lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797043.606916:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb042ea2400 already unused, calling callback (ffffffffc1f014f0) 00010000:00010000:3.0:1788797043.606922:0:5828:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2400/0xca7fc0c411f938ba lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797043.606930:0:5828:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2400/0xca7fc0c411f938ba lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797043.606946:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cb058766100) 00010000:00010000:3.0:1788797043.606949:0:5828:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1788797043.606955:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2400/0xca7fc0c411f938ba lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797043.606961:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2400/0xca7fc0c411f938ba lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788797043.607700:0:5828:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1788797043.607935:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:3.0:1788797043.607948:0:5828:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 332613918126ns, next at 333613915251ns, rc = 0 00000001:00080000:3.0:1788797043.607957:0:5828:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00010000:00010000:3.0:1788797043.608017:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cb058766100) 00010000:00010000:3.0:1788797043.608021:0:5828:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1788797043.608198:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb0821f0a00/0xca7fc0c411f938a5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1051 expref: 27 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788797043.608517:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb080686d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e6d050bb-169e-4784-be5b-7071799bf3b0+26:10330:x1875689351444608:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 12331us (12667us total) trans 4294967325 rc 0/0 00000100:00100000:3.0:1788797043.608526:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 8 00000020:00080000:3.0:1788797043.608531:0:5828:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1788797043.611620:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1788797043.611705:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351444864 00000100:00100000:2.0:1788797043.611715:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351444864 00000100:00100000:2.0:1788797043.611767:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 45 00000100:00100000:2.0:1788797043.611777:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb079028a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6d050bb-169e-4784-be5b-7071799bf3b0+26:10330:x1875689351444864:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1788797043.611801:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788797043.611822:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484c00/0xca7fc0c411f938c1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c99e04559ee1058 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797043.611879:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484c00/0xca7fc0c411f938c1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1058 expref: 27 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797043.611917:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484c00/0xca7fc0c411f938c1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1058 expref: 27 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797043.611939:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cb05088a100) 00010000:00010000:2.0:1788797043.611943:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788797043.611946:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb041484c00, rc 0) 00000100:00100000:2.0:1788797043.612065:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb079028a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6d050bb-169e-4784-be5b-7071799bf3b0+27:10330:x1875689351444864:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 289us (453us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797043.612072:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 45 00000100:00100000:3.0:1788797043.614769:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1788797043.614858:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351445120 00000100:00100000:2.0:1788797043.614870:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351445120 00000100:00100000:2.0:1788797043.614929:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9 00000100:00100000:2.0:1788797043.614939:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb050636c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e6d050bb-169e-4784-be5b-7071799bf3b0+27:10330:x1875689351445120:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:2.0:1788797043.615255:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb050636c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e6d050bb-169e-4784-be5b-7071799bf3b0+28:10330:x1875689351445120:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 317us (494us total) trans 4294967326 rc 0/0 00000100:00100000:2.0:1788797043.615264:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9 00000100:00100000:2.0:1788797043.734941:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1788797043.740788:0:7636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351445376 00000100:00100000:1.0:1788797043.740827:0:7636:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351445376 00000100:00100000:1.0:1788797043.740912:0:7636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 46 00000100:00100000:1.0:1788797043.740926:0:7636:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb080686d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6d050bb-169e-4784-be5b-7071799bf3b0+28:10340:x1875689351445376:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1788797043.740952:0:7636:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788797043.740986:0:7636:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045400/0xca7fc0c411f938c8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c99e04559ee105f expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788797043.741169:0:7636:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:1.0:1788797043.741324:0:7636:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045400/0xca7fc0c411f938c8 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee105f expref: 30 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797043.741339:0:7636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cb065cc2500) 00010000:00010000:1.0:1788797043.741342:0:7636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788797043.741348:0:7636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045400/0xca7fc0c411f938c8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee105f expref: 30 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797043.741364:0:7636:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb082045400, rc 0) 00000100:00100000:1.0:1788797043.741453:0:7636:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb080686d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6d050bb-169e-4784-be5b-7071799bf3b0+29:10340:x1875689351445376:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 529us (6523us total) trans 4294967327 rc 301/301 00000100:00100000:1.0:1788797043.741461:0:7636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 46 00000100:00100000:1.0:1788797043.750291:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1788797043.750443:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351445504 00000100:00100000:2.0:1788797043.750455:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351445504 00000100:00100000:2.0:1788797043.750522:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 47 00000100:00100000:2.0:1788797043.750533:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb079028700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6d050bb-169e-4784-be5b-7071799bf3b0+29:10340:x1875689351445504:12345-192.168.204.38@tcp:34:lfs.0 00010000:00010000:2.0:1788797043.750618:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484400/0xca7fc0c411f938d6 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797043.750650:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484400/0xca7fc0c411f938d6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797043.750683:0:5827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484400/0xca7fc0c411f938d6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797043.750701:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484000/0xca7fc0c411f938dd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797043.750710:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484000/0xca7fc0c411f938dd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797043.750717:0:5827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484000/0xca7fc0c411f938dd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797043.750833:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484800/0xca7fc0c411f938e4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797043.750842:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484800/0xca7fc0c411f938e4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797043.750849:0:5827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484800/0xca7fc0c411f938e4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788797043.750900:0:5827:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484800/0xca7fc0c411f938e4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797043.750916:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484400/0xca7fc0c411f938d6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797043.750924:0:5827:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484400/0xca7fc0c411f938d6 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797043.750932:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484400/0xca7fc0c411f938d6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797043.750949:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb041484400 already unused, calling callback (ffffffffc1f014f0) 00010000:00010000:2.0:1788797043.750955:0:5827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484400/0xca7fc0c411f938d6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797043.750977:0:5827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484400/0xca7fc0c411f938d6 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797043.750995:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8cb06ce84d00) 00010000:00010000:2.0:1788797043.750999:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788797043.751005:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484400/0xca7fc0c411f938d6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797043.751012:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484400/0xca7fc0c411f938d6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797043.751118:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484000/0xca7fc0c411f938dd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797043.751125:0:5827:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484000/0xca7fc0c411f938dd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797043.751132:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484000/0xca7fc0c411f938dd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797043.751138:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb041484000 already unused, calling callback (ffffffffc1f014f0) 00010000:00010000:2.0:1788797043.751141:0:5827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484000/0xca7fc0c411f938dd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797043.751148:0:5827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484000/0xca7fc0c411f938dd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797043.751181:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8cb05088a800) 00010000:00010000:2.0:1788797043.751185:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788797043.751188:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484000/0xca7fc0c411f938dd lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797043.751195:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484000/0xca7fc0c411f938dd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797043.751214:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484800/0xca7fc0c411f938e4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797043.751221:0:5827:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484800/0xca7fc0c411f938e4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797043.751227:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484800/0xca7fc0c411f938e4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797043.751233:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb041484800 already unused, calling callback (ffffffffc1f014f0) 00010000:00010000:2.0:1788797043.751236:0:5827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484800/0xca7fc0c411f938e4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797043.751242:0:5827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484800/0xca7fc0c411f938e4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797043.751249:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cb05088a100) 00010000:00010000:2.0:1788797043.751251:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788797043.751254:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484800/0xca7fc0c411f938e4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797043.751260:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484800/0xca7fc0c411f938e4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788797043.751436:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb079028700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6d050bb-169e-4784-be5b-7071799bf3b0+29:10340:x1875689351445504:12345-192.168.204.38@tcp:34:lfs.0 Request processed in 903us (1163us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797043.751444:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 47 00000100:00100000:3.0:1788797043.779875:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1788797043.780144:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351445760 00000100:00100000:3.0:1788797043.780154:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351445760 00000100:00100000:1.0:1788797043.780226:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 10 00000100:00100000:1.0:1788797043.780245:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb07797a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e6d050bb-169e-4784-be5b-7071799bf3b0+29:10340:x1875689351445760:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:1.0:1788797043.780841:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb07797a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e6d050bb-169e-4784-be5b-7071799bf3b0+30:10340:x1875689351445760:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 599us (974us total) trans 4294967328 rc 0/0 00000100:00100000:1.0:1788797043.780853:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 10 00000100:00100000:0.0:1788797043.829285:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1788797043.829362:0:7636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351446016 00000100:00100000:1.0:1788797043.829373:0:7636:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351446016 00000100:00100000:1.0:1788797043.829435:0:7636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 48 00000100:00100000:1.0:1788797043.829446:0:7636:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb077f09c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6d050bb-169e-4784-be5b-7071799bf3b0+30:10343:x1875689351446016:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1788797043.829475:0:7636:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788797043.829500:0:7636:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045400/0xca7fc0c411f938eb lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c99e04559ee1066 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797043.829576:0:7636:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045e00/0xca7fc0c411f938f2 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797043.829590:0:7636:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045e00/0xca7fc0c411f938f2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797043.829602:0:7636:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045e00/0xca7fc0c411f938f2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797043.829617:0:7636:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045200/0xca7fc0c411f938f9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797043.829624:0:7636:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045200/0xca7fc0c411f938f9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797043.829631:0:7636:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045200/0xca7fc0c411f938f9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797043.829739:0:7636:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082044600/0xca7fc0c411f93900 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797043.829747:0:7636:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082044600/0xca7fc0c411f93900 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797043.829772:0:7636:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082044600/0xca7fc0c411f93900 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788797043.829782:0:7636:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:1.0:1788797043.829876:0:7636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045e00/0xca7fc0c411f938f2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797043.829917:0:7636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045e00/0xca7fc0c411f938f2 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797043.829924:0:7636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045e00/0xca7fc0c411f938f2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797043.829930:0:7636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb082045e00 already unused, calling callback (ffffffffc1f014f0) 00010000:00010000:1.0:1788797043.829936:0:7636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045e00/0xca7fc0c411f938f2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797043.829943:0:7636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045e00/0xca7fc0c411f938f2 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797043.829984:0:7636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8cb06ce84d00) 00010000:00010000:1.0:1788797043.829987:0:7636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788797043.829992:0:7636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045e00/0xca7fc0c411f938f2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797043.829999:0:7636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045e00/0xca7fc0c411f938f2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797043.830013:0:7636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045200/0xca7fc0c411f938f9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797043.830019:0:7636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045200/0xca7fc0c411f938f9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797043.830070:0:7636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045200/0xca7fc0c411f938f9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797043.830074:0:7636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb082045200 already unused, calling callback (ffffffffc1f014f0) 00010000:00010000:1.0:1788797043.830078:0:7636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045200/0xca7fc0c411f938f9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797043.830084:0:7636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045200/0xca7fc0c411f938f9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797043.830092:0:7636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8cb06ce84c00) 00010000:00010000:1.0:1788797043.830094:0:7636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788797043.830097:0:7636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045200/0xca7fc0c411f938f9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797043.830104:0:7636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045200/0xca7fc0c411f938f9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797043.830146:0:7636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045400/0xca7fc0c411f938eb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1066 expref: 33 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797043.830158:0:7636:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082044600/0xca7fc0c411f93900 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1066 expref: 32 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797043.830166:0:7636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cb05088a100) 00010000:00010000:1.0:1788797043.830168:0:7636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788797043.830170:0:7636:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb082044600, rc 0) 00000100:00100000:1.0:1788797043.830222:0:7636:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb077f09c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6d050bb-169e-4784-be5b-7071799bf3b0+32:10343:x1875689351446016:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 778us (958us total) trans 4294967329 rc 0/0 00000100:00100000:1.0:1788797043.830237:0:7636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 48 00000100:00100000:3.0:1788797043.841925:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1788797043.842079:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351446144 00000100:00100000:2.0:1788797043.842093:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351446144 00000100:00100000:2.0:1788797043.842166:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 49 00000100:00100000:2.0:1788797043.842178:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0796c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6d050bb-169e-4784-be5b-7071799bf3b0+32:10343:x1875689351446144:12345-192.168.204.38@tcp:54:lfs.0 00010000:00010000:2.0:1788797043.842277:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484800/0xca7fc0c411f9390e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797043.842298:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484800/0xca7fc0c411f9390e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797043.842312:0:5827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484800/0xca7fc0c411f9390e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797043.842345:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484800/0xca7fc0c411f9390e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797043.842354:0:5827:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484800/0xca7fc0c411f9390e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797043.842362:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484800/0xca7fc0c411f9390e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797043.842368:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb041484800 already unused, calling callback (ffffffffc1f014f0) 00010000:00010000:2.0:1788797043.842373:0:5827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484800/0xca7fc0c411f9390e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797043.842381:0:5827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484800/0xca7fc0c411f9390e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797043.842412:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cb05088a100) 00010000:00010000:2.0:1788797043.842415:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788797043.842421:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484800/0xca7fc0c411f9390e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797043.842428:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484800/0xca7fc0c411f9390e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788797043.842495:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0796c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6d050bb-169e-4784-be5b-7071799bf3b0+32:10343:x1875689351446144:12345-192.168.204.38@tcp:54:lfs.0 Request processed in 319us (582us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797043.842503:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 49 00000100:00100000:3.0:1788797043.854981:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1788797043.855077:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351446400 00000100:00100000:2.0:1788797043.855086:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351446400 00000100:00100000:2.0:1788797043.855195:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 11 00000100:00100000:2.0:1788797043.855212:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb06f608700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e6d050bb-169e-4784-be5b-7071799bf3b0+32:10343:x1875689351446400:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:2.0:1788797043.855530:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb06f608700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e6d050bb-169e-4784-be5b-7071799bf3b0+33:10343:x1875689351446400:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 326us (566us total) trans 4294967330 rc 0/0 00000100:00100000:2.0:1788797043.855539:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 11 00000100:00100000:0.0:1788797044.211969:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1788797044.212057:0:7636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351446656 00000100:00100000:1.0:1788797044.212068:0:7636:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351446656 00000100:00100000:1.0:1788797044.212136:0:7636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 50 00000100:00100000:1.0:1788797044.212148:0:7636:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb077f0bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6d050bb-169e-4784-be5b-7071799bf3b0+33:10374:x1875689351446656:12345-192.168.204.38@tcp:101:cat.0 00010000:00010000:1.0:1788797044.212175:0:7636:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788797044.212196:0:7636:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045400/0xca7fc0c411f93915 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c99e04559ee106d expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797044.212338:0:7636:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045200/0xca7fc0c411f9391c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797044.212355:0:7636:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045200/0xca7fc0c411f9391c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797044.212370:0:7636:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045200/0xca7fc0c411f9391c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788797044.212384:0:7636:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:1.0:1788797044.212536:0:7636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045400/0xca7fc0c411f93915 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee106d expref: 36 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797044.212557:0:7636:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045200/0xca7fc0c411f9391c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee106d expref: 35 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797044.212565:0:7636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cb05088a100) 00010000:00010000:1.0:1788797044.212568:0:7636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788797044.212572:0:7636:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb082045200, rc 0) 00000100:00100000:1.0:1788797044.212656:0:7636:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb077f0bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6d050bb-169e-4784-be5b-7071799bf3b0+35:10374:x1875689351446656:12345-192.168.204.38@tcp:101:cat.0 Request processed in 510us (710us total) trans 4294967331 rc 0/0 00000100:00100000:1.0:1788797044.212663:0:7636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 50 00000100:00100000:3.0:1788797044.220281:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1788797044.220336:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1788797044.220468:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351447040 00000100:00100000:0.0:1788797044.220480:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351447040 00000100:00100000:0.0:1788797044.220565:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3 00000100:00100000:0.0:1788797044.220589:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb042ed9c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e6d050bb-169e-4784-be5b-7071799bf3b0+35:2355:x1875689351447040:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788797044.220608:0:5813:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788797044.220632:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045200/0xca7fc0c411f9391c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee106d expref: 35 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797044.220653:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cb05088a100) 00010000:00010000:0.0:1788797044.220659:0:5813:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788797044.220722:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb042ed9c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e6d050bb-169e-4784-be5b-7071799bf3b0+34:2355:x1875689351447040:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 147us (386us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797044.220730:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3 00000100:00100000:2.0:1788797044.220887:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351446912 00000100:00100000:2.0:1788797044.220892:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351446912 00000100:00100000:2.0:1788797044.220930:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 12 00000100:00100000:2.0:1788797044.220939:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb06f60a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e6d050bb-169e-4784-be5b-7071799bf3b0+34:10374:x1875689351446912:12345-192.168.204.38@tcp:35:cat.0 00000100:00100000:2.0:1788797044.221278:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb06f60a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e6d050bb-169e-4784-be5b-7071799bf3b0+35:10374:x1875689351446912:12345-192.168.204.38@tcp:35:cat.0 Request processed in 339us (1019us total) trans 4294967332 rc 0/0 00000100:00100000:2.0:1788797044.221299:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 12 00000100:00100000:2.0:1788797044.305190:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1788797044.305457:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351447296 00000100:00100000:1.0:1788797044.305467:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351447296 00000100:00100000:1.0:1788797044.305680:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 51 00000100:00100000:1.0:1788797044.306485:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb080687b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6d050bb-169e-4784-be5b-7071799bf3b0+35:10380:x1875689351447296:12345-192.168.204.38@tcp:101:dd.0 00010000:00010000:1.0:1788797044.306516:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788797044.306520:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1788797044.306556:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb0821f0400/0xca7fc0c411f93882 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1043 expref: 35 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797044.306580:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8cb06ce84d00) 00010000:00010000:1.0:1788797044.306585:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788797044.306602:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045400/0xca7fc0c411f9392a lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c99e04559ee1074 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797044.307823:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045e00/0xca7fc0c411f93931 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797044.307853:0:5827:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082044600/0xca7fc0c411f93900 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1066 expref: 35 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797044.307867:0:5827:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045e00/0xca7fc0c411f93931 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797044.307911:0:5827:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082044600/0xca7fc0c411f93900 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1066 expref: 35 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797044.307974:0:5827:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082044600/0xca7fc0c411f93900 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1066 expref: 35 pid: 7636 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788797044.307997:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb07902a300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5827:1875689374546432:192.168.204.38@tcp:104: 00000100:00100000:1.0:1788797044.308233:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb0465d4f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788797044.318435:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb07902a300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5827:1875689374546432:192.168.204.38@tcp:104: 00010000:00010000:1.0:1788797044.318474:0:5827:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045e00/0xca7fc0c411f93931 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788797044.318699:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1788797044.319119:0:11663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351447424 00000100:00100000:1.0:1788797044.319128:0:11663:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351447424 00010000:00010000:1.0:1788797044.319167:0:11663:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082044600/0xca7fc0c411f93900 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1066 expref: 36 pid: 7636 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788797044.319211:0:11663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 38 00000100:00100000:1.0:1788797044.319222:0:11663:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb06f60b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e6d050bb-169e-4784-be5b-7071799bf3b0+36:2352:x1875689351447424:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788797044.319241:0:11663:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788797044.319248:0:11663:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082044600/0xca7fc0c411f93900 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1066 expref: 36 pid: 7636 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797044.319260:0:11663:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082044600/0xca7fc0c411f93900 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1066 expref: 36 pid: 7636 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797044.319968:0:11663:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082044600/0xca7fc0c411f93900 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1066 expref: 36 pid: 7636 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797044.320013:0:11663:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cb05088a100) 00010000:00010000:1.0:1788797044.320019:0:11663:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045e00/0xca7fc0c411f93931 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797044.320071:0:11663:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045e00/0xca7fc0c411f93931 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797044.320080:0:11663:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045e00/0xca7fc0c411f93931 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797044.320118:0:11663:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788797044.320260:0:11663:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb06f60b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e6d050bb-169e-4784-be5b-7071799bf3b0+35:2352:x1875689351447424:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 1039us (1570us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797044.320278:0:11663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 38 00010000:00010000:3.0:1788797044.320540:0:5827:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045e00/0xca7fc0c411f93931 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797044.320550:0:5827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045e00/0xca7fc0c411f93931 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788797044.320576:0:5827:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:3.0:1788797044.320813:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045400/0xca7fc0c411f9392a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1074 expref: 36 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797044.320835:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045e00/0xca7fc0c411f93931 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1074 expref: 35 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797044.320845:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cb05088a100) 00010000:00010000:3.0:1788797044.320859:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788797044.320873:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb082045e00, rc 0) 00000100:00100000:3.0:1788797044.320913:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb080687b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6d050bb-169e-4784-be5b-7071799bf3b0+35:10380:x1875689351447296:12345-192.168.204.38@tcp:101:dd.0 Request processed in 15224us (15736us total) trans 4294967333 rc 0/0 00000100:00100000:3.0:1788797044.320920:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 51 00000100:00100000:3.0:1788797044.325754:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1788797044.325932:0:7636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351447680 00000100:00100000:1.0:1788797044.325942:0:7636:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351447680 00000100:00100000:1.0:1788797044.326078:0:7636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 52 00000100:00100000:1.0:1788797044.326091:0:7636:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0794f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6d050bb-169e-4784-be5b-7071799bf3b0+35:10380:x1875689351447680:12345-192.168.204.38@tcp:36:dd.0 00010000:00010000:1.0:1788797044.326590:0:7636:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082044600/0xca7fc0c411f9393f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797044.326609:0:7636:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082044600/0xca7fc0c411f9393f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797044.326620:0:7636:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082044600/0xca7fc0c411f9393f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788797044.326667:0:7636:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967334 00000004:00010000:1.0:1788797044.326788:0:7636:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d17daee0 reply state 000000006349ec2d transno 4294967335 ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082044600/0xca7fc0c411f9393f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788797044.326806:0:7636:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788797044.327062:0:7636:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0794f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6d050bb-169e-4784-be5b-7071799bf3b0+38:10380:x1875689351447680:12345-192.168.204.38@tcp:36:dd.0 Request processed in 972us (1317us total) trans 4294967335 rc 0/0 00000100:00100000:1.0:1788797044.327070:0:7636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 52 00000020:00080000:1.0:1788797044.327077:0:7636:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1788797044.333533:0:3286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082044600/0xca7fc0c411f9393f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797044.333552:0:3286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082044600/0xca7fc0c411f9393f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797044.333571:0:3286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082044600/0xca7fc0c411f9393f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797044.333578:0:3286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb082044600 already unused, calling callback (ffffffffc1f014f0) 00010000:00010000:0.0:1788797044.333583:0:3286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082044600/0xca7fc0c411f9393f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797044.333590:0:3286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082044600/0xca7fc0c411f9393f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797044.333607:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cb05088a100) 00010000:00010000:0.0:1788797044.333610:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788797044.333615:0:3286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082044600/0xca7fc0c411f9393f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797044.333621:0:3286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082044600/0xca7fc0c411f9393f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797044.530592:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788797044.674725:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1788797044.674815:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351447808 00000100:00100000:3.0:1788797044.674826:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351447808 00000100:00100000:3.0:1788797044.674899:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 53 00000100:00100000:3.0:1788797044.674909:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb077f0b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6d050bb-169e-4784-be5b-7071799bf3b0+37:10394:x1875689351447808:12345-192.168.204.38@tcp:101:stat.0 00010000:00010000:3.0:1788797044.674934:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788797044.674966:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080436e00/0xca7fc0c411f93946 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c99e04559ee107b expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797044.675063:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080436a00/0xca7fc0c411f9394d lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797044.675077:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080436a00/0xca7fc0c411f9394d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797044.675102:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080436a00/0xca7fc0c411f9394d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797044.675116:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080437c00/0xca7fc0c411f93954 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797044.675122:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080437c00/0xca7fc0c411f93954 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797044.675128:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080437c00/0xca7fc0c411f93954 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797044.675231:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080436600/0xca7fc0c411f9395b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797044.675242:0:5825:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045e00/0xca7fc0c411f93931 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1074 expref: 38 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797044.675250:0:5825:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080436600/0xca7fc0c411f9395b lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797044.675285:0:5825:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045e00/0xca7fc0c411f93931 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1074 expref: 38 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797044.675299:0:5825:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045e00/0xca7fc0c411f93931 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1074 expref: 38 pid: 5827 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788797044.675313:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb0794f6680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5825:1875689374546560:192.168.204.38@tcp:104: 00000100:00100000:3.0:1788797044.675719:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb08214f3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788797044.683627:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1788797044.684227:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351448064 00000100:00100000:2.0:1788797044.684241:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351448064 00000100:00100000:2.0:1788797044.684323:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 13 00000100:00100000:2.0:1788797044.684343:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0794f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e6d050bb-169e-4784-be5b-7071799bf3b0+39:5608:x1875689351448064:12345-192.168.204.38@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1788797044.685110:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0794f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e6d050bb-169e-4784-be5b-7071799bf3b0+40:5608:x1875689351448064:12345-192.168.204.38@tcp:35:ldlm_bl.0 Request processed in 766us (1492us total) trans 4294967336 rc 0/0 00000100:00100000:2.0:1788797044.685121:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 13 00000100:00100000:1.0:1788797044.685573:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb0794f6680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5825:1875689374546560:192.168.204.38@tcp:104: 00000100:00100000:2.0:1788797044.688472:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00010000:00010000:1.0:1788797044.688670:0:5825:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080436600/0xca7fc0c411f9395b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788797044.688868:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351448192 00000100:00100000:0.0:1788797044.688877:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351448192 00010000:00010000:0.0:1788797044.688919:0:5812:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045e00/0xca7fc0c411f93931 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1074 expref: 40 pid: 5827 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788797044.689004:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 39 00000100:00100000:0.0:1788797044.689015:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb080684e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e6d050bb-169e-4784-be5b-7071799bf3b0+40:2355:x1875689351448192:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788797044.689063:0:5812:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788797044.689072:0:5812:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045e00/0xca7fc0c411f93931 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1074 expref: 40 pid: 5827 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797044.689109:0:5812:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045e00/0xca7fc0c411f93931 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1074 expref: 40 pid: 5827 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797044.689135:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045e00/0xca7fc0c411f93931 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1074 expref: 40 pid: 5827 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797044.689152:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cb05088a100) 00010000:00010000:0.0:1788797044.689157:0:5812:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080436600/0xca7fc0c411f9395b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797044.689167:0:5812:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080436600/0xca7fc0c411f9395b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797044.689175:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080436600/0xca7fc0c411f9395b lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797044.689206:0:5812:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788797044.689277:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb080684e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e6d050bb-169e-4784-be5b-7071799bf3b0+39:2355:x1875689351448192:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 264us (817us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797044.689291:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 39 00010000:00010000:1.0:1788797044.689827:0:5825:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080436600/0xca7fc0c411f9395b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797044.689836:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080436600/0xca7fc0c411f9395b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788797044.689886:0:5825:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:1.0:1788797044.689891:0:5825:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788797044.689940:0:5825:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080436600/0xca7fc0c411f9395b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797044.689963:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080436600/0xca7fc0c411f9395b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797044.689974:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080436a00/0xca7fc0c411f9394d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797044.689979:0:5825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080436a00/0xca7fc0c411f9394d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797044.689998:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080436a00/0xca7fc0c411f9394d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797044.690003:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb080436a00 already unused, calling callback (ffffffffc1f014f0) 00010000:00010000:1.0:1788797044.690008:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080436a00/0xca7fc0c411f9394d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797044.690017:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080436a00/0xca7fc0c411f9394d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797044.690060:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8cb06ce84d00) 00010000:00010000:1.0:1788797044.690064:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788797044.690068:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080436a00/0xca7fc0c411f9394d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797044.690074:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080436a00/0xca7fc0c411f9394d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797044.690086:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080437c00/0xca7fc0c411f93954 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797044.690092:0:5825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080437c00/0xca7fc0c411f93954 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797044.690098:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080437c00/0xca7fc0c411f93954 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797044.690103:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb080437c00 already unused, calling callback (ffffffffc1f014f0) 00010000:00010000:1.0:1788797044.690106:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080437c00/0xca7fc0c411f93954 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797044.690122:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080437c00/0xca7fc0c411f93954 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797044.690131:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8cb065cc2000) 00010000:00010000:1.0:1788797044.690133:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788797044.690136:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080437c00/0xca7fc0c411f93954 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797044.690142:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080437c00/0xca7fc0c411f93954 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797044.690183:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080436e00/0xca7fc0c411f93946 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee107b expref: 39 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797044.690198:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080436600/0xca7fc0c411f9395b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee107b expref: 38 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797044.690205:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cb05088a100) 00010000:00010000:1.0:1788797044.690206:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788797044.690209:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb080436600, rc 0) 00000100:00100000:1.0:1788797044.690251:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb077f0b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6d050bb-169e-4784-be5b-7071799bf3b0+38:10394:x1875689351447808:12345-192.168.204.38@tcp:101:stat.0 Request processed in 15344us (15538us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797044.690271:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 53 00000100:00100000:2.0:1788797044.768968:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1788797044.769170:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351448448 00000100:00100000:3.0:1788797044.769183:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351448448 00000100:00100000:3.0:1788797044.769248:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 54 00000100:00100000:3.0:1788797044.769268:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb080685f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6d050bb-169e-4784-be5b-7071799bf3b0+38:10400:x1875689351448448:12345-192.168.204.38@tcp:36:truncate.0 00010000:00010000:3.0:1788797044.769338:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788797044.769367:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080436600/0xca7fc0c411f9395b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee107b expref: 38 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797044.769394:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cb05088a100) 00010000:00010000:3.0:1788797044.769414:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788797044.769814:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c68a00/0xca7fc0c411f93962 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797044.769833:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c68a00/0xca7fc0c411f93962 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797044.769845:0:5826:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c68a00/0xca7fc0c411f93962 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788797044.769902:0:5826:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967337 00000004:00010000:3.0:1788797044.769930:0:5826:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000225019d0 reply state 00000000843598da transno 4294967338 ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c68a00/0xca7fc0c411f93962 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788797044.769940:0:5826:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788797044.770241:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb080685f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6d050bb-169e-4784-be5b-7071799bf3b0+40:10400:x1875689351448448:12345-192.168.204.38@tcp:36:truncate.0 Request processed in 983us (1293us total) trans 4294967338 rc 0/0 00000100:00100000:3.0:1788797044.770250:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 54 00000020:00080000:3.0:1788797044.770255:0:5826:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788797044.776236:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c68a00/0xca7fc0c411f93962 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797044.776265:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c68a00/0xca7fc0c411f93962 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797044.776274:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c68a00/0xca7fc0c411f93962 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797044.776286:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb077c68a00 already unused, calling callback (ffffffffc1f014f0) 00010000:00010000:2.0:1788797044.776292:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c68a00/0xca7fc0c411f93962 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797044.776301:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c68a00/0xca7fc0c411f93962 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797044.776428:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cb05088a100) 00010000:00010000:2.0:1788797044.776432:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788797044.776439:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c68a00/0xca7fc0c411f93962 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797044.776445:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c68a00/0xca7fc0c411f93962 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788797044.925953:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1788797044.926232:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351448576 00000100:00100000:1.0:1788797044.926241:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351448576 00000100:00100000:1.0:1788797044.926534:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 55 00000100:00100000:1.0:1788797044.926547:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb080687100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6d050bb-169e-4784-be5b-7071799bf3b0+39:10414:x1875689351448576:12345-192.168.204.38@tcp:101:stat.0 00010000:00010000:1.0:1788797044.926590:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788797044.926613:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045600/0xca7fc0c411f93969 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c99e04559ee1082 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797044.926679:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045c00/0xca7fc0c411f93970 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797044.926693:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045c00/0xca7fc0c411f93970 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797044.926703:0:5827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045c00/0xca7fc0c411f93970 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797044.926718:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045e00/0xca7fc0c411f93977 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797044.926725:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045e00/0xca7fc0c411f93977 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797044.926731:0:5827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045e00/0xca7fc0c411f93977 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797044.926831:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082044600/0xca7fc0c411f9397e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797044.926841:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082044600/0xca7fc0c411f9397e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797044.926848:0:5827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082044600/0xca7fc0c411f9397e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788797044.926885:0:5827:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00000004:00200000:1.0:1788797044.926895:0:5827:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788797044.926916:0:5827:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082044600/0xca7fc0c411f9397e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797044.926928:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082044600/0xca7fc0c411f9397e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797044.926936:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045c00/0xca7fc0c411f93970 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797044.926955:0:5827:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045c00/0xca7fc0c411f93970 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797044.926962:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045c00/0xca7fc0c411f93970 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797044.926969:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb082045c00 already unused, calling callback (ffffffffc1f014f0) 00010000:00010000:1.0:1788797044.926973:0:5827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045c00/0xca7fc0c411f93970 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797044.926982:0:5827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045c00/0xca7fc0c411f93970 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797044.926993:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8cb06ce84d00) 00010000:00010000:1.0:1788797044.926997:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788797044.927002:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045c00/0xca7fc0c411f93970 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797044.927008:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045c00/0xca7fc0c411f93970 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797044.927022:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045e00/0xca7fc0c411f93977 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797044.929433:0:5827:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045e00/0xca7fc0c411f93977 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797044.929441:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045e00/0xca7fc0c411f93977 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797044.929447:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb082045e00 already unused, calling callback (ffffffffc1f014f0) 00010000:00010000:1.0:1788797044.929452:0:5827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045e00/0xca7fc0c411f93977 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797044.929462:0:5827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045e00/0xca7fc0c411f93977 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797044.929479:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8cb06ce84c00) 00010000:00010000:1.0:1788797044.929482:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788797044.929486:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045e00/0xca7fc0c411f93977 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797044.929493:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045e00/0xca7fc0c411f93977 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797044.929561:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045600/0xca7fc0c411f93969 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1082 expref: 41 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797044.929578:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082044600/0xca7fc0c411f9397e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1082 expref: 40 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797044.929813:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cb05088a100) 00010000:00010000:1.0:1788797044.929815:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788797044.929825:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb082044600, rc 0) 00000100:00100000:1.0:1788797044.929921:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb080687100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6d050bb-169e-4784-be5b-7071799bf3b0+40:10414:x1875689351448576:12345-192.168.204.38@tcp:101:stat.0 Request processed in 3376us (3985us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797044.929931:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 55 00000100:00100000:3.0:1788797045.002077:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1788797045.002287:0:7636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351448832 00000100:00100000:2.0:1788797045.002298:0:7636:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351448832 00000100:00100000:2.0:1788797045.002375:0:7636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 56 00000100:00100000:2.0:1788797045.002386:0:7636:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0794f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6d050bb-169e-4784-be5b-7071799bf3b0+40:10424:x1875689351448832:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1788797045.002407:0:7636:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788797045.002428:0:7636:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041485c00/0xca7fc0c411f93985 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c99e04559ee1089 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788797045.002521:0:7636:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:2.0:1788797045.002652:0:7636:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041485c00/0xca7fc0c411f93985 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1089 expref: 42 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797045.002670:0:7636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cb065cc2500) 00010000:00010000:2.0:1788797045.002672:0:7636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788797045.002678:0:7636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041485c00/0xca7fc0c411f93985 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1089 expref: 42 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797045.002690:0:7636:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb041485c00, rc 0) 00000100:00100000:2.0:1788797045.002761:0:7636:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0794f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6d050bb-169e-4784-be5b-7071799bf3b0+41:10424:x1875689351448832:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 378us (743us total) trans 4294967339 rc 301/301 00000100:00100000:2.0:1788797045.002768:0:7636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 56 00000100:00080000:3.0:1788797045.002836:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788797045.009135:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1788797045.009405:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351449088 00000100:00100000:3.0:1788797045.009416:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351449088 00000100:00100000:3.0:1788797045.009513:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 14 00000100:00100000:3.0:1788797045.009524:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb077f09f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e6d050bb-169e-4784-be5b-7071799bf3b0+41:10424:x1875689351449088:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:3.0:1788797045.009786:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb077f09f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e6d050bb-169e-4784-be5b-7071799bf3b0+42:10424:x1875689351449088:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 263us (659us total) trans 4294967340 rc 0/0 00000100:00100000:3.0:1788797045.009794:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 14 00000100:00100000:0.0:1788797045.056001:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1788797045.056070:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351449344 00000100:00100000:3.0:1788797045.056083:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351449344 00000100:00100000:3.0:1788797045.056235:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 57 00000100:00100000:3.0:1788797045.056249:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb077f08e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6d050bb-169e-4784-be5b-7071799bf3b0+42:10430:x1875689351449344:12345-192.168.204.38@tcp:101:bash.0 00010000:00010000:3.0:1788797045.056276:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788797045.056297:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69a00/0xca7fc0c411f93993 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c99e04559ee1090 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797045.056578:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c68400/0xca7fc0c411f9399a lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797045.056596:0:5825:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082044600/0xca7fc0c411f9397e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1082 expref: 43 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797045.056605:0:5825:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c68400/0xca7fc0c411f9399a lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797045.056643:0:5825:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082044600/0xca7fc0c411f9397e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1082 expref: 43 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797045.056656:0:5825:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082044600/0xca7fc0c411f9397e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1082 expref: 43 pid: 5827 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788797045.056671:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb0794f5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5825:1875689374546688:192.168.204.38@tcp:104: 00000100:00100000:3.0:1788797045.056853:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb0453f4480 going to sleep for 11 seconds 00000100:00100000:3.0:1788797045.060867:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb0794f5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5825:1875689374546688:192.168.204.38@tcp:104: 00010000:00010000:3.0:1788797045.060898:0:5825:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c68400/0xca7fc0c411f9399a lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788797045.061238:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1788797045.061442:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351449472 00000100:00100000:1.0:1788797045.061451:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351449472 00010000:00010000:1.0:1788797045.061491:0:6698:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082044600/0xca7fc0c411f9397e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1082 expref: 44 pid: 5827 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788797045.061534:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 40 00000100:00100000:1.0:1788797045.061544:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb077f0b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e6d050bb-169e-4784-be5b-7071799bf3b0+44:2354:x1875689351449472:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788797045.061560:0:6698:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788797045.061567:0:6698:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082044600/0xca7fc0c411f9397e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1082 expref: 44 pid: 5827 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797045.061579:0:6698:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082044600/0xca7fc0c411f9397e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1082 expref: 44 pid: 5827 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797045.061604:0:6698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082044600/0xca7fc0c411f9397e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1082 expref: 44 pid: 5827 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797045.061624:0:6698:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cb05088a100) 00010000:00010000:1.0:1788797045.061630:0:6698:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c68400/0xca7fc0c411f9399a lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797045.061639:0:6698:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c68400/0xca7fc0c411f9399a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797045.061647:0:6698:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c68400/0xca7fc0c411f9399a lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797045.061709:0:6698:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788797045.061810:0:5825:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c68400/0xca7fc0c411f9399a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797045.061819:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c68400/0xca7fc0c411f9399a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788797045.061864:0:5825:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00010000:00010000:2.0:1788797045.062072:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69a00/0xca7fc0c411f93993 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1090 expref: 45 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797045.062089:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c68400/0xca7fc0c411f9399a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1090 expref: 44 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797045.062097:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cb05088a100) 00010000:00010000:2.0:1788797045.062100:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788797045.062103:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb077c68400, rc 0) 00000100:00100000:2.0:1788797045.062140:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb077f08e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6d050bb-169e-4784-be5b-7071799bf3b0+44:10430:x1875689351449344:12345-192.168.204.38@tcp:101:bash.0 Request processed in 5895us (6150us total) trans 4294967341 rc 0/0 00000100:00100000:2.0:1788797045.062147:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 57 00000100:00100000:1.0:1788797045.062437:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb077f0b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e6d050bb-169e-4784-be5b-7071799bf3b0+43:2354:x1875689351449472:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 893us (1199us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797045.062446:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 40 00000100:00100000:0.0:1788797045.067257:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1788797045.067346:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351449728 00000100:00100000:3.0:1788797045.067374:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351449728 00000100:00100000:3.0:1788797045.067447:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 58 00000100:00100000:3.0:1788797045.067459:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb077f09500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6d050bb-169e-4784-be5b-7071799bf3b0+43:10430:x1875689351449728:12345-192.168.204.38@tcp:36:bash.0 00010000:00010000:3.0:1788797045.067904:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c68e00/0xca7fc0c411f939a8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797045.067925:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c68e00/0xca7fc0c411f939a8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797045.067952:0:5826:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c68e00/0xca7fc0c411f939a8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788797045.068064:0:5826:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967342 00000004:00010000:3.0:1788797045.068093:0:5826:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b6693945 reply state 000000008a56a056 transno 4294967343 ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c68e00/0xca7fc0c411f939a8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788797045.068152:0:5826:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788797045.068316:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb077f09500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6d050bb-169e-4784-be5b-7071799bf3b0+46:10430:x1875689351449728:12345-192.168.204.38@tcp:36:bash.0 Request processed in 857us (1066us total) trans 4294967343 rc 0/0 00000100:00100000:3.0:1788797045.068324:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 58 00000020:00080000:3.0:1788797045.068330:0:5826:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1788797045.070866:0:3286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c68e00/0xca7fc0c411f939a8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797045.070887:0:3286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c68e00/0xca7fc0c411f939a8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797045.070911:0:3286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c68e00/0xca7fc0c411f939a8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797045.070919:0:3286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb077c68e00 already unused, calling callback (ffffffffc1f014f0) 00010000:00010000:0.0:1788797045.070925:0:3286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c68e00/0xca7fc0c411f939a8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797045.070935:0:3286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c68e00/0xca7fc0c411f939a8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797045.070965:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cb05088a100) 00010000:00010000:0.0:1788797045.070968:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788797045.070974:0:3286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c68e00/0xca7fc0c411f939a8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797045.070980:0:3286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c68e00/0xca7fc0c411f939a8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788797045.074916:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1788797045.075193:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351449856 00000100:00100000:1.0:1788797045.075211:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351449856 00000100:00100000:0.0:1788797045.075629:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 59 00000100:00100000:0.0:1788797045.075642:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb079174380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6d050bb-169e-4784-be5b-7071799bf3b0+45:10430:x1875689351449856:12345-192.168.204.38@tcp:101:bash.0 00010000:00010000:0.0:1788797045.075669:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788797045.075691:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2200/0xca7fc0c411f939af lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c99e04559ee1097 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797045.075980:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2c00/0xca7fc0c411f939b6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797045.075996:0:5827:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c68400/0xca7fc0c411f9399a lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1090 expref: 46 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797045.076020:0:5827:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2c00/0xca7fc0c411f939b6 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797045.076167:0:5827:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c68400/0xca7fc0c411f9399a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1090 expref: 46 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797045.076183:0:5827:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c68400/0xca7fc0c411f9399a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1090 expref: 46 pid: 5825 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788797045.076382:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb04982f800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5827:1875689374546816:192.168.204.38@tcp:104: 00000100:00100000:0.0:1788797045.076484:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb0452ac300 going to sleep for 11 seconds 00000100:00100000:3.0:1788797045.079833:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1788797045.079934:0:11663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351449984 00000100:00100000:1.0:1788797045.079958:0:11663:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351449984 00010000:00010000:1.0:1788797045.080000:0:11663:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c68400/0xca7fc0c411f9399a lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1090 expref: 47 pid: 5825 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788797045.080079:0:11663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 41 00000100:00100000:1.0:1788797045.080095:0:11663:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0794f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e6d050bb-169e-4784-be5b-7071799bf3b0+47:2355:x1875689351449984:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788797045.080113:0:11663:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788797045.080120:0:11663:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c68400/0xca7fc0c411f9399a lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1090 expref: 47 pid: 5825 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797045.080134:0:11663:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c68400/0xca7fc0c411f9399a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1090 expref: 47 pid: 5825 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797045.080157:0:11663:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cb05088a100) 00010000:00010000:1.0:1788797045.080162:0:11663:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2c00/0xca7fc0c411f939b6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797045.080171:0:11663:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2c00/0xca7fc0c411f939b6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797045.080192:0:11663:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2c00/0xca7fc0c411f939b6 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797045.080232:0:11663:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788797045.080311:0:11663:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0794f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e6d050bb-169e-4784-be5b-7071799bf3b0+47:2355:x1875689351449984:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 221us (492us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797045.080318:0:11663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 41 00010000:00010000:0.0:1788797045.080475:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c68400/0xca7fc0c411f9399a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1090 expref: 46 pid: 5825 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788797045.080495:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb04982f800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5827:1875689374546816:192.168.204.38@tcp:104: 00010000:00010000:0.0:1788797045.080514:0:5827:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2c00/0xca7fc0c411f939b6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797045.080523:0:5827:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2c00/0xca7fc0c411f939b6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797045.080528:0:5827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2c00/0xca7fc0c411f939b6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788797045.080586:0:5827:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:0.0:1788797045.080591:0:5827:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788797045.080611:0:5827:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2c00/0xca7fc0c411f939b6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797045.080651:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2200/0xca7fc0c411f939af lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1097 expref: 46 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797045.080666:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2c00/0xca7fc0c411f939b6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1097 expref: 45 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797045.080674:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cb05088a100) 00010000:00010000:0.0:1788797045.080677:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788797045.080680:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb042ea2c00, rc 0) 00000100:00100000:0.0:1788797045.080721:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb079174380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6d050bb-169e-4784-be5b-7071799bf3b0+45:10430:x1875689351449856:12345-192.168.204.38@tcp:101:bash.0 Request processed in 5084us (5817us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797045.080728:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 59 00000100:00100000:3.0:1788797045.084172:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1788797045.084456:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351450240 00000100:00100000:2.0:1788797045.084466:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351450240 00000100:00100000:2.0:1788797045.084598:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 15 00000100:00100000:2.0:1788797045.084610:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb050634450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e6d050bb-169e-4784-be5b-7071799bf3b0+45:10430:x1875689351450240:12345-192.168.204.38@tcp:35:bash.0 00000100:00100000:2.0:1788797045.084872:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb050634450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e6d050bb-169e-4784-be5b-7071799bf3b0+46:10430:x1875689351450240:12345-192.168.204.38@tcp:35:bash.0 Request processed in 264us (710us total) trans 4294967344 rc 0/0 00000100:00100000:2.0:1788797045.084880:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 15 00000100:00100000:2.0:1788797045.151913:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1788797045.152390:0:7636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351450496 00000100:00100000:1.0:1788797045.152402:0:7636:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351450496 00000100:00100000:1.0:1788797045.152565:0:7636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 60 00000100:00100000:1.0:1788797045.152578:0:7636:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb080687800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6d050bb-169e-4784-be5b-7071799bf3b0+46:10440:x1875689351450496:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1788797045.152828:0:7636:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788797045.152850:0:7636:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082044600/0xca7fc0c411f939bd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c99e04559ee109e expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788797045.153069:0:7636:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:1.0:1788797045.153186:0:7636:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082044600/0xca7fc0c411f939bd lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee109e expref: 48 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797045.153201:0:7636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cb065cc2500) 00010000:00010000:1.0:1788797045.153204:0:7636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788797045.153209:0:7636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082044600/0xca7fc0c411f939bd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee109e expref: 48 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797045.153224:0:7636:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb082044600, rc 0) 00000100:00100000:1.0:1788797045.153355:0:7636:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb080687800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6d050bb-169e-4784-be5b-7071799bf3b0+47:10440:x1875689351450496:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 780us (1451us total) trans 4294967345 rc 301/301 00000100:00100000:1.0:1788797045.153364:0:7636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 60 00000100:00100000:0.0:1788797045.157570:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1788797045.157738:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351450624 00000100:00100000:2.0:1788797045.157748:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351450624 00000100:00100000:2.0:1788797045.157835:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 61 00000100:00100000:2.0:1788797045.157845:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb04982f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6d050bb-169e-4784-be5b-7071799bf3b0+47:10440:x1875689351450624:12345-192.168.204.38@tcp:34:lfs.0 00010000:00010000:2.0:1788797045.157960:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484400/0xca7fc0c411f939cb lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797045.157979:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484400/0xca7fc0c411f939cb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797045.157992:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484400/0xca7fc0c411f939cb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797045.158010:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484000/0xca7fc0c411f939d2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797045.158017:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484000/0xca7fc0c411f939d2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797045.158023:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484000/0xca7fc0c411f939d2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797045.158168:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484800/0xca7fc0c411f939d9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797045.158189:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484800/0xca7fc0c411f939d9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797045.158198:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484800/0xca7fc0c411f939d9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788797045.158918:0:5825:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484800/0xca7fc0c411f939d9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797045.158948:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484400/0xca7fc0c411f939cb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797045.158971:0:5825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484400/0xca7fc0c411f939cb lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797045.158978:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484400/0xca7fc0c411f939cb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797045.158984:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb041484400 already unused, calling callback (ffffffffc1f014f0) 00010000:00010000:2.0:1788797045.158988:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484400/0xca7fc0c411f939cb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797045.158996:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484400/0xca7fc0c411f939cb lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797045.159009:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8cb06ce84d00) 00010000:00010000:2.0:1788797045.159012:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788797045.159017:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484400/0xca7fc0c411f939cb lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797045.159024:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484400/0xca7fc0c411f939cb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797045.159887:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484000/0xca7fc0c411f939d2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797045.159896:0:5825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484000/0xca7fc0c411f939d2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797045.159910:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484000/0xca7fc0c411f939d2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797045.159917:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb041484000 already unused, calling callback (ffffffffc1f014f0) 00010000:00010000:2.0:1788797045.159935:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484000/0xca7fc0c411f939d2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797045.159955:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484000/0xca7fc0c411f939d2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797045.159968:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8cb05088a800) 00010000:00010000:2.0:1788797045.159971:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788797045.159975:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484000/0xca7fc0c411f939d2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797045.159981:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484000/0xca7fc0c411f939d2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797045.160002:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484800/0xca7fc0c411f939d9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797045.160008:0:5825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484800/0xca7fc0c411f939d9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797045.160013:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484800/0xca7fc0c411f939d9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797045.160017:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb041484800 already unused, calling callback (ffffffffc1f014f0) 00010000:00010000:2.0:1788797045.160020:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484800/0xca7fc0c411f939d9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797045.160025:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484800/0xca7fc0c411f939d9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797045.160049:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cb05088a100) 00010000:00010000:2.0:1788797045.160051:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788797045.160061:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484800/0xca7fc0c411f939d9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797045.160067:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484800/0xca7fc0c411f939d9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788797045.160180:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb04982f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6d050bb-169e-4784-be5b-7071799bf3b0+47:10440:x1875689351450624:12345-192.168.204.38@tcp:34:lfs.0 Request processed in 2332us (2617us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797045.160189:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 61 00000100:00100000:0.0:1788797045.162586:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1788797045.162819:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351450880 00000100:00100000:3.0:1788797045.162829:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351450880 00000100:00100000:3.0:1788797045.162988:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 16 00000100:00100000:3.0:1788797045.162999:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb07797a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e6d050bb-169e-4784-be5b-7071799bf3b0+47:10440:x1875689351450880:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:3.0:1788797045.163273:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb07797a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e6d050bb-169e-4784-be5b-7071799bf3b0+48:10440:x1875689351450880:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 269us (689us total) trans 4294967346 rc 0/0 00000100:00100000:3.0:1788797045.163299:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 16 00000100:00100000:0.0:1788797045.196743:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1788797045.196861:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351451136 00000100:00100000:3.0:1788797045.196874:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351451136 00000100:00100000:3.0:1788797045.196959:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 62 00000100:00100000:3.0:1788797045.196969:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb077979180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6d050bb-169e-4784-be5b-7071799bf3b0+48:10443:x1875689351451136:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1788797045.196996:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788797045.197017:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c68200/0xca7fc0c411f939e0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c99e04559ee10a5 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797045.197142:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c68800/0xca7fc0c411f939e7 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797045.197158:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c68800/0xca7fc0c411f939e7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797045.197169:0:5826:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c68800/0xca7fc0c411f939e7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797045.197190:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69400/0xca7fc0c411f939ee lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797045.197197:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69400/0xca7fc0c411f939ee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797045.197203:0:5826:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69400/0xca7fc0c411f939ee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797045.197324:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69800/0xca7fc0c411f939f5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797045.197353:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69800/0xca7fc0c411f939f5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797045.197361:0:5826:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69800/0xca7fc0c411f939f5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788797045.197372:0:5826:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:3.0:1788797045.197469:0:5826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c68800/0xca7fc0c411f939e7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797045.197478:0:5826:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c68800/0xca7fc0c411f939e7 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797045.197485:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c68800/0xca7fc0c411f939e7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797045.197490:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb077c68800 already unused, calling callback (ffffffffc1f014f0) 00010000:00010000:3.0:1788797045.197494:0:5826:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c68800/0xca7fc0c411f939e7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797045.197501:0:5826:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c68800/0xca7fc0c411f939e7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797045.197513:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8cb06ce84d00) 00010000:00010000:3.0:1788797045.197516:0:5826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788797045.197521:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c68800/0xca7fc0c411f939e7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797045.197527:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c68800/0xca7fc0c411f939e7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797045.197540:0:5826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69400/0xca7fc0c411f939ee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797045.197552:0:5826:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69400/0xca7fc0c411f939ee lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797045.197558:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69400/0xca7fc0c411f939ee lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797045.197563:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb077c69400 already unused, calling callback (ffffffffc1f014f0) 00010000:00010000:3.0:1788797045.197566:0:5826:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69400/0xca7fc0c411f939ee lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797045.197572:0:5826:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69400/0xca7fc0c411f939ee lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797045.197579:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8cb065cc2600) 00010000:00010000:3.0:1788797045.197593:0:5826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788797045.197597:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69400/0xca7fc0c411f939ee lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797045.197603:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69400/0xca7fc0c411f939ee lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797045.197648:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c68200/0xca7fc0c411f939e0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee10a5 expref: 51 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797045.197662:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69800/0xca7fc0c411f939f5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee10a5 expref: 50 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797045.197669:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cb05088a100) 00010000:00010000:3.0:1788797045.197671:0:5826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788797045.197679:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb077c69800, rc 0) 00000100:00100000:3.0:1788797045.197769:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb077979180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6d050bb-169e-4784-be5b-7071799bf3b0+50:10443:x1875689351451136:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 800us (1041us total) trans 4294967347 rc 0/0 00000100:00100000:3.0:1788797045.197778:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 62 00000100:00100000:1.0:1788797045.204291:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1788797045.205950:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351451264 00000100:00100000:3.0:1788797045.205965:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351451264 00000100:00100000:3.0:1788797045.206072:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 63 00000100:00100000:3.0:1788797045.206084:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb07902a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6d050bb-169e-4784-be5b-7071799bf3b0+50:10443:x1875689351451264:12345-192.168.204.38@tcp:54:lfs.0 00010000:00010000:3.0:1788797045.206162:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69e00/0xca7fc0c411f93a03 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797045.206181:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69e00/0xca7fc0c411f93a03 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797045.206194:0:5827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69e00/0xca7fc0c411f93a03 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797045.206227:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69e00/0xca7fc0c411f93a03 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797045.206234:0:5827:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69e00/0xca7fc0c411f93a03 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797045.206241:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69e00/0xca7fc0c411f93a03 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797045.206248:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb077c69e00 already unused, calling callback (ffffffffc1f014f0) 00010000:00010000:3.0:1788797045.206253:0:5827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69e00/0xca7fc0c411f93a03 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797045.206263:0:5827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69e00/0xca7fc0c411f93a03 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788797045.206263:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00010000:00010000:3.0:1788797045.206291:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cb05088a100) 00010000:00010000:3.0:1788797045.206294:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00000100:00100000:1.0:1788797045.206294:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351451392 00000100:00100000:1.0:1788797045.206300:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351451392 00010000:00010000:3.0:1788797045.206303:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69e00/0xca7fc0c411f93a03 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797045.206311:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69e00/0xca7fc0c411f93a03 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788797045.206332:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 4 00000100:00100000:1.0:1788797045.206341:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb079028380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e6d050bb-169e-4784-be5b-7071799bf3b0+51:2355:x1875689351451392:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788797045.206351:0:5812:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788797045.206367:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69800/0xca7fc0c411f939f5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee10a5 expref: 51 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797045.206380:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cb05088a100) 00010000:00010000:1.0:1788797045.206383:0:5812:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788797045.206393:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb07902a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6d050bb-169e-4784-be5b-7071799bf3b0+50:10443:x1875689351451264:12345-192.168.204.38@tcp:54:lfs.0 Request processed in 311us (2110us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797045.206403:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 63 00000100:00100000:1.0:1788797045.206408:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb079028380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e6d050bb-169e-4784-be5b-7071799bf3b0+50:2355:x1875689351451392:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 66us (146us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797045.206416:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 4 00000100:00100000:1.0:1788797045.208382:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1788797045.208878:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351451648 00000100:00100000:2.0:1788797045.208888:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351451648 00000100:00100000:2.0:1788797045.208959:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 17 00000100:00100000:2.0:1788797045.208971:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb07902ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e6d050bb-169e-4784-be5b-7071799bf3b0+49:10443:x1875689351451648:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:2.0:1788797045.209471:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb07902ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e6d050bb-169e-4784-be5b-7071799bf3b0+50:10443:x1875689351451648:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 500us (1095us total) trans 4294967348 rc 0/0 00000100:00100000:2.0:1788797045.209479:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 17 00000100:00100000:1.0:1788797045.379678:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1788797045.379975:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351451904 00000100:00100000:3.0:1788797045.380003:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351451904 00000100:00100000:3.0:1788797045.380130:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 64 00000100:00100000:3.0:1788797045.380146:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb07902b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6d050bb-169e-4784-be5b-7071799bf3b0+50:10461:x1875689351451904:12345-192.168.204.38@tcp:101:cat.0 00010000:00010000:3.0:1788797045.380210:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788797045.380259:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69e00/0xca7fc0c411f93a0a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c99e04559ee10ac expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797045.380385:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c68200/0xca7fc0c411f93a11 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797045.380405:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c68200/0xca7fc0c411f93a11 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797045.380421:0:5826:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c68200/0xca7fc0c411f93a11 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788797045.380438:0:5826:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:3.0:1788797045.380639:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69e00/0xca7fc0c411f93a0a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee10ac expref: 53 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797045.380668:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c68200/0xca7fc0c411f93a11 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee10ac expref: 52 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797045.380679:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cb05088a100) 00010000:00010000:3.0:1788797045.380683:0:5826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1788797045.380688:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb077c68200, rc 0) 00000100:00100000:3.0:1788797045.380803:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb07902b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6d050bb-169e-4784-be5b-7071799bf3b0+52:10461:x1875689351451904:12345-192.168.204.38@tcp:101:cat.0 Request processed in 659us (1161us total) trans 4294967349 rc 0/0 00000100:00100000:3.0:1788797045.380812:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 64 00000100:00100000:1.0:1788797045.406116:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1788797045.406289:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351452032 00000100:00100000:3.0:1788797045.406300:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351452032 00000100:00100000:3.0:1788797045.406515:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 65 00000100:00100000:3.0:1788797045.406528:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb079029500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6d050bb-169e-4784-be5b-7071799bf3b0+52:10462:x1875689351452032:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1788797045.406556:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788797045.406582:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69e00/0xca7fc0c411f93a1f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c99e04559ee10b3 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797045.406873:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69400/0xca7fc0c411f93a26 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797045.406893:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69400/0xca7fc0c411f93a26 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797045.406908:0:5827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69400/0xca7fc0c411f93a26 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788797045.406988:0:5827:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:3.0:1788797045.406994:0:5827:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788797045.407016:0:5827:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69400/0xca7fc0c411f93a26 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797045.407100:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69e00/0xca7fc0c411f93a1f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee10b3 expref: 54 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797045.407128:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69400/0xca7fc0c411f93a26 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee10b3 expref: 53 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797045.407139:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8cb06ce84d00) 00010000:00010000:3.0:1788797045.407142:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788797045.407147:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb077c69400, rc 0) 00000100:00100000:3.0:1788797045.407775:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb079029500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6d050bb-169e-4784-be5b-7071799bf3b0+53:10462:x1875689351452032:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 1245us (1665us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797045.407786:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 65 00000100:00100000:2.0:1788797045.420829:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1788797045.421076:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351452416 00000100:00100000:3.0:1788797045.421090:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351452416 00000100:00100000:3.0:1788797045.421157:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 18 00000100:00100000:3.0:1788797045.421167:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb080685500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e6d050bb-169e-4784-be5b-7071799bf3b0+53:10462:x1875689351452416:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:3.0:1788797045.421869:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb080685500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e6d050bb-169e-4784-be5b-7071799bf3b0+54:10462:x1875689351452416:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 699us (1047us total) trans 4294967350 rc 0/0 00000100:00100000:3.0:1788797045.421879:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 18 00000100:00100000:1.0:1788797045.430507:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1788797045.431384:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351452544 00000100:00100000:0.0:1788797045.431396:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351452544 00000100:00100000:0.0:1788797045.431474:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 5 00000100:00100000:0.0:1788797045.431485:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb07902b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e6d050bb-169e-4784-be5b-7071799bf3b0+54:10462:x1875689351452544:12345-192.168.204.38@tcp:103:lfs.0 00010000:00010000:0.0:1788797045.431502:0:6698:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1788797045.431527:0:6698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2c00/0xca7fc0c411f939b6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1097 expref: 54 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797045.431550:0:6698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c68200/0xca7fc0c411f93a11 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee10ac expref: 53 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797045.431584:0:6698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484c00/0xca7fc0c411f938c1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1058 expref: 52 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797045.431594:0:6698:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cb05088a100) 00010000:00010000:0.0:1788797045.431604:0:6698:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788797045.431672:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb07902b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e6d050bb-169e-4784-be5b-7071799bf3b0+51:10462:x1875689351452544:12345-192.168.204.38@tcp:103:lfs.0 Request processed in 189us (1176us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797045.431679:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 5 00000100:00100000:1.0:1788797045.435442:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1788797045.435540:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351452672 00000100:00100000:3.0:1788797045.435551:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351452672 00000100:00100000:3.0:1788797045.435632:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 66 00000100:00100000:3.0:1788797045.435641:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb079028000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6d050bb-169e-4784-be5b-7071799bf3b0+51:10462:x1875689351452672:12345-192.168.204.38@tcp:58:lfs.0 00010000:00010000:3.0:1788797045.435749:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69e00/0xca7fc0c411f93a2d lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797045.435765:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69e00/0xca7fc0c411f93a2d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797045.435776:0:5826:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69e00/0xca7fc0c411f93a2d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788797045.436505:0:5826:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788797045.436697:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:3.0:1788797045.436758:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:3.0:1788797045.439089:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb079028000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6d050bb-169e-4784-be5b-7071799bf3b0+51:10462:x1875689351452672:12345-192.168.204.38@tcp:58:lfs.0 Request processed in 3435us (3643us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797045.439112:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 66 00000100:00100000:1.0:1788797045.501163:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1788797045.501438:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351452800 00000100:00100000:2.0:1788797045.501449:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351452800 00000100:00100000:2.0:1788797045.501579:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 67 00000100:00100000:2.0:1788797045.501599:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb079029c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6d050bb-169e-4784-be5b-7071799bf3b0+51:10464:x1875689351452800:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1788797045.501629:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788797045.501653:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484000/0xca7fc0c411f93a34 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c99e04559ee10ba expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797045.501733:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484400/0xca7fc0c411f93a3b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797045.501751:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484400/0xca7fc0c411f93a3b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797045.501778:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484400/0xca7fc0c411f93a3b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797045.501795:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041485200/0xca7fc0c411f93a42 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797045.501803:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041485200/0xca7fc0c411f93a42 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797045.501809:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041485200/0xca7fc0c411f93a42 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797045.501905:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484c00/0xca7fc0c411f93a49 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797045.501914:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484c00/0xca7fc0c411f93a49 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797045.501921:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484c00/0xca7fc0c411f93a49 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788797045.501978:0:5825:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:2.0:1788797045.501983:0:5825:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788797045.502005:0:5825:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484c00/0xca7fc0c411f93a49 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797045.502018:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484c00/0xca7fc0c411f93a49 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797045.502066:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484400/0xca7fc0c411f93a3b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797045.502089:0:5825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484400/0xca7fc0c411f93a3b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797045.502097:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484400/0xca7fc0c411f93a3b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797045.502104:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb041484400 already unused, calling callback (ffffffffc1f014f0) 00010000:00010000:2.0:1788797045.502109:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484400/0xca7fc0c411f93a3b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797045.502117:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484400/0xca7fc0c411f93a3b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797045.502130:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8cb06ce84d00) 00010000:00010000:2.0:1788797045.502137:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788797045.502142:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484400/0xca7fc0c411f93a3b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797045.502148:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484400/0xca7fc0c411f93a3b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797045.502162:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041485200/0xca7fc0c411f93a42 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797045.502168:0:5825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041485200/0xca7fc0c411f93a42 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797045.502174:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041485200/0xca7fc0c411f93a42 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797045.502179:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb041485200 already unused, calling callback (ffffffffc1f014f0) 00010000:00010000:2.0:1788797045.502188:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041485200/0xca7fc0c411f93a42 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797045.502194:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041485200/0xca7fc0c411f93a42 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797045.502202:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8cb05088a800) 00010000:00010000:2.0:1788797045.502205:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788797045.502208:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041485200/0xca7fc0c411f93a42 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797045.502213:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041485200/0xca7fc0c411f93a42 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797045.502246:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484000/0xca7fc0c411f93a34 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee10ba expref: 53 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797045.502327:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484c00/0xca7fc0c411f93a49 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee10ba expref: 52 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797045.502406:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cb065cc2600) 00010000:00010000:2.0:1788797045.502410:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788797045.502413:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb041484c00, rc 0) 00000100:00100000:2.0:1788797045.502492:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb079029c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6d050bb-169e-4784-be5b-7071799bf3b0+52:10464:x1875689351452800:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 896us (1339us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797045.502499:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 67 00010000:00010000:0.0:1788797045.556246:0:5815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788797045.683707:0:11679:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788797045.683715:0:11679:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788797045.683768:0:11679:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1788797045.683775:0:11679:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788797045.683906:0:11679:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb079029880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11679:1875689374546944:192.168.204.38@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788797045.684057:0:11679:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb0465d4300 going to sleep for 11 seconds 00000100:00100000:1.0:1788797045.691117:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1788797045.691244:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351452928 00000100:00100000:0.0:1788797045.691255:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351452928 00000100:00100000:0.0:1788797045.691316:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1 00000100:00100000:0.0:1788797045.691327:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb04945e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:e6d050bb-169e-4784-be5b-7071799bf3b0+53:10475:x1875689351452928:12345-192.168.204.38@tcp:900:lhsmtool_posix.0 00000100:00100000:0.0:1788797045.691428:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb04945e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:e6d050bb-169e-4784-be5b-7071799bf3b0+53:10475:x1875689351452928:12345-192.168.204.38@tcp:900:lhsmtool_posix.0 Request processed in 103us (321us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797045.691436:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1 00000100:00100000:1.0:1788797045.697710:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1788797045.698268:0:11679:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb079029880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11679:1875689374546944:192.168.204.38@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788797045.698496:0:7636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351453056 00000100:00100000:0.0:1788797045.698506:0:7636:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351453056 00000100:00100000:0.0:1788797045.698570:0:7636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 68 00000100:00100000:0.0:1788797045.698581:0:7636:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb06ef1df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6d050bb-169e-4784-be5b-7071799bf3b0+52:10475:x1875689351453056:12345-192.168.204.38@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788797045.698621:0:7636:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788797045.698746:0:7636:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb06ef1df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6d050bb-169e-4784-be5b-7071799bf3b0+52:10475:x1875689351453056:12345-192.168.204.38@tcp:53:lhsmtool_posix.0 Request processed in 166us (1048us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797045.698754:0:7636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 68 00000100:00100000:0.0:1788797045.708220:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1788797045.708550:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351453184 00000100:00100000:3.0:1788797045.708561:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351453184 00000100:00100000:3.0:1788797045.708625:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 69 00000100:00100000:3.0:1788797045.708638:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb047c1b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6d050bb-169e-4784-be5b-7071799bf3b0+52:10475:x1875689351453184:12345-192.168.204.38@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1788797045.708712:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c68800/0xca7fc0c411f93a50 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797045.708730:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c68800/0xca7fc0c411f93a50 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797045.708741:0:5827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c68800/0xca7fc0c411f93a50 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797045.708820:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69000/0xca7fc0c411f93a57 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797045.708828:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69000/0xca7fc0c411f93a57 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797045.708835:0:5827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69000/0xca7fc0c411f93a57 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797045.708862:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69c00/0xca7fc0c411f93a5e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797045.708871:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69c00/0xca7fc0c411f93a5e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797045.708877:0:5827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69c00/0xca7fc0c411f93a5e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788797045.708915:0:5827:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:3.0:1788797045.708920:0:5827:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788797045.708942:0:5827:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69c00/0xca7fc0c411f93a5e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797045.708953:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c68800/0xca7fc0c411f93a50 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797045.708960:0:5827:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c68800/0xca7fc0c411f93a50 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797045.708967:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c68800/0xca7fc0c411f93a50 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797045.708983:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb077c68800 already unused, calling callback (ffffffffc1f014f0) 00010000:00010000:3.0:1788797045.708989:0:5827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c68800/0xca7fc0c411f93a50 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797045.708997:0:5827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c68800/0xca7fc0c411f93a50 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797045.709010:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8cb05088a400) 00010000:00010000:3.0:1788797045.709013:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788797045.709019:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c68800/0xca7fc0c411f93a50 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797045.709062:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c68800/0xca7fc0c411f93a50 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797045.709076:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69000/0xca7fc0c411f93a57 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797045.709081:0:5827:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69000/0xca7fc0c411f93a57 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797045.709087:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69000/0xca7fc0c411f93a57 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797045.709091:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb077c69000 already unused, calling callback (ffffffffc1f014f0) 00010000:00010000:3.0:1788797045.709093:0:5827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69000/0xca7fc0c411f93a57 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797045.709098:0:5827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69000/0xca7fc0c411f93a57 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797045.709116:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x3c15db59 (ffff8cb065cc2700) 00010000:00010000:3.0:1788797045.709118:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788797045.709121:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69000/0xca7fc0c411f93a57 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797045.709126:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69000/0xca7fc0c411f93a57 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797045.709141:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69c00/0xca7fc0c411f93a5e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797045.709148:0:5827:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69c00/0xca7fc0c411f93a5e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797045.709153:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69c00/0xca7fc0c411f93a5e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797045.709170:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb077c69c00 already unused, calling callback (ffffffffc1f014f0) 00010000:00010000:3.0:1788797045.709173:0:5827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69c00/0xca7fc0c411f93a5e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797045.709180:0:5827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69c00/0xca7fc0c411f93a5e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797045.709188:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cb065cc2600) 00010000:00010000:3.0:1788797045.709191:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788797045.709194:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69c00/0xca7fc0c411f93a5e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797045.709200:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69c00/0xca7fc0c411f93a5e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788797045.709837:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb047c1b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6d050bb-169e-4784-be5b-7071799bf3b0+52:10475:x1875689351453184:12345-192.168.204.38@tcp:34:lhsmtool_posix.0 Request processed in 663us (1087us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797045.709847:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 69 00000100:00100000:3.0:1788797045.732622:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1788797045.732698:0:7636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351453440 00000100:00100000:1.0:1788797045.732708:0:7636:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351453440 00000100:00100000:1.0:1788797045.732767:0:7636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 70 00000100:00100000:1.0:1788797045.732778:0:7636:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0794f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6d050bb-169e-4784-be5b-7071799bf3b0+52:10475:x1875689351453440:12345-192.168.204.38@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788797045.732802:0:7636:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788797045.732825:0:7636:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082044600/0xca7fc0c411f93a65 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c99e04559ee10c1 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797045.732951:0:7636:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045600/0xca7fc0c411f93a6c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797045.732969:0:7636:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045600/0xca7fc0c411f93a6c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797045.732982:0:7636:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045600/0xca7fc0c411f93a6c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788797045.732993:0:7636:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:1.0:1788797045.733129:0:7636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045600/0xca7fc0c411f93a6c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797045.733136:0:7636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045600/0xca7fc0c411f93a6c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797045.733143:0:7636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045600/0xca7fc0c411f93a6c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797045.733148:0:7636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb082045600 already unused, calling callback (ffffffffc1f014f0) 00010000:00010000:1.0:1788797045.733153:0:7636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045600/0xca7fc0c411f93a6c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797045.733187:0:7636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045600/0xca7fc0c411f93a6c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797045.733200:0:7636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cb065cc2600) 00010000:00010000:1.0:1788797045.733203:0:7636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788797045.733209:0:7636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045600/0xca7fc0c411f93a6c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797045.733215:0:7636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045600/0xca7fc0c411f93a6c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797045.733568:0:7636:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082044600/0xca7fc0c411f93a65 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee10c1 expref: 54 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797045.733581:0:7636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8cb05088a400) 00010000:00010000:1.0:1788797045.733584:0:7636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788797045.733588:0:7636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082044600/0xca7fc0c411f93a65 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee10c1 expref: 54 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797045.733601:0:7636:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb082044600, rc 0) 00000100:00100000:1.0:1788797045.733666:0:7636:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0794f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6d050bb-169e-4784-be5b-7071799bf3b0+53:10475:x1875689351453440:12345-192.168.204.38@tcp:101:lhsmtool_posix.0 Request processed in 888us (1053us total) trans 4294967351 rc 301/301 00000100:00100000:1.0:1788797045.733675:0:7636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 70 00000100:00100000:3.0:1788797045.743192:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1788797045.743281:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351453568 00000100:00100000:2.0:1788797045.743291:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351453568 00000100:00100000:2.0:1788797045.743358:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 71 00000100:00100000:2.0:1788797045.743369:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0794f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6d050bb-169e-4784-be5b-7071799bf3b0+53:10475:x1875689351453568:12345-192.168.204.38@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788797045.743424:0:5825:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788797045.743531:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0794f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6d050bb-169e-4784-be5b-7071799bf3b0+53:10475:x1875689351453568:12345-192.168.204.38@tcp:53:lhsmtool_posix.0 Request processed in 164us (344us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797045.743538:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 71 00000100:00100000:2.0:1788797045.751839:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1788797045.752122:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351453824 00000100:00100000:0.0:1788797045.752133:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351453824 00000100:00100000:0.0:1788797045.752396:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 72 00000100:00100000:0.0:1788797045.752407:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb080687480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6d050bb-169e-4784-be5b-7071799bf3b0+53:10475:x1875689351453824:12345-192.168.204.38@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788797045.752430:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788797045.752434:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1788797045.752459:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69400/0xca7fc0c411f93a26 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee10b3 expref: 53 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797045.752475:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8cb06ce84d00) 00010000:00010000:0.0:1788797045.752480:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788797045.752494:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3000/0xca7fc0c411f93a7a lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c99e04559ee10c8 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788797045.752896:0:5826:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3:0x0], index 0: 0 00010000:00010000:0.0:1788797045.753208:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3200/0xca7fc0c411f93a81 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797045.753222:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3200/0xca7fc0c411f93a81 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797045.753232:0:5826:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3200/0xca7fc0c411f93a81 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797045.753369:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3000/0xca7fc0c411f93a7a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee10c8 expref: 55 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797045.753387:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3200/0xca7fc0c411f93a81 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee10c8 expref: 54 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797045.753408:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8cb058766400) 00010000:00010000:0.0:1788797045.753411:0:5826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788797045.753414:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb042ea3200, rc 0) 00000100:00100000:0.0:1788797045.753483:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb080687480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6d050bb-169e-4784-be5b-7071799bf3b0+54:10475:x1875689351453824:12345-192.168.204.38@tcp:101:lhsmtool_posix.0 Request processed in 1076us (1651us total) trans 4294967352 rc 0/0 00000100:00100000:0.0:1788797045.753491:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 72 00000100:00100000:0.0:1788797045.769151:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1788797045.769522:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351454080 00000100:00100000:2.0:1788797045.769533:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351454080 00000100:00100000:2.0:1788797045.769607:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 73 00000100:00100000:2.0:1788797045.769618:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb047c1aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6d050bb-169e-4784-be5b-7071799bf3b0+54:10475:x1875689351454080:12345-192.168.204.38@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788797045.769681:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788797045.769715:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3200/0xca7fc0c411f93a81 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee10c8 expref: 54 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797045.769737:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8cb058766400) 00010000:00010000:2.0:1788797045.769749:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788797045.769773:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041485200/0xca7fc0c411f93a8f lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797045.769786:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041485200/0xca7fc0c411f93a8f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797045.769794:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041485200/0xca7fc0c411f93a8f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797045.769860:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484400/0xca7fc0c411f93a96 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0xdb46d6a7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797045.769869:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484400/0xca7fc0c411f93a96 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xdb46d6a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797045.769891:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484400/0xca7fc0c411f93a96 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xdb46d6a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797045.769965:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041485200/0xca7fc0c411f93a8f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797045.769973:0:5825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041485200/0xca7fc0c411f93a8f lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797045.769980:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041485200/0xca7fc0c411f93a8f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797045.769986:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb041485200 already unused, calling callback (ffffffffc1f014f0) 00010000:00010000:2.0:1788797045.769990:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041485200/0xca7fc0c411f93a8f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797045.769997:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041485200/0xca7fc0c411f93a8f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797045.770007:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8cb06ce84d00) 00010000:00010000:2.0:1788797045.770009:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788797045.770013:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041485200/0xca7fc0c411f93a8f lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797045.770018:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041485200/0xca7fc0c411f93a8f lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797045.770062:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484400/0xca7fc0c411f93a96 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xdb46d6a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797045.770071:0:5825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484400/0xca7fc0c411f93a96 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xdb46d6a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797045.770084:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484400/0xca7fc0c411f93a96 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xdb46d6a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797045.770088:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb041484400 already unused, calling callback (ffffffffc1f014f0) 00010000:00010000:2.0:1788797045.770091:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484400/0xca7fc0c411f93a96 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xdb46d6a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797045.770097:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484400/0xca7fc0c411f93a96 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xdb46d6a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797045.770105:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0xdb46d6a7 (ffff8cb05088a800) 00010000:00010000:2.0:1788797045.770107:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788797045.770110:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484400/0xca7fc0c411f93a96 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xdb46d6a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797045.770114:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484400/0xca7fc0c411f93a96 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xdb46d6a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788797045.770208:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb047c1aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6d050bb-169e-4784-be5b-7071799bf3b0+53:10475:x1875689351454080:12345-192.168.204.38@tcp:36:lhsmtool_posix.0 Request processed in 591us (1067us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788797045.770216:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 73 00000100:00100000:1.0:1788797045.772722:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1788797045.772887:0:7636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351454208 00000100:00100000:0.0:1788797045.772898:0:7636:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351454208 00000100:00100000:0.0:1788797045.772970:0:7636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 74 00000100:00100000:0.0:1788797045.772980:0:7636:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb06ef1d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6d050bb-169e-4784-be5b-7071799bf3b0+53:10475:x1875689351454208:12345-192.168.204.38@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788797045.773001:0:7636:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788797045.773022:0:7636:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3000/0xca7fc0c411f93a9d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c99e04559ee10cf expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797045.773085:0:7636:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3c00/0xca7fc0c411f93aa4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797045.773097:0:7636:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3c00/0xca7fc0c411f93aa4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797045.773109:0:7636:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3c00/0xca7fc0c411f93aa4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797045.773465:0:7636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3000/0xca7fc0c411f93a9d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee10cf expref: 55 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797045.773498:0:7636:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3c00/0xca7fc0c411f93aa4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee10cf expref: 54 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797045.773506:0:7636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8cb058766000) 00010000:00010000:0.0:1788797045.773509:0:7636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788797045.773512:0:7636:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb042ea3c00, rc 0) 00000100:00100000:0.0:1788797045.773604:0:7636:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb06ef1d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6d050bb-169e-4784-be5b-7071799bf3b0+54:10475:x1875689351454208:12345-192.168.204.38@tcp:101:lhsmtool_posix.0 Request processed in 626us (892us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797045.773612:0:7636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 74 00000100:00100000:2.0:1788797045.781279:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1788797045.782127:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351454464 00000100:00100000:1.0:1788797045.782140:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351454464 00000100:00100000:1.0:1788797045.782226:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 75 00000100:00100000:1.0:1788797045.782245:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb080684700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6d050bb-169e-4784-be5b-7071799bf3b0+54:10475:x1875689351454464:12345-192.168.204.38@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788797045.782364:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082044600/0xca7fc0c411f93aab lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797045.782385:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082044600/0xca7fc0c411f93aab lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797045.782398:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082044600/0xca7fc0c411f93aab lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788797045.782706:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 88 off8408 00000004:00080000:1.0:1788797045.782717:0:5825:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 334788687795ns, next at 335788685105ns, rc = 0 00000004:00010000:1.0:1788797045.782811:0:5825:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001fc5caae reply state 000000006ccddc89 transno 4294967353 ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082044600/0xca7fc0c411f93aab lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788797045.782820:0:5825:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788797045.782940:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb080684700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6d050bb-169e-4784-be5b-7071799bf3b0+56:10475:x1875689351454464:12345-192.168.204.38@tcp:36:lhsmtool_posix.0 Request processed in 692us (1665us total) trans 4294967353 rc 0/0 00000100:00100000:1.0:1788797045.782947:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 75 00010000:00010000:1.0:1788797045.788764:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082044600/0xca7fc0c411f93aab lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797045.788783:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082044600/0xca7fc0c411f93aab lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797045.788791:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082044600/0xca7fc0c411f93aab lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797045.788798:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb082044600 already unused, calling callback (ffffffffc1f014f0) 00010000:00010000:1.0:1788797045.788803:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082044600/0xca7fc0c411f93aab lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797045.788830:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082044600/0xca7fc0c411f93aab lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797045.788848:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8cb058766000) 00010000:00010000:1.0:1788797045.788851:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788797045.788856:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082044600/0xca7fc0c411f93aab lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797045.788862:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082044600/0xca7fc0c411f93aab lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788797045.789415:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1788797045.789826:0:7636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351454592 00000100:00100000:1.0:1788797045.789837:0:7636:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351454592 00000100:00100000:1.0:1788797045.789902:0:7636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 76 00000100:00100000:1.0:1788797045.789912:0:7636:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb080684380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6d050bb-169e-4784-be5b-7071799bf3b0+55:10475:x1875689351454592:12345-192.168.204.38@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788797045.789953:0:7636:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788797045.789973:0:7636:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045600/0xca7fc0c411f93ab2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c99e04559ee10d6 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797045.790055:0:7636:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045600/0xca7fc0c411f93ab2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee10d6 expref: 56 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797045.790069:0:7636:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045600/0xca7fc0c411f93ab2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee10d6 expref: 56 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797045.790090:0:7636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8cb058766000) 00010000:00010000:1.0:1788797045.790093:0:7636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788797045.790097:0:7636:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb082045600, rc 0) 00000100:00100000:1.0:1788797045.790166:0:7636:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb080684380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6d050bb-169e-4784-be5b-7071799bf3b0+56:10475:x1875689351454592:12345-192.168.204.38@tcp:101:lhsmtool_posix.0 Request processed in 255us (755us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797045.790174:0:7636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 76 00000100:00100000:2.0:1788797045.794180:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1788797045.794474:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351454720 00000100:00100000:1.0:1788797045.794485:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351454720 00000100:00100000:1.0:1788797045.794540:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 25 00000100:00100000:1.0:1788797045.794548:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb06f608700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2351:x1875689351454720:12345-192.168.204.38@tcp:8:lhsmtool_posix.0 00010000:00080000:1.0:1788797045.794580:0:6684:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from e6d050bb-169e-4784-be5b-7071799bf3b0@192.168.204.38@tcp t0 exp 0000000000000000 cur 334 last 0 00000020:00000080:1.0:1788797045.794612:0:6684:0:(genops.c:1384:class_connect()) connect: client e6d050bb-169e-4784-be5b-7071799bf3b0, cookie 0xca7fc0c411f93ab9 00002000:00100000:1.0:1788797045.794624:0:6684:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli e6d050bb-169e-4784-be5b-7071799bf3b0/ffff8cb0502a1000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788797045.794648:0:6684:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788797045.794891:0:6684:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788797045.794934:0:6684:0:(import.c:65:import_set_state_nolock()) ffff8cb0502fe800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788797045.795011:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb06f608700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e6d050bb-169e-4784-be5b-7071799bf3b0+6:2351:x1875689351454720:12345-192.168.204.38@tcp:8:lhsmtool_posix.0 Request processed in 462us (840us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797045.795019:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 25 00000100:00100000:1.0:1788797045.797872:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1788797045.797958:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351454848 00000100:00100000:0.0:1788797045.797968:0:6683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351454848 00000100:00100000:0.0:1788797045.798072:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 26 00000100:00100000:0.0:1788797045.798083:0:6683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb050380a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e6d050bb-169e-4784-be5b-7071799bf3b0+6:0:x1875689351454848:12345-192.168.204.38@tcp:2:lhsmtool_posix.0 00000100:00080000:1.0:1788797045.798831:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:1.0:1788797045.850117:0:6713:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967301 is committed 00000001:00100000:1.0:1788797045.850135:0:6713:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of e6d050bb-169e-4784-be5b-7071799bf3b0 00000100:00100000:1.0:1788797045.850271:0:6683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb050380a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e6d050bb-169e-4784-be5b-7071799bf3b0+5:0:x1875689351454848:12345-192.168.204.38@tcp:2:lhsmtool_posix.0 Request processed in 52185us (52404us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1788797045.850283:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 26 00000100:00100000:2.0:1788797045.853946:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1788797045.854058:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351455104 00000100:00100000:3.0:1788797045.854070:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351455104 00000100:00100000:3.0:1788797045.854122:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19 00000100:00100000:3.0:1788797045.854131:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb06f60a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e6d050bb-169e-4784-be5b-7071799bf3b0+56:10475:x1875689351455104:12345-192.168.204.38@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788797045.854529:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb06f60a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e6d050bb-169e-4784-be5b-7071799bf3b0+57:10475:x1875689351455104:12345-192.168.204.38@tcp:35:lhsmtool_posix.0 Request processed in 397us (602us total) trans 4294967354 rc 0/0 00000100:00100000:3.0:1788797045.854537:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19 00000100:00100000:2.0:1788797045.858202:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1788797045.858371:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351455360 00000100:00100000:1.0:1788797045.858382:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351455360 00000100:00100000:1.0:1788797045.858458:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 77 00000100:00100000:1.0:1788797045.858486:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb077f09f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6d050bb-169e-4784-be5b-7071799bf3b0+57:10475:x1875689351455360:12345-192.168.204.38@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788797045.858621:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb077f09f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6d050bb-169e-4784-be5b-7071799bf3b0+57:10475:x1875689351455360:12345-192.168.204.38@tcp:57:lhsmtool_posix.0 Request processed in 138us (426us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797045.858628:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 77 00000100:00100000:2.0:1788797045.861170:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1788797045.861376:0:7636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351455488 00000100:00100000:1.0:1788797045.861386:0:7636:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351455488 00000100:00100000:1.0:1788797045.861488:0:7636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 78 00000100:00100000:1.0:1788797045.861500:0:7636:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb079b93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6d050bb-169e-4784-be5b-7071799bf3b0+57:10475:x1875689351455488:12345-192.168.204.38@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788797045.861524:0:7636:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788797045.861548:0:7636:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082044600/0xca7fc0c411f93ac0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c99e04559ee10dd expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797045.861628:0:7636:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045e00/0xca7fc0c411f93ac7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797045.861644:0:7636:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045e00/0xca7fc0c411f93ac7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797045.861656:0:7636:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045e00/0xca7fc0c411f93ac7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788797045.861697:0:7636:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788797045.861715:0:7636:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045e00/0xca7fc0c411f93ac7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797045.861742:0:7636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082044600/0xca7fc0c411f93ac0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee10dd expref: 59 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797045.861760:0:7636:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045e00/0xca7fc0c411f93ac7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee10dd expref: 58 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797045.861783:0:7636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8cb058766000) 00010000:00010000:1.0:1788797045.861787:0:7636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1788797045.861791:0:7636:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb082045e00, rc 0) 00000100:00100000:1.0:1788797045.861872:0:7636:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb079b93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6d050bb-169e-4784-be5b-7071799bf3b0+58:10475:x1875689351455488:12345-192.168.204.38@tcp:101:lhsmtool_posix.0 Request processed in 374us (710us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797045.861880:0:7636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 78 00000100:00100000:3.0:1788797045.869132:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1788797045.869437:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351455616 00000100:00100000:1.0:1788797045.869449:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351455616 00000100:00100000:1.0:1788797045.869520:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 27 00000100:00100000:1.0:1788797045.869534:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0794f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e6d050bb-169e-4784-be5b-7071799bf3b0+5:2354:x1875689351455616:12345-192.168.204.38@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788797045.869554:0:6684:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788797045.869581:0:6684:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001496f488/0xca7fc0c411f93ace lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7c99e04559ee10e4 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788797045.869610:0:6684:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9ee076, blocks: 0x1 00010000:00010000:1.0:1788797045.869630:0:6684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=334s v=(0 0) 00010000:00010000:1.0:1788797045.869635:0:6684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788797045.869646:0:6684:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001496f488/0xca7fc0c411f93ace lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee10e4 expref: 6 pid: 6684 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797045.869667:0:6684:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001496f488/0xca7fc0c411f93ace lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee10e4 expref: 6 pid: 6684 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797045.869681:0:6684:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb082045c00, rc 0) 00000100:00100000:1.0:1788797045.869776:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0794f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e6d050bb-169e-4784-be5b-7071799bf3b0+6:2354:x1875689351455616:12345-192.168.204.38@tcp:101:lhsmtool_posix.0 Request processed in 246us (656us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797045.869786:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 27 00000100:00100000:3.0:1788797045.876268:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1788797045.876347:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351455872 00000100:00100000:2.0:1788797045.876372:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351455872 00000100:00100000:2.0:1788797045.876423:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 79 00000100:00100000:2.0:1788797045.876434:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0794f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6d050bb-169e-4784-be5b-7071799bf3b0+58:10475:x1875689351455872:12345-192.168.204.38@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788797045.876556:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0794f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6d050bb-169e-4784-be5b-7071799bf3b0+58:10475:x1875689351455872:12345-192.168.204.38@tcp:57:lhsmtool_posix.0 Request processed in 123us (299us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797045.876564:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 79 00000100:00100000:3.0:1788797045.879618:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1788797045.879703:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351456000 00000100:00100000:2.0:1788797045.879715:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351456000 00000100:00100000:2.0:1788797045.879776:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 28 00000100:00100000:2.0:1788797045.879787:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0794f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e6d050bb-169e-4784-be5b-7071799bf3b0+6:10475:x1875689351456000:12345-192.168.204.38@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788797045.879816:0:6681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788797045.879835:0:6681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ae867b02/0xca7fc0c411f93ad5 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7c99e04559ee10eb expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797045.879877:0:6681:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001496f488/0xca7fc0c411f93ace lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee10e4 expref: 7 pid: 6684 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797045.879885:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788797045.879889:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788797045.879893:0:6681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ae867b02/0xca7fc0c411f93ad5 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee10eb expref: 7 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797045.879960:0:6681:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000001496f488/0xca7fc0c411f93ace lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee10e4 expref: 7 pid: 6684 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797045.879974:0:6681:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000001496f488/0xca7fc0c411f93ace lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee10e4 expref: 7 pid: 6684 timeout: 434 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788797045.879996:0:6681:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb050384700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6681:1875689374547072:192.168.204.38@tcp:104: 00000100:00100000:2.0:1788797045.880122:0:6681:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb052f5a3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788797045.883240:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1788797045.883382:0:11663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351456128 00000100:00100000:1.0:1788797045.883392:0:11663:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351456128 00010000:00010000:1.0:1788797045.883437:0:11663:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000001496f488/0xca7fc0c411f93ace lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee10e4 expref: 8 pid: 6684 timeout: 434 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788797045.883531:0:11663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 42 00000100:00100000:1.0:1788797045.883542:0:11663:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb042edb050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e6d050bb-169e-4784-be5b-7071799bf3b0+8:2355:x1875689351456128:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788797045.883558:0:11663:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788797045.883594:0:11663:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000001496f488/0xca7fc0c411f93ace lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee10e4 expref: 8 pid: 6684 timeout: 434 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797045.883610:0:11663:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000001496f488/0xca7fc0c411f93ace lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee10e4 expref: 8 pid: 6684 timeout: 434 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797045.883634:0:11663:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788797045.883639:0:11663:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788797045.883648:0:11663:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ae867b02/0xca7fc0c411f93ad5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee10eb expref: 8 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797045.883658:0:11663:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ae867b02/0xca7fc0c411f93ad5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee10eb expref: 8 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797045.883698:0:11663:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000ae867b02/0xca7fc0c411f93ad5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee10eb expref: 8 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788797045.883729:0:11663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb050380700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11663:1875689374547200:192.168.204.38@tcp:105: 00000100:00100000:1.0:1788797045.883824:0:11663:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb04b5ed540 going to sleep for 11 seconds 00010000:00010000:2.0:1788797045.884223:0:6681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001496f488/0xca7fc0c411f93ace lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee10e4 expref: 8 pid: 6684 timeout: 434 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788797045.884240:0:6681:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb050384700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6681:1875689374547072:192.168.204.38@tcp:104: 00010000:00010000:2.0:1788797045.884268:0:6681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ae867b02/0xca7fc0c411f93ad5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee10eb expref: 7 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797045.884279:0:6681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb041485c00, rc 0) 00000100:00100000:2.0:1788797045.884329:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0794f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e6d050bb-169e-4784-be5b-7071799bf3b0+7:10475:x1875689351456000:12345-192.168.204.38@tcp:101:lhsmtool_posix.0 Request processed in 4544us (4721us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797045.884337:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 28 00000100:00100000:1.0:1788797045.887457:0:11663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb050380700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11663:1875689374547200:192.168.204.38@tcp:105: 00010000:00010000:1.0:1788797045.887484:0:11663:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788797045.887543:0:11663:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb042edb050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e6d050bb-169e-4784-be5b-7071799bf3b0+6:2355:x1875689351456128:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 4002us (4313us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797045.887553:0:11663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 42 00000100:00100000:3.0:1788797045.888259:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1788797045.888355:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351456256 00000100:00100000:2.0:1788797045.888364:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351456256 00002000:00100000:2.0:1788797045.888408:0:6689:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff8cb0794f5f80 x1875689351456256/t0(0) o4->e6d050bb-169e-4784-be5b-7071799bf3b0@192.168.204.38@tcp:471/0 lens 504/0 e 0 to 0 dl 1788797056 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788797045.888418:0:6689:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8cb0794f5f80 with x1875689351456256 ext(0->8) 00002000:00010000:2.0:1788797045.888423:0:6689:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8cb0794f5f80 00000100:00100000:2.0:1788797045.888453:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 0 00000100:00100000:2.0:1788797045.888463:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0794f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e6d050bb-169e-4784-be5b-7071799bf3b0+6:2355:x1875689351456256:12345-192.168.204.38@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1788797045.889278:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0794f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e6d050bb-169e-4784-be5b-7071799bf3b0+8:2355:x1875689351456256:12345-192.168.204.38@tcp:4:lhsmtool_posix.0 Request processed in 813us (1019us total) trans 4294967302 rc 0/0 00000100:00100000:2.0:1788797045.889295:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 0 00002000:00100000:2.0:1788797045.889304:0:6689:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff8cb0794f5f80 x1875689351456256/t4294967302(0) o4->e6d050bb-169e-4784-be5b-7071799bf3b0@192.168.204.38@tcp:471/0 lens 504/448 e 0 to 0 dl 1788797056 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788797045.889312:0:6689:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8cb0794f5f80 with x1875689351456256 ext(0->8) 00002000:00010000:2.0:1788797045.889317:0:6689:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8cb0794f5f80 00000100:00100000:3.0:1788797045.900077:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1788797045.900507:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351456384 00000100:00100000:2.0:1788797045.900518:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351456384 00000100:00100000:2.0:1788797045.900702:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 80 00000100:00100000:2.0:1788797045.900714:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb079028380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6d050bb-169e-4784-be5b-7071799bf3b0+58:10475:x1875689351456384:12345-192.168.204.38@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1788797046.006484:0:5848:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967352 is committed 00000001:00080000:1.0:1788797046.006515:0:5848:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967353 is committed 00000004:00080000:1.0:1788797046.006520:0:5848:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000020:00080000:1.0:1788797046.006566:0:5848:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8cb046b36840 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:1.0:1788797046.006571:0:5848:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8cb047c23200 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8cb046b36b40 00000020:00080000:1.0:1788797046.006575:0:5848:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8cb047c23500 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8cb081375400 00000001:00080000:1.0:1788797046.006589:0:5848:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967354 is committed 00000004:00080000:1.0:1788797046.006608:0:5848:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000100:00100000:1.0:1788797046.006750:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb050380700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875689374547328:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788797046.006819:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788797046.007250:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374547328 00000100:00100000:1.0:1788797046.007258:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374547328 00000100:00100000:1.0:1788797046.007310:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788797046.007319:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb050382300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3301:x1875689374547328:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1788797046.007344:0:6684:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:2 count 1 00002000:00010000:1.0:1788797046.007377:0:6684:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 13, mtime: 0x6a9ee073, atime: 0x6a9ee073, ctime: 0x6a9ee073, blocks: 0x1 00010000:00010000:1.0:1788797046.007387:0:6684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000848a423f/0xca7fc0c411f93adc lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797046.007414:0:6684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=335s v=(0 0) 00010000:00010000:1.0:1788797046.007420:0:6684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788797046.007426:0:6684:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000848a423f/0xca7fc0c411f93adc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797046.007442:0:6684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000848a423f/0xca7fc0c411f93adc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797046.007452:0:6684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000848a423f/0xca7fc0c411f93adc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797046.007460:0:6684:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000848a423f/0xca7fc0c411f93adc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797046.007475:0:6684:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788797046.007991:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb079028380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6d050bb-169e-4784-be5b-7071799bf3b0+13:10475:x1875689351456384:12345-192.168.204.38@tcp:44:lhsmtool_posix.0 Request processed in 107274us (107920us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797046.008002:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 80 00000020:00080000:2.0:1788797046.008044:0:5859:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000020:00080000:2.0:1788797046.008168:0:5859:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:3.0:1788797046.008571:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788797046.008583:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb07902b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875689374547456:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1788797046.008621:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788797046.008662:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374547456 00000100:00100000:3.0:1788797046.008667:0:6683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374547456 00000100:00100000:3.0:1788797046.008698:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788797046.008706:0:6683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb079029880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1875689374547456:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1788797046.008838:0:6683:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1788797046.008841:0:6683:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1788797046 00002000:00010000:3.0:1788797046.008844:0:6683:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1788797046.008846:0:6683:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1788797046 -> 1788797046 00002000:00010000:3.0:1788797046.008848:0:6683:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1788797046.008879:0:6683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb079029880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3303:x1875689374547456:12345-0@lo:2:osp-syn-0-0.0 Request processed in 174us (258us total) trans 4294967303 rc 0/0 00000100:00100000:3.0:1788797046.008886:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000004:00080000:3.0:1788797046.008932:0:3303:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8cb07902b480/2, rc 0, transno 4294967303 00000100:00100000:3.0:1788797046.008938:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb07902b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875689374547456:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1788797046.009329:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb050382300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3301:x1875689374547328:12345-0@lo:6:osp-syn-1-0.0 Request processed in 2010us (2508us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1788797046.009336:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:1.0:1788797046.009356:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788797046.009360:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1788797046.009369:0:5814:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788797046.009376:0:5814:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000848a423f/0xca7fc0c411f93adc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797046.009386:0:5814:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb082044600 already unused, calling callback (ffffffffc14d98b0) 00010000:00010000:1.0:1788797046.009391:0:5814:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000848a423f/0xca7fc0c411f93adc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797046.009407:0:5814:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000848a423f/0xca7fc0c411f93adc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797046.009426:0:5814:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000848a423f/0xca7fc0c411f93adc lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797046.009433:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000848a423f/0xca7fc0c411f93adc lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797046.009450:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788797046.009451:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788797046.009453:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1788797046.009811:0:3301:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8cb050380700/2, rc 0, transno 4294967301 00000100:00100000:3.0:1788797046.009818:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb050380700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875689374547328:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788797046.016807:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1788797046.017356:0:10829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351456512 00000100:00100000:2.0:1788797046.017366:0:10829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351456512 00000100:00100000:2.0:1788797046.017533:0:10829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 31 00000100:00100000:2.0:1788797046.017545:0:10829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb047c18000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e6d050bb-169e-4784-be5b-7071799bf3b0+8:2354:x1875689351456512:12345-192.168.204.38@tcp:16:lhsmtool_posix.0 00000001:00080000:1.0:1788797046.131824:0:6713:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000001:00080000:1.0:1788797046.131846:0:6713:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00000100:00100000:2.0:1788797046.132128:0:10829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb047c18000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e6d050bb-169e-4784-be5b-7071799bf3b0+6:2354:x1875689351456512:12345-192.168.204.38@tcp:16:lhsmtool_posix.0 Request processed in 114577us (115324us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797046.132141:0:10829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 31 00000100:00100000:1.0:1788797046.136512:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1788797046.136991:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351456768 00000100:00100000:2.0:1788797046.137002:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351456768 00000100:00100000:2.0:1788797046.137078:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 81 00000100:00100000:2.0:1788797046.137097:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb050380380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6d050bb-169e-4784-be5b-7071799bf3b0+13:10475:x1875689351456768:12345-192.168.204.38@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788797046.137159:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788797046.137187:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045e00/0xca7fc0c411f93ac7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee10dd expref: 13 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797046.137205:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8cb058766000) 00010000:00010000:2.0:1788797046.137209:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788797046.137236:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484800/0xca7fc0c411f93ae3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797046.137260:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484800/0xca7fc0c411f93ae3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797046.137270:0:5827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484800/0xca7fc0c411f93ae3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788797046.137676:0:5827:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000082dc88b1 reply state 0000000098af5504 transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484800/0xca7fc0c411f93ae3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788797046.137686:0:5827:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788797046.139219:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb050380380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6d050bb-169e-4784-be5b-7071799bf3b0+14:10475:x1875689351456768:12345-192.168.204.38@tcp:36:lhsmtool_posix.0 Request processed in 2115us (2708us total) trans 4294967355 rc 0/0 00000100:00100000:3.0:1788797046.139230:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 81 00010000:00010000:0.0:1788797046.147898:0:3286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484800/0xca7fc0c411f93ae3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797046.147916:0:3286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484800/0xca7fc0c411f93ae3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797046.147934:0:3286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484800/0xca7fc0c411f93ae3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797046.147941:0:3286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb041484800 already unused, calling callback (ffffffffc1f014f0) 00010000:00010000:0.0:1788797046.147946:0:3286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484800/0xca7fc0c411f93ae3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797046.147974:0:3286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484800/0xca7fc0c411f93ae3 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797046.147994:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8cb058766000) 00010000:00010000:0.0:1788797046.147997:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788797046.148003:0:3286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484800/0xca7fc0c411f93ae3 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797046.148010:0:3286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484800/0xca7fc0c411f93ae3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788797046.151657:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1788797046.151897:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351456896 00000100:00100000:2.0:1788797046.151908:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351456896 00000100:00100000:2.0:1788797046.151987:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 32 00000100:00100000:2.0:1788797046.151999:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb048e29c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e6d050bb-169e-4784-be5b-7071799bf3b0+6:2353:x1875689351456896:12345-192.168.204.38@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1788797046.153185:0:6681:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:2.0:1788797046.153191:0:6681:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 1788797046 -> 1788797045 00002000:00010000:2.0:1788797046.153194:0:6681:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 1788797043 00002000:00010000:2.0:1788797046.153196:0:6681:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1788797046 -> 1788797045 00002000:00010000:2.0:1788797046.153198:0:6681:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:2.0:1788797046.153319:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb048e29c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e6d050bb-169e-4784-be5b-7071799bf3b0+7:2353:x1875689351456896:12345-192.168.204.38@tcp:2:lhsmtool_posix.0 Request processed in 1319us (1667us total) trans 4294967304 rc 0/0 00000100:00100000:2.0:1788797046.153344:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 32 00000100:00100000:1.0:1788797046.156754:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1788797046.156791:0:7636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351457152 00000100:00100000:1.0:1788797046.156802:0:7636:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351457152 00000100:00100000:1.0:1788797046.156859:0:7636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 82 00000100:00100000:1.0:1788797046.156868:0:7636:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb050382d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6d050bb-169e-4784-be5b-7071799bf3b0+13:10475:x1875689351457152:12345-192.168.204.38@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1788797046.156943:0:7636:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082044600/0xca7fc0c411f93aea lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797046.156960:0:7636:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3c00/0xca7fc0c411f93aa4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee10cf expref: 13 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797046.156986:0:7636:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082044600/0xca7fc0c411f93aea lrc: 4/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797046.157018:0:7636:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3c00/0xca7fc0c411f93aa4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee10cf expref: 13 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797046.157053:0:7636:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3c00/0xca7fc0c411f93aa4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee10cf expref: 13 pid: 7636 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788797046.157067:0:7636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb050381880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7636:1875689374547584:192.168.204.38@tcp:104: 00000100:00100000:1.0:1788797046.157153:0:7636:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb046b36d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788797046.172333:0:7636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb050381880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7636:1875689374547584:192.168.204.38@tcp:104: 00010000:00010000:1.0:1788797046.172364:0:7636:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082044600/0xca7fc0c411f93aea lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788797046.173546:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1788797046.173590:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351457280 00000100:00100000:0.0:1788797046.173599:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351457280 00010000:00010000:0.0:1788797046.173641:0:5811:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3c00/0xca7fc0c411f93aa4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee10cf expref: 14 pid: 7636 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788797046.173679:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 43 00000100:00100000:0.0:1788797046.173690:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb047c19180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e6d050bb-169e-4784-be5b-7071799bf3b0+14:2354:x1875689351457280:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788797046.173705:0:5811:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788797046.173712:0:5811:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3c00/0xca7fc0c411f93aa4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee10cf expref: 14 pid: 7636 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797046.173726:0:5811:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3c00/0xca7fc0c411f93aa4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee10cf expref: 14 pid: 7636 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797046.173751:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3c00/0xca7fc0c411f93aa4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee10cf expref: 14 pid: 7636 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797046.173786:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8cb058766000) 00010000:00010000:0.0:1788797046.173792:0:5811:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082044600/0xca7fc0c411f93aea lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797046.173802:0:5811:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082044600/0xca7fc0c411f93aea lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797046.173810:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082044600/0xca7fc0c411f93aea lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797046.173835:0:5811:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788797046.175266:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb047c19180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e6d050bb-169e-4784-be5b-7071799bf3b0+13:2354:x1875689351457280:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 1570us (1717us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797046.175279:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 43 00010000:00010000:0.0:1788797046.175325:0:7636:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082044600/0xca7fc0c411f93aea lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797046.175334:0:7636:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082044600/0xca7fc0c411f93aea lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797046.175365:0:7636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082044600/0xca7fc0c411f93aea lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797046.175379:0:7636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082044600/0xca7fc0c411f93aea lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797046.175386:0:7636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082044600/0xca7fc0c411f93aea lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797046.175392:0:7636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb082044600 already unused, calling callback (ffffffffc1f014f0) 00010000:00010000:0.0:1788797046.175412:0:7636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082044600/0xca7fc0c411f93aea lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797046.175421:0:7636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082044600/0xca7fc0c411f93aea lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797046.175434:0:7636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8cb058766000) 00010000:00010000:0.0:1788797046.175437:0:7636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1788797046.175442:0:7636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082044600/0xca7fc0c411f93aea lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797046.175449:0:7636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082044600/0xca7fc0c411f93aea lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788797046.175523:0:7636:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb050382d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6d050bb-169e-4784-be5b-7071799bf3b0+12:10475:x1875689351457152:12345-192.168.204.38@tcp:55:lhsmtool_posix.0 Request processed in 18655us (18780us total) trans 0 rc -22/-22 00000100:00100000:0.0:1788797046.175532:0:7636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 82 00000100:00100000:2.0:1788797046.202562:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1788797046.202670:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351457408 00000100:00100000:3.0:1788797046.202682:0:6683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351457408 00000100:00100000:3.0:1788797046.202761:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 33 00000100:00100000:3.0:1788797046.202776:0:6683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb050384700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e6d050bb-169e-4784-be5b-7071799bf3b0+7:2354:x1875689351457408:12345-192.168.204.38@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1788797046.202836:0:6683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000ee3cf875/0xca7fc0c411f93af1 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797046.202871:0:6683:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ae867b02/0xca7fc0c411f93ad5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee10eb expref: 7 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797046.202892:0:6683:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1788797046.202896:0:6683:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788797046.202902:0:6683:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ee3cf875/0xca7fc0c411f93af1 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797046.202958:0:6683:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ae867b02/0xca7fc0c411f93ad5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee10eb expref: 7 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797046.202978:0:6683:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ae867b02/0xca7fc0c411f93ad5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee10eb expref: 7 pid: 6681 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788797046.202998:0:6683:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb048e2b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6683:1875689374547712:192.168.204.38@tcp:104: 00000100:00100000:3.0:1788797046.203127:0:6683:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb0484ea9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788797046.214534:0:6683:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb048e2b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6683:1875689374547712:192.168.204.38@tcp:104: 00010000:00010000:1.0:1788797046.214572:0:6683:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000ee3cf875/0xca7fc0c411f93af1 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788797046.216327:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1788797046.216730:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351457536 00000100:00100000:0.0:1788797046.216741:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351457536 00010000:00010000:0.0:1788797046.216782:0:5813:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ae867b02/0xca7fc0c411f93ad5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee10eb expref: 8 pid: 6681 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788797046.216832:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 44 00000100:00100000:0.0:1788797046.216842:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb050386300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e6d050bb-169e-4784-be5b-7071799bf3b0+8:2354:x1875689351457536:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788797046.216860:0:5813:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788797046.216889:0:5813:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ae867b02/0xca7fc0c411f93ad5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee10eb expref: 8 pid: 6681 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797046.216903:0:5813:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ae867b02/0xca7fc0c411f93ad5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee10eb expref: 8 pid: 6681 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797046.216968:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ae867b02/0xca7fc0c411f93ad5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee10eb expref: 8 pid: 6681 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797046.216991:0:5813:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788797046.216997:0:5813:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788797046.217004:0:5813:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ee3cf875/0xca7fc0c411f93af1 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797046.217015:0:5813:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ee3cf875/0xca7fc0c411f93af1 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797046.217096:0:5813:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788797046.217152:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb050386300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e6d050bb-169e-4784-be5b-7071799bf3b0+7:2354:x1875689351457536:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 311us (833us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797046.217160:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 44 00010000:00010000:2.0:1788797046.217774:0:6683:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000ee3cf875/0xca7fc0c411f93af1 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797046.217786:0:6683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ee3cf875/0xca7fc0c411f93af1 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797046.217817:0:6683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000ee3cf875/0xca7fc0c411f93af1 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797046.217827:0:6683:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ee3cf875/0xca7fc0c411f93af1 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797046.217837:0:6683:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ee3cf875/0xca7fc0c411f93af1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797046.217845:0:6683:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb077c68e00 already unused, calling callback (ffffffffc14d98b0) 00010000:00010000:2.0:1788797046.217850:0:6683:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ee3cf875/0xca7fc0c411f93af1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797046.217859:0:6683:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ee3cf875/0xca7fc0c411f93af1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797046.217881:0:6683:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ee3cf875/0xca7fc0c411f93af1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797046.217901:0:6683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ee3cf875/0xca7fc0c411f93af1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788797046.217983:0:6683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb050384700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e6d050bb-169e-4784-be5b-7071799bf3b0+6:2354:x1875689351457408:12345-192.168.204.38@tcp:1:lhsmtool_posix.0 Request processed in 15210us (15430us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797046.217992:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 33 00000100:00100000:2.0:1788797046.224767:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1788797046.225085:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351457792 00000100:00100000:0.0:1788797046.225098:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351457792 00000100:00100000:0.0:1788797046.225176:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 83 00000100:00100000:0.0:1788797046.225191:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb050384380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6d050bb-169e-4784-be5b-7071799bf3b0+12:10475:x1875689351457792:12345-192.168.204.38@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1788797046.225312:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3c00/0xca7fc0c411f93af8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797046.225334:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3c00/0xca7fc0c411f93af8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797046.225348:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3c00/0xca7fc0c411f93af8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797046.225595:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3600/0xca7fc0c411f93aff lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797046.225611:0:5825:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045600/0xca7fc0c411f93ab2 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee10d6 expref: 13 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797046.225620:0:5825:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3600/0xca7fc0c411f93aff lrc: 4/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797046.225661:0:5825:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045600/0xca7fc0c411f93ab2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee10d6 expref: 13 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797046.225680:0:5825:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045600/0xca7fc0c411f93ab2 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee10d6 expref: 13 pid: 7636 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788797046.225696:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb047c18a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5825:1875689374547840:192.168.204.38@tcp:104: 00000100:00100000:0.0:1788797046.225795:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb0454809c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788797046.243546:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1788797046.245814:0:11663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351457920 00000100:00100000:3.0:1788797046.245833:0:11663:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351457920 00010000:00010000:3.0:1788797046.245882:0:11663:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045600/0xca7fc0c411f93ab2 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee10d6 expref: 14 pid: 7636 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788797046.245948:0:11663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 45 00000100:00100000:3.0:1788797046.245962:0:11663:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb050386d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e6d050bb-169e-4784-be5b-7071799bf3b0+14:2354:x1875689351457920:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788797046.245979:0:11663:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788797046.245988:0:11663:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045600/0xca7fc0c411f93ab2 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee10d6 expref: 14 pid: 7636 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797046.246004:0:11663:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045600/0xca7fc0c411f93ab2 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee10d6 expref: 14 pid: 7636 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797046.246067:0:11663:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8cb058766000) 00010000:00010000:3.0:1788797046.246075:0:11663:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3600/0xca7fc0c411f93aff lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797046.246086:0:11663:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3600/0xca7fc0c411f93aff lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797046.246095:0:11663:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3600/0xca7fc0c411f93aff lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797046.246122:0:11663:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788797046.246188:0:11663:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb050386d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e6d050bb-169e-4784-be5b-7071799bf3b0+14:2354:x1875689351457920:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 228us (2651us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797046.246197:0:11663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 45 00010000:00010000:1.0:1788797046.248309:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045600/0xca7fc0c411f93ab2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee10d6 expref: 13 pid: 7636 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788797046.248332:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb047c18a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5825:1875689374547840:192.168.204.38@tcp:104: 00010000:00010000:1.0:1788797046.248357:0:5825:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3600/0xca7fc0c411f93aff lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797046.248387:0:5825:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3600/0xca7fc0c411f93aff lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797046.248394:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3600/0xca7fc0c411f93aff lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788797046.248602:0:5825:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967356 00000001:00080000:1.0:1788797046.248765:0:5825:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967357 00000001:00080000:1.0:1788797046.248838:0:5825:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000100:00100000:1.0:1788797046.248980:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb050381880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5825:1875689374547968:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1788797046.250535:0:5825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788797046.250873:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb046b36240 going to sleep for 11 seconds 00000100:00100000:2.0:1788797046.252860:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374547968 00000100:00100000:2.0:1788797046.252874:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374547968 00000100:00100000:2.0:1788797046.253005:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788797046.253020:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb050381c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5825:x1875689374547968:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1788797046.253203:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb050381c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5825:x1875689374547968:12345-0@lo:1000:mdt00_000.0 Request processed in 186us (2669us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797046.253212:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788797046.253316:0:5825:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967303 gen 2 00000004:00080000:3.0:1788797046.253322:0:5825:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8cb07902b480, transno 4294967303 00000100:00100000:3.0:1788797046.253337:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb050381880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5825:1875689374547968:0@lo:1000:mdt00_000.0 00000001:00080000:3.0:1788797046.254001:0:5825:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000100:00100000:3.0:1788797046.254135:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb048e2b100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5825:1875689374548096:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1788797046.254193:0:5825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788797046.256674:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb045529a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788797046.261865:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374548096 00000100:00100000:1.0:1788797046.261885:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374548096 00000100:00100000:1.0:1788797046.261968:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788797046.261983:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb048e2a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5825:x1875689374548096:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1788797046.262355:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb048e2a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5825:x1875689374548096:12345-0@lo:1000:mdt00_000.0 Request processed in 376us (8162us total) trans 4294967305 rc 0/0 00000100:00100000:1.0:1788797046.262363:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788797046.262518:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb048e2b100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5825:1875689374548096:0@lo:1000:mdt00_000.0 00010000:00010000:3.0:1788797046.262567:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3600/0xca7fc0c411f93aff lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797046.262581:0:5825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3600/0xca7fc0c411f93aff lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797046.262607:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3600/0xca7fc0c411f93aff lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797046.262613:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb042ea3600 already unused, calling callback (ffffffffc1f014f0) 00010000:00010000:3.0:1788797046.262618:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3600/0xca7fc0c411f93aff lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797046.262627:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3600/0xca7fc0c411f93aff lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797046.262645:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8cb058766000) 00010000:00010000:3.0:1788797046.262649:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788797046.262655:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3600/0xca7fc0c411f93aff lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797046.262662:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3600/0xca7fc0c411f93aff lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797046.262711:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69e00/0xca7fc0c411f93a2d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797046.262720:0:5825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69e00/0xca7fc0c411f93a2d lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797046.262726:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69e00/0xca7fc0c411f93a2d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797046.262732:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb077c69e00 already unused, calling callback (ffffffffc1f014f0) 00010000:00010000:3.0:1788797046.262735:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69e00/0xca7fc0c411f93a2d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797046.262757:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69e00/0xca7fc0c411f93a2d lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797046.262769:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cb065cc2600) 00010000:00010000:3.0:1788797046.262772:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788797046.262776:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69e00/0xca7fc0c411f93a2d lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797046.262782:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69e00/0xca7fc0c411f93a2d lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797046.262811:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69a00/0xca7fc0c411f93b06 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797046.262829:0:5825:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484c00/0xca7fc0c411f93a49 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee10ba expref: 16 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797046.262839:0:5825:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69a00/0xca7fc0c411f93b06 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797046.262880:0:5825:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484c00/0xca7fc0c411f93a49 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee10ba expref: 16 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797046.262898:0:5825:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484c00/0xca7fc0c411f93a49 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee10ba expref: 16 pid: 5825 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788797046.262913:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb048e2aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5825:1875689374548224:192.168.204.38@tcp:104: 00000100:00100000:3.0:1788797046.263072:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb0452ac480 going to sleep for 11 seconds 00000100:00100000:3.0:1788797046.274146:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb048e2aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5825:1875689374548224:192.168.204.38@tcp:104: 00010000:00010000:3.0:1788797046.274204:0:5825:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69a00/0xca7fc0c411f93b06 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788797046.275471:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1788797046.275546:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351458048 00000100:00100000:0.0:1788797046.275555:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351458048 00010000:00010000:0.0:1788797046.275593:0:6698:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484c00/0xca7fc0c411f93a49 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee10ba expref: 17 pid: 5825 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788797046.275639:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 46 00000100:00100000:0.0:1788797046.275649:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb050385880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e6d050bb-169e-4784-be5b-7071799bf3b0+17:2354:x1875689351458048:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788797046.275664:0:6698:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788797046.275670:0:6698:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484c00/0xca7fc0c411f93a49 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee10ba expref: 17 pid: 5825 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797046.275696:0:6698:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484c00/0xca7fc0c411f93a49 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee10ba expref: 17 pid: 5825 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797046.275723:0:6698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484c00/0xca7fc0c411f93a49 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee10ba expref: 17 pid: 5825 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797046.275739:0:6698:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cb065cc2600) 00010000:00010000:0.0:1788797046.275746:0:6698:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69a00/0xca7fc0c411f93b06 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797046.275756:0:6698:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69a00/0xca7fc0c411f93b06 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797046.275766:0:6698:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69a00/0xca7fc0c411f93b06 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797046.275809:0:6698:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788797046.275876:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb050385880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e6d050bb-169e-4784-be5b-7071799bf3b0+16:2354:x1875689351458048:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 226us (407us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797046.275885:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 46 00010000:00010000:3.0:1788797046.276022:0:5825:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69a00/0xca7fc0c411f93b06 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797046.276067:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69a00/0xca7fc0c411f93b06 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797046.276082:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69a00/0xca7fc0c411f93b06 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797046.276089:0:5825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69a00/0xca7fc0c411f93b06 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797046.276096:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69a00/0xca7fc0c411f93b06 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797046.276101:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb077c69a00 already unused, calling callback (ffffffffc1f014f0) 00010000:00010000:3.0:1788797046.276106:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69a00/0xca7fc0c411f93b06 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797046.276113:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69a00/0xca7fc0c411f93b06 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797046.276125:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cb065cc2600) 00010000:00010000:3.0:1788797046.276128:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788797046.276133:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69a00/0xca7fc0c411f93b06 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797046.276140:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69a00/0xca7fc0c411f93b06 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797046.276169:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3c00/0xca7fc0c411f93af8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797046.276177:0:5825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3c00/0xca7fc0c411f93af8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797046.276183:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3c00/0xca7fc0c411f93af8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797046.276188:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb042ea3c00 already unused, calling callback (ffffffffc1f014f0) 00010000:00010000:3.0:1788797046.276192:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3c00/0xca7fc0c411f93af8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797046.276198:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3c00/0xca7fc0c411f93af8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797046.276209:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cb065cc2600) 00010000:00010000:3.0:1788797046.276212:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788797046.276216:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3c00/0xca7fc0c411f93af8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797046.276222:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3c00/0xca7fc0c411f93af8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788797046.276457:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb050384380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6d050bb-169e-4784-be5b-7071799bf3b0+15:10475:x1875689351457792:12345-192.168.204.38@tcp:57:lhsmtool_posix.0 Request processed in 51269us (51700us total) trans 4294967360 rc 0/0 00000100:00100000:3.0:1788797046.276467:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 83 00000020:00080000:3.0:1788797046.276472:0:5825:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1788797046.276673:0:11679:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788797046.276678:0:11679:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788797046.276721:0:11679:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1788797046.276730:0:11679:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788797046.283849:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1788797046.283964:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351458304 00000100:00100000:3.0:1788797046.283974:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351458304 00000100:00100000:3.0:1788797046.284072:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 20 00000100:00100000:3.0:1788797046.284083:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb050385c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e6d050bb-169e-4784-be5b-7071799bf3b0+15:10475:x1875689351458304:12345-192.168.204.38@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1788797046.284962:0:5829:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1788797046.285124:0:5829:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00010000:00010000:3.0:1788797046.285190:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69e00/0xca7fc0c411f93b0d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797046.285208:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69e00/0xca7fc0c411f93b0d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797046.285221:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69e00/0xca7fc0c411f93b0d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797046.285231:0:5829:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69e00/0xca7fc0c411f93b0d lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797046.285237:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69e00/0xca7fc0c411f93b0d lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797046.285244:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69e00/0xca7fc0c411f93b0d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797046.285287:0:5829:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788797046.285403:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb050385c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e6d050bb-169e-4784-be5b-7071799bf3b0+17:10475:x1875689351458304:12345-192.168.204.38@tcp:35:lhsmtool_posix.0 Request processed in 1318us (1561us total) trans 4294967362 rc 0/0 00000100:00100000:3.0:1788797046.285412:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 20 00000020:00080000:3.0:1788797046.285419:0:5829:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1788797046.285549:0:8446:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788797046.285555:0:8446:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69e00/0xca7fc0c411f93b0d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797046.285562:0:8446:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb077c69e00 already unused, calling callback (ffffffffc14d98b0) 00010000:00010000:0.0:1788797046.285574:0:8446:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69e00/0xca7fc0c411f93b0d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797046.285582:0:8446:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69e00/0xca7fc0c411f93b0d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797046.285593:0:8446:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8cb065cc2e00) 00010000:00010000:0.0:1788797046.285596:0:8446:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788797046.285600:0:8446:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69e00/0xca7fc0c411f93b0d lrc: 1/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797046.285606:0:8446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69e00/0xca7fc0c411f93b0d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797046.285621:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788797046.285622:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788797046.285624:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788797046.487080:0:11995:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788797046.487089:0:11995:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788797046.487126:0:11995:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1788797046.487132:0:11995:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788797046.580272:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1788797046.580497:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351458560 00000100:00100000:2.0:1788797046.580508:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351458560 00000100:00100000:2.0:1788797046.580576:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 84 00000100:00100000:2.0:1788797046.580588:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb050382680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6d050bb-169e-4784-be5b-7071799bf3b0+17:10485:x1875689351458560:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1788797046.580614:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788797046.580634:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484c00/0xca7fc0c411f93b14 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c99e04559ee10f2 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797046.580746:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484800/0xca7fc0c411f93b1b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797046.580760:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484800/0xca7fc0c411f93b1b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797046.580772:0:5826:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484800/0xca7fc0c411f93b1b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788797046.580783:0:5826:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:2.0:1788797046.580907:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484c00/0xca7fc0c411f93b14 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee10f2 expref: 20 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797046.580937:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484800/0xca7fc0c411f93b1b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee10f2 expref: 19 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797046.580947:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8cb06ce84d00) 00010000:00010000:2.0:1788797046.580951:0:5826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788797046.580955:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb041484800, rc 0) 00000100:00100000:2.0:1788797046.581018:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb050382680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6d050bb-169e-4784-be5b-7071799bf3b0+19:10485:x1875689351458560:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 432us (755us total) trans 4294967363 rc 0/0 00000100:00100000:2.0:1788797046.581025:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 84 00000100:00100000:1.0:1788797046.585391:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00010000:00010000:3.0:1788797046.589148:0:5815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788797046.589431:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351458688 00000100:00100000:0.0:1788797046.589445:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351458688 00000100:00100000:0.0:1788797046.589509:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 85 00000100:00100000:0.0:1788797046.589520:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb050383b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6d050bb-169e-4784-be5b-7071799bf3b0+19:10485:x1875689351458688:12345-192.168.204.38@tcp:34:lfs.0 00010000:00010000:0.0:1788797046.589603:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2400/0xca7fc0c411f93b29 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797046.589620:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2400/0xca7fc0c411f93b29 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797046.589631:0:5827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2400/0xca7fc0c411f93b29 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797046.589647:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3c00/0xca7fc0c411f93b30 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797046.589666:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3c00/0xca7fc0c411f93b30 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797046.589673:0:5827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3c00/0xca7fc0c411f93b30 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797046.589879:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3600/0xca7fc0c411f93b37 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797046.589887:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3600/0xca7fc0c411f93b37 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797046.589894:0:5827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3600/0xca7fc0c411f93b37 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788797046.589947:0:5827:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3600/0xca7fc0c411f93b37 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797046.589959:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2400/0xca7fc0c411f93b29 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797046.589967:0:5827:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2400/0xca7fc0c411f93b29 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797046.589973:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2400/0xca7fc0c411f93b29 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797046.589979:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb042ea2400 already unused, calling callback (ffffffffc1f014f0) 00010000:00010000:0.0:1788797046.589984:0:5827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2400/0xca7fc0c411f93b29 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797046.589992:0:5827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2400/0xca7fc0c411f93b29 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797046.590009:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8cb06ce84d00) 00010000:00010000:0.0:1788797046.590011:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788797046.590016:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2400/0xca7fc0c411f93b29 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797046.590022:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2400/0xca7fc0c411f93b29 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797046.590062:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3c00/0xca7fc0c411f93b30 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797046.590068:0:5827:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3c00/0xca7fc0c411f93b30 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797046.590074:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3c00/0xca7fc0c411f93b30 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797046.590079:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb042ea3c00 already unused, calling callback (ffffffffc1f014f0) 00010000:00010000:0.0:1788797046.590082:0:5827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3c00/0xca7fc0c411f93b30 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797046.590087:0:5827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3c00/0xca7fc0c411f93b30 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797046.590095:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8cb058766200) 00010000:00010000:0.0:1788797046.590098:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788797046.590100:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3c00/0xca7fc0c411f93b30 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797046.590106:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3c00/0xca7fc0c411f93b30 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797046.590133:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3600/0xca7fc0c411f93b37 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797046.590139:0:5827:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3600/0xca7fc0c411f93b37 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797046.590144:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3600/0xca7fc0c411f93b37 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797046.590149:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb042ea3600 already unused, calling callback (ffffffffc1f014f0) 00010000:00010000:0.0:1788797046.590152:0:5827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3600/0xca7fc0c411f93b37 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797046.590157:0:5827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3600/0xca7fc0c411f93b37 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797046.590163:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cb058766700) 00010000:00010000:0.0:1788797046.590166:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788797046.590168:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3600/0xca7fc0c411f93b37 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797046.590174:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3600/0xca7fc0c411f93b37 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788797046.590673:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb050383b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6d050bb-169e-4784-be5b-7071799bf3b0+19:10485:x1875689351458688:12345-192.168.204.38@tcp:34:lfs.0 Request processed in 1152us (5290us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797046.590683:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 85 00000100:00100000:2.0:1788797046.649853:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1788797046.649964:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351458944 00000100:00100000:0.0:1788797046.649975:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351458944 00000100:00100000:0.0:1788797046.650149:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 86 00000100:00100000:0.0:1788797046.650174:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb050386680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6d050bb-169e-4784-be5b-7071799bf3b0+19:10488:x1875689351458944:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1788797046.650195:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788797046.650215:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3c00/0xca7fc0c411f93b3e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c99e04559ee10f9 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797046.650308:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2400/0xca7fc0c411f93b45 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797046.650322:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2400/0xca7fc0c411f93b45 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797046.650333:0:5826:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2400/0xca7fc0c411f93b45 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797046.650346:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3000/0xca7fc0c411f93b4c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797046.650352:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3000/0xca7fc0c411f93b4c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797046.650360:0:5826:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3000/0xca7fc0c411f93b4c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797046.650633:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2a00/0xca7fc0c411f93b53 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797046.650642:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2a00/0xca7fc0c411f93b53 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797046.650649:0:5826:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2a00/0xca7fc0c411f93b53 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788797046.650669:0:5826:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:0.0:1788797046.650754:0:5826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2400/0xca7fc0c411f93b45 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797046.650761:0:5826:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2400/0xca7fc0c411f93b45 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797046.650768:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2400/0xca7fc0c411f93b45 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797046.650774:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb042ea2400 already unused, calling callback (ffffffffc1f014f0) 00010000:00010000:0.0:1788797046.650779:0:5826:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2400/0xca7fc0c411f93b45 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797046.650786:0:5826:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2400/0xca7fc0c411f93b45 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797046.650798:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8cb06ce84d00) 00010000:00010000:0.0:1788797046.650801:0:5826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788797046.650806:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2400/0xca7fc0c411f93b45 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797046.650811:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2400/0xca7fc0c411f93b45 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797046.650821:0:5826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3000/0xca7fc0c411f93b4c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797046.650827:0:5826:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3000/0xca7fc0c411f93b4c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797046.650842:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3000/0xca7fc0c411f93b4c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797046.650848:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb042ea3000 already unused, calling callback (ffffffffc1f014f0) 00010000:00010000:0.0:1788797046.650851:0:5826:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3000/0xca7fc0c411f93b4c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797046.650856:0:5826:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3000/0xca7fc0c411f93b4c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797046.650864:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8cb058766700) 00010000:00010000:0.0:1788797046.650867:0:5826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788797046.650869:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3000/0xca7fc0c411f93b4c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797046.650875:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3000/0xca7fc0c411f93b4c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797046.650929:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3c00/0xca7fc0c411f93b3e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee10f9 expref: 22 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797046.650943:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2a00/0xca7fc0c411f93b53 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee10f9 expref: 21 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797046.650950:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cb058766200) 00010000:00010000:0.0:1788797046.650952:0:5826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788797046.650955:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb042ea2a00, rc 0) 00000100:00100000:0.0:1788797046.651016:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb050386680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6d050bb-169e-4784-be5b-7071799bf3b0+21:10488:x1875689351458944:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 844us (1174us total) trans 4294967364 rc 0/0 00000100:00100000:0.0:1788797046.651063:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 86 00000100:00100000:1.0:1788797046.654344:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1788797046.654462:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351459072 00000100:00100000:3.0:1788797046.654472:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351459072 00000100:00100000:3.0:1788797046.654529:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 87 00000100:00100000:3.0:1788797046.654552:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb050380e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6d050bb-169e-4784-be5b-7071799bf3b0+21:10488:x1875689351459072:12345-192.168.204.38@tcp:54:lfs.0 00010000:00010000:3.0:1788797046.654614:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69600/0xca7fc0c411f93b61 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797046.654630:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69600/0xca7fc0c411f93b61 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797046.654642:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69600/0xca7fc0c411f93b61 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797046.654668:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69600/0xca7fc0c411f93b61 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797046.654675:0:5825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69600/0xca7fc0c411f93b61 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797046.654683:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69600/0xca7fc0c411f93b61 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797046.654689:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb077c69600 already unused, calling callback (ffffffffc1f014f0) 00010000:00010000:3.0:1788797046.654693:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69600/0xca7fc0c411f93b61 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797046.654701:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69600/0xca7fc0c411f93b61 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797046.654712:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cb058766200) 00010000:00010000:3.0:1788797046.654715:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788797046.654720:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69600/0xca7fc0c411f93b61 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797046.654726:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69600/0xca7fc0c411f93b61 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788797046.654808:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb050380e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6d050bb-169e-4784-be5b-7071799bf3b0+21:10488:x1875689351459072:12345-192.168.204.38@tcp:54:lfs.0 Request processed in 258us (474us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797046.654815:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 87 00000100:00100000:2.0:1788797046.657474:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1788797046.657564:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351459328 00000100:00100000:3.0:1788797046.657574:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351459328 00000100:00100000:3.0:1788797046.657616:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 21 00000100:00100000:3.0:1788797046.657626:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb050635450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e6d050bb-169e-4784-be5b-7071799bf3b0+21:10488:x1875689351459328:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:3.0:1788797046.657880:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb050635450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e6d050bb-169e-4784-be5b-7071799bf3b0+22:10488:x1875689351459328:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 254us (413us total) trans 4294967365 rc 0/0 00000100:00100000:3.0:1788797046.657888:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 21 00000100:00100000:1.0:1788797046.675820:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1788797046.675933:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1788797046.676082:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1788797046.676124:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351459584 00000100:00100000:3.0:1788797046.676136:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351459584 00000100:00100000:2.0:1788797046.676157:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351459456 00000100:00100000:2.0:1788797046.676163:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351459456 00000100:00100000:3.0:1788797046.676225:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 53 00000100:00100000:3.0:1788797046.676237:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb050383100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e6d050bb-169e-4784-be5b-7071799bf3b0+7:2352:x1875689351459584:12345-192.168.204.38@tcp:400:kworker.0 00000100:00080000:1.0:1788797046.676263:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788797046.676346:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb050383100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e6d050bb-169e-4784-be5b-7071799bf3b0+7:2352:x1875689351459584:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 112us (265us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797046.676354:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 53 00000100:00100000:2.0:1788797046.676775:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 292 00000100:00100000:2.0:1788797046.676787:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb048869050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4d9d1a9-601d-459e-8721-8bfc2fdde84f+13:2352:x1875689351459456:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:2.0:1788797046.676838:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb048869050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4d9d1a9-601d-459e-8721-8bfc2fdde84f+13:2352:x1875689351459456:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 54us (1029us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797046.676847:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 292 00000100:00100000:0.0:1788797046.677364:0:7636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351459712 00000100:00100000:0.0:1788797046.677371:0:7636:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351459712 00000100:00100000:0.0:1788797046.677468:0:7636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 143 00000100:00100000:0.0:1788797046.677476:0:7636:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb050381f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed124ec0-b908-4000-b768-8e53d5def0fc+5:2352:x1875689351459712:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:0.0:1788797046.677536:0:7636:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb050381f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed124ec0-b908-4000-b768-8e53d5def0fc+5:2352:x1875689351459712:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 61us (1602us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797046.677542:0:7636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 143 00000100:00080000:1.0:1788797046.678015:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788797046.681687:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1788797046.682361:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351459968 00000100:00100000:3.0:1788797046.682371:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351459968 00000100:00100000:3.0:1788797046.682430:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 88 00000100:00100000:3.0:1788797046.682440:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb050383800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6d050bb-169e-4784-be5b-7071799bf3b0+22:10017:x1875689351459968:12345-192.168.204.38@tcp:101:bash.0 00010000:00010000:3.0:1788797046.682463:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788797046.682484:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c68600/0xca7fc0c411f93b68 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c99e04559ee1100 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797046.682616:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69600/0xca7fc0c411f93b6f lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797046.682632:0:5825:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2a00/0xca7fc0c411f93b53 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee10f9 expref: 23 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797046.682641:0:5825:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69600/0xca7fc0c411f93b6f lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797046.682676:0:5825:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2a00/0xca7fc0c411f93b53 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee10f9 expref: 23 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797046.682689:0:5825:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2a00/0xca7fc0c411f93b53 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee10f9 expref: 23 pid: 5826 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788797046.682702:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb048e2aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5825:1875689374548352:192.168.204.38@tcp:104: 00000100:00100000:3.0:1788797046.682787:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb0503cfe40 going to sleep for 11 seconds 00000100:00100000:1.0:1788797046.685830:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb048e2aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5825:1875689374548352:192.168.204.38@tcp:104: 00010000:00010000:1.0:1788797046.685858:0:5825:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69600/0xca7fc0c411f93b6f lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788797046.687207:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1788797046.687962:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351460096 00000100:00100000:0.0:1788797046.687973:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351460096 00010000:00010000:0.0:1788797046.688018:0:5812:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2a00/0xca7fc0c411f93b53 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee10f9 expref: 24 pid: 5826 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788797046.688087:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 47 00000100:00100000:0.0:1788797046.688097:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb050381500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e6d050bb-169e-4784-be5b-7071799bf3b0+24:2355:x1875689351460096:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788797046.688114:0:5812:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788797046.688121:0:5812:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2a00/0xca7fc0c411f93b53 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee10f9 expref: 24 pid: 5826 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797046.688135:0:5812:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2a00/0xca7fc0c411f93b53 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee10f9 expref: 24 pid: 5826 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797046.688156:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2a00/0xca7fc0c411f93b53 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee10f9 expref: 24 pid: 5826 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797046.688171:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cb058766200) 00010000:00010000:0.0:1788797046.688187:0:5812:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69600/0xca7fc0c411f93b6f lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797046.688196:0:5812:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69600/0xca7fc0c411f93b6f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797046.688203:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69600/0xca7fc0c411f93b6f lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797046.688412:0:5812:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788797046.688479:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb050381500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e6d050bb-169e-4784-be5b-7071799bf3b0+23:2355:x1875689351460096:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 383us (1276us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797046.688488:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 47 00010000:00010000:1.0:1788797046.689341:0:5825:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69600/0xca7fc0c411f93b6f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797046.689351:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69600/0xca7fc0c411f93b6f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788797046.689372:0:5825:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:1.0:1788797046.689519:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c68600/0xca7fc0c411f93b68 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1100 expref: 24 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797046.689537:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69600/0xca7fc0c411f93b6f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1100 expref: 23 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797046.689546:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cb058766200) 00010000:00010000:1.0:1788797046.689549:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788797046.689552:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb077c69600, rc 0) 00000100:00100000:1.0:1788797046.689873:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb050383800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6d050bb-169e-4784-be5b-7071799bf3b0+23:10017:x1875689351459968:12345-192.168.204.38@tcp:101:bash.0 Request processed in 7432us (8193us total) trans 4294967366 rc 0/0 00000100:00100000:1.0:1788797046.689881:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 88 00000100:00100000:2.0:1788797046.692446:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1788797046.692618:0:7636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351460352 00000100:00100000:0.0:1788797046.692628:0:7636:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351460352 00000100:00100000:0.0:1788797046.692683:0:7636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 89 00000100:00100000:0.0:1788797046.692692:0:7636:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb050387b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6d050bb-169e-4784-be5b-7071799bf3b0+23:10017:x1875689351460352:12345-192.168.204.38@tcp:36:bash.0 00010000:00010000:0.0:1788797046.692965:0:7636:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3000/0xca7fc0c411f93b7d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797046.692983:0:7636:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3000/0xca7fc0c411f93b7d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797046.692994:0:7636:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3000/0xca7fc0c411f93b7d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788797046.693073:0:7636:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967367 00000004:00010000:0.0:1788797046.693098:0:7636:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008684635f reply state 000000008ca6ba28 transno 4294967368 ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3000/0xca7fc0c411f93b7d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788797046.693107:0:7636:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:0.0:1788797046.693162:0:7636:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967368 00000100:00100000:0.0:1788797046.693651:0:7636:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb050387b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6d050bb-169e-4784-be5b-7071799bf3b0+27:10017:x1875689351460352:12345-192.168.204.38@tcp:36:bash.0 Request processed in 956us (1210us total) trans 4294967369 rc 0/0 00000100:00100000:0.0:1788797046.693659:0:7636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 89 00000020:00080000:0.0:1788797046.693665:0:7636:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:1.0:1788797046.696439:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3000/0xca7fc0c411f93b7d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797046.696470:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3000/0xca7fc0c411f93b7d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797046.696478:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3000/0xca7fc0c411f93b7d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797046.696483:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb042ea3000 already unused, calling callback (ffffffffc1f014f0) 00010000:00010000:1.0:1788797046.696488:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3000/0xca7fc0c411f93b7d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797046.696497:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3000/0xca7fc0c411f93b7d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797046.696514:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cb058766200) 00010000:00010000:1.0:1788797046.696517:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788797046.696523:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3000/0xca7fc0c411f93b7d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797046.696528:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3000/0xca7fc0c411f93b7d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788797046.697985:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1788797046.698198:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351460480 00000100:00100000:0.0:1788797046.698208:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351460480 00000100:00100000:0.0:1788797046.698270:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 90 00000100:00100000:0.0:1788797046.698280:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb050384e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6d050bb-169e-4784-be5b-7071799bf3b0+26:10017:x1875689351460480:12345-192.168.204.38@tcp:101:bash.0 00010000:00010000:0.0:1788797046.698370:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788797046.698389:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2a00/0xca7fc0c411f93b84 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c99e04559ee1107 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797046.698449:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2a00/0xca7fc0c411f93b84 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1107 expref: 27 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797046.698463:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2a00/0xca7fc0c411f93b84 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1107 expref: 27 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797046.698482:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cb058766200) 00010000:00010000:0.0:1788797046.698486:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788797046.698490:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb042ea2a00, rc 0) 00000100:00100000:0.0:1788797046.698548:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb050384e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6d050bb-169e-4784-be5b-7071799bf3b0+27:10017:x1875689351460480:12345-192.168.204.38@tcp:101:bash.0 Request processed in 268us (570us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797046.698554:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 90 00000100:00100000:3.0:1788797046.701145:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1788797046.701447:0:10829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351460608 00000100:00100000:2.0:1788797046.701458:0:10829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351460608 00000100:00100000:2.0:1788797046.701514:0:10829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 34 00000100:00100000:2.0:1788797046.701524:0:10829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb048e29180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e6d050bb-169e-4784-be5b-7071799bf3b0+6:10017:x1875689351460608:12345-192.168.204.38@tcp:101:bash.0 00010000:00010000:2.0:1788797046.701541:0:10829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788797046.701562:0:10829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000076e75d25/0xca7fc0c411f93b8b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7c99e04559ee110e expref: -99 pid: 10829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788797046.701597:0:10829:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a9ee075, atime: 0x6a9ee073, ctime: 0x6a9ee075, blocks: 0xb 00010000:00010000:2.0:1788797046.701617:0:10829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=335s v=(0 0) 00010000:00010000:2.0:1788797046.701622:0:10829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788797046.701630:0:10829:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000076e75d25/0xca7fc0c411f93b8b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee110e expref: 7 pid: 10829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797046.701645:0:10829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000076e75d25/0xca7fc0c411f93b8b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee110e expref: 7 pid: 10829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797046.701657:0:10829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb041485200, rc 0) 00000100:00100000:2.0:1788797046.701718:0:10829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb048e29180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e6d050bb-169e-4784-be5b-7071799bf3b0+7:10017:x1875689351460608:12345-192.168.204.38@tcp:101:bash.0 Request processed in 195us (581us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797046.701740:0:10829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 34 00000100:00100000:2.0:1788797046.704018:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1788797046.704177:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351460736 00000100:00100000:3.0:1788797046.704186:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351460736 00002000:00010000:3.0:1788797046.704243:0:6687:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/3 (0->18446744073709551615) 00002000:00100000:3.0:1788797046.704249:0:6687:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8cb050385f80 with x1875689351460736 ext(0->18446744073709551615) 00002000:00010000:3.0:1788797046.704260:0:6687:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8cb050385f80. 00000100:00100000:3.0:1788797046.704288:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1 00000100:00100000:3.0:1788797046.704298:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb050385f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e6d050bb-169e-4784-be5b-7071799bf3b0+7:2354:x1875689351460736:12345-192.168.204.38@tcp:10:bash.0 00002000:00010000:3.0:1788797046.704560:0:6687:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:3.0:1788797046.704575:0:6687:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 1788797045 -> 1788797047 00002000:00010000:3.0:1788797046.704578:0:6687:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 1788797043 -> 1788797043 00002000:00010000:3.0:1788797046.704722:0:6687:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1788797045 -> 1788797047 00002000:00010000:3.0:1788797046.704725:0:6687:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:3.0:1788797046.704776:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb050385f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e6d050bb-169e-4784-be5b-7071799bf3b0+8:2354:x1875689351460736:12345-192.168.204.38@tcp:10:bash.0 Request processed in 480us (766us total) trans 4294967306 rc 0/0 00000100:00100000:3.0:1788797046.704784:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1 00002000:00010000:3.0:1788797046.704788:0:6687:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/3 (0->18446744073709551615) 00002000:00100000:3.0:1788797046.704791:0:6687:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8cb050385f80 with x1875689351460736 ext(0->18446744073709551615) 00002000:00010000:3.0:1788797046.704795:0:6687:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8cb050385f80. 00000100:00100000:3.0:1788797046.783678:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1788797046.783798:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351460864 00000100:00100000:2.0:1788797046.783808:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351460864 00000100:00100000:2.0:1788797046.783864:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 91 00000100:00100000:2.0:1788797046.783874:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb048e29880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6d050bb-169e-4784-be5b-7071799bf3b0+27:10502:x1875689351460864:12345-192.168.204.38@tcp:34:lfs.0 00010000:00010000:2.0:1788797046.783955:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041485c00/0xca7fc0c411f93b92 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797046.783972:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041485c00/0xca7fc0c411f93b92 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797046.783983:0:5826:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041485c00/0xca7fc0c411f93b92 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797046.783997:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484c00/0xca7fc0c411f93b99 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797046.784005:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484c00/0xca7fc0c411f93b99 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797046.784011:0:5826:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484c00/0xca7fc0c411f93b99 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797046.784283:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484400/0xca7fc0c411f93ba0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797046.784293:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484400/0xca7fc0c411f93ba0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797046.784300:0:5826:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484400/0xca7fc0c411f93ba0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788797046.785132:0:5826:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484400/0xca7fc0c411f93ba0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797046.785149:0:5826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041485c00/0xca7fc0c411f93b92 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797046.785156:0:5826:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041485c00/0xca7fc0c411f93b92 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797046.785164:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041485c00/0xca7fc0c411f93b92 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797046.785169:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb041485c00 already unused, calling callback (ffffffffc1f014f0) 00010000:00010000:3.0:1788797046.785173:0:5826:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041485c00/0xca7fc0c411f93b92 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797046.785181:0:5826:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041485c00/0xca7fc0c411f93b92 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797046.785364:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8cb06ce84d00) 00010000:00010000:3.0:1788797046.785368:0:5826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788797046.785375:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041485c00/0xca7fc0c411f93b92 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797046.785382:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041485c00/0xca7fc0c411f93b92 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797046.785398:0:5826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484c00/0xca7fc0c411f93b99 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797046.785404:0:5826:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484c00/0xca7fc0c411f93b99 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797046.785409:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484c00/0xca7fc0c411f93b99 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797046.785414:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb041484c00 already unused, calling callback (ffffffffc1f014f0) 00010000:00010000:3.0:1788797046.785417:0:5826:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484c00/0xca7fc0c411f93b99 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797046.785422:0:5826:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484c00/0xca7fc0c411f93b99 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797046.785430:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8cb05088ab00) 00010000:00010000:3.0:1788797046.785432:0:5826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788797046.785435:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484c00/0xca7fc0c411f93b99 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797046.785441:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484c00/0xca7fc0c411f93b99 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797046.785465:0:5826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484400/0xca7fc0c411f93ba0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797046.785472:0:5826:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484400/0xca7fc0c411f93ba0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797046.785478:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484400/0xca7fc0c411f93ba0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797046.785483:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb041484400 already unused, calling callback (ffffffffc1f014f0) 00010000:00010000:3.0:1788797046.785486:0:5826:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484400/0xca7fc0c411f93ba0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797046.785492:0:5826:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484400/0xca7fc0c411f93ba0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797046.785499:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cb058766200) 00010000:00010000:3.0:1788797046.785501:0:5826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788797046.785504:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484400/0xca7fc0c411f93ba0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797046.785510:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484400/0xca7fc0c411f93ba0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788797046.785798:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb048e29880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6d050bb-169e-4784-be5b-7071799bf3b0+27:10502:x1875689351460864:12345-192.168.204.38@tcp:34:lfs.0 Request processed in 1922us (2125us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797046.785809:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 91 00000100:00100000:1.0:1788797046.819850:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1788797046.819989:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351461120 00000100:00100000:0.0:1788797046.820000:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351461120 00000100:00100000:0.0:1788797046.820118:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 92 00000100:00100000:0.0:1788797046.820128:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb050383480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6d050bb-169e-4784-be5b-7071799bf3b0+27:10505:x1875689351461120:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1788797046.820163:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788797046.820549:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2400/0xca7fc0c411f93ba7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c99e04559ee1115 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797046.820642:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2800/0xca7fc0c411f93bae lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797046.820656:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2800/0xca7fc0c411f93bae lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797046.820667:0:5827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2800/0xca7fc0c411f93bae lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797046.820683:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2c00/0xca7fc0c411f93bb5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797046.820690:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2c00/0xca7fc0c411f93bb5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797046.820697:0:5827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2c00/0xca7fc0c411f93bb5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797046.820977:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3400/0xca7fc0c411f93bbc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797046.820986:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3400/0xca7fc0c411f93bbc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797046.820993:0:5827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3400/0xca7fc0c411f93bbc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788797046.821002:0:5827:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:0.0:1788797046.821153:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2800/0xca7fc0c411f93bae lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797046.821161:0:5827:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2800/0xca7fc0c411f93bae lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797046.821167:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2800/0xca7fc0c411f93bae lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797046.821173:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb042ea2800 already unused, calling callback (ffffffffc1f014f0) 00010000:00010000:0.0:1788797046.821177:0:5827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2800/0xca7fc0c411f93bae lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797046.821184:0:5827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2800/0xca7fc0c411f93bae lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797046.821196:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8cb06ce84d00) 00010000:00010000:0.0:1788797046.821199:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788797046.821204:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2800/0xca7fc0c411f93bae lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797046.821209:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2800/0xca7fc0c411f93bae lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797046.821229:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2c00/0xca7fc0c411f93bb5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797046.821240:0:5827:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2c00/0xca7fc0c411f93bb5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797046.821246:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2c00/0xca7fc0c411f93bb5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797046.821250:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb042ea2c00 already unused, calling callback (ffffffffc1f014f0) 00010000:00010000:0.0:1788797046.821264:0:5827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2c00/0xca7fc0c411f93bb5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797046.821270:0:5827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2c00/0xca7fc0c411f93bb5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797046.821277:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8cb058766700) 00010000:00010000:0.0:1788797046.821280:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788797046.821282:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2c00/0xca7fc0c411f93bb5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797046.821288:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2c00/0xca7fc0c411f93bb5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797046.821339:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2400/0xca7fc0c411f93ba7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1115 expref: 30 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797046.821352:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3400/0xca7fc0c411f93bbc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1115 expref: 29 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797046.821358:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cb058766200) 00010000:00010000:0.0:1788797046.821361:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1788797046.821363:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb042ea3400, rc 0) 00000100:00100000:0.0:1788797046.821432:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb050383480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6d050bb-169e-4784-be5b-7071799bf3b0+29:10505:x1875689351461120:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 1305us (1859us total) trans 4294967370 rc 0/0 00000100:00100000:0.0:1788797046.821440:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 92 00000100:00100000:2.0:1788797046.825377:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1788797046.825451:0:7636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351461248 00000100:00100000:0.0:1788797046.825460:0:7636:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351461248 00000100:00100000:0.0:1788797046.825518:0:7636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 93 00000100:00100000:0.0:1788797046.825528:0:7636:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb050387100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6d050bb-169e-4784-be5b-7071799bf3b0+29:10505:x1875689351461248:12345-192.168.204.38@tcp:54:lfs.0 00010000:00010000:0.0:1788797046.825605:0:7636:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2600/0xca7fc0c411f93bca lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797046.825621:0:7636:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69600/0xca7fc0c411f93b6f lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1100 expref: 29 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797046.825630:0:7636:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2600/0xca7fc0c411f93bca lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797046.825662:0:7636:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69600/0xca7fc0c411f93b6f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1100 expref: 29 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797046.825675:0:7636:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69600/0xca7fc0c411f93b6f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1100 expref: 29 pid: 5825 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788797046.825688:0:7636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb047c18700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7636:1875689374548480:192.168.204.38@tcp:104: 00000100:00100000:0.0:1788797046.825781:0:7636:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb045480480 going to sleep for 11 seconds 00000100:00100000:0.0:1788797046.828471:0:7636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb047c18700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7636:1875689374548480:192.168.204.38@tcp:104: 00010000:00010000:0.0:1788797046.828500:0:7636:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2600/0xca7fc0c411f93bca lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788797046.834169:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1788797046.834268:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351461504 00000100:00100000:3.0:1788797046.834278:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351461504 00000100:00100000:3.0:1788797046.834351:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 22 00000100:00100000:3.0:1788797046.834379:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb050387800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e6d050bb-169e-4784-be5b-7071799bf3b0+30:5608:x1875689351461504:12345-192.168.204.38@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1788797046.834725:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb050387800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e6d050bb-169e-4784-be5b-7071799bf3b0+31:5608:x1875689351461504:12345-192.168.204.38@tcp:35:ldlm_bl.0 Request processed in 350us (564us total) trans 4294967371 rc 0/0 00000100:00100000:3.0:1788797046.834756:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 22 00000100:00100000:3.0:1788797046.839220:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1788797046.839283:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351461632 00000100:00100000:2.0:1788797046.839295:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351461632 00010000:00010000:2.0:1788797046.839334:0:5811:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69600/0xca7fc0c411f93b6f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1100 expref: 31 pid: 5825 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788797046.839384:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 48 00000100:00100000:2.0:1788797046.839394:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb048e2ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e6d050bb-169e-4784-be5b-7071799bf3b0+31:2354:x1875689351461632:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788797046.839408:0:5811:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788797046.839415:0:5811:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69600/0xca7fc0c411f93b6f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1100 expref: 31 pid: 5825 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797046.839431:0:5811:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69600/0xca7fc0c411f93b6f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1100 expref: 31 pid: 5825 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797046.839461:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69600/0xca7fc0c411f93b6f lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1100 expref: 31 pid: 5825 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797046.839476:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cb058766200) 00010000:00010000:2.0:1788797046.839482:0:5811:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2600/0xca7fc0c411f93bca lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797046.839492:0:5811:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2600/0xca7fc0c411f93bca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797046.839500:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2600/0xca7fc0c411f93bca lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797046.839542:0:5811:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788797046.839599:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb048e2ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e6d050bb-169e-4784-be5b-7071799bf3b0+30:2354:x1875689351461632:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 206us (390us total) trans 0 rc 0/0 00010000:00010000:0.0:1788797046.839604:0:7636:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2600/0xca7fc0c411f93bca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788797046.839609:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 48 00010000:00010000:0.0:1788797046.839619:0:7636:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2600/0xca7fc0c411f93bca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797046.839653:0:7636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2600/0xca7fc0c411f93bca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797046.839670:0:7636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2600/0xca7fc0c411f93bca lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797046.839676:0:7636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2600/0xca7fc0c411f93bca lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797046.839682:0:7636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb042ea2600 already unused, calling callback (ffffffffc1f014f0) 00010000:00010000:0.0:1788797046.839685:0:7636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2600/0xca7fc0c411f93bca lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797046.839692:0:7636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2600/0xca7fc0c411f93bca lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797046.839766:0:7636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cb058766200) 00010000:00010000:0.0:1788797046.839770:0:7636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788797046.839774:0:7636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2600/0xca7fc0c411f93bca lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797046.839780:0:7636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2600/0xca7fc0c411f93bca lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788797046.839818:0:7636:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb050387100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6d050bb-169e-4784-be5b-7071799bf3b0+29:10505:x1875689351461248:12345-192.168.204.38@tcp:54:lfs.0 Request processed in 14292us (14451us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797046.839826:0:7636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 93 00000100:00100000:2.0:1788797046.845304:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1788797046.845364:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351461888 00000100:00100000:1.0:1788797046.845379:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351461888 00000100:00100000:1.0:1788797046.845441:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 23 00000100:00100000:1.0:1788797046.845453:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb050385500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e6d050bb-169e-4784-be5b-7071799bf3b0+29:10505:x1875689351461888:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:1.0:1788797046.845744:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb050385500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e6d050bb-169e-4784-be5b-7071799bf3b0+30:10505:x1875689351461888:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 292us (449us total) trans 4294967372 rc 0/0 00000100:00100000:1.0:1788797046.845753:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 23 00000100:00100000:3.0:1788797046.972889:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1788797046.986478:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351462144 00000100:00100000:1.0:1788797046.986495:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351462144 00000100:00100000:1.0:1788797046.986779:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 94 00000100:00100000:1.0:1788797046.986793:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb048e2a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6d050bb-169e-4784-be5b-7071799bf3b0+30:10516:x1875689351462144:12345-192.168.204.38@tcp:101:cat.0 00010000:00010000:1.0:1788797046.986818:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788797046.986837:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045400/0xca7fc0c411f93bd1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c99e04559ee111c expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797046.986920:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045200/0xca7fc0c411f93bd8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797046.986933:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045200/0xca7fc0c411f93bd8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797046.986943:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045200/0xca7fc0c411f93bd8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797046.986955:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045600/0xca7fc0c411f93bdf lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797046.986962:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045600/0xca7fc0c411f93bdf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797046.986968:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045600/0xca7fc0c411f93bdf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797046.987278:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082044200/0xca7fc0c411f93be6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797046.987287:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082044200/0xca7fc0c411f93be6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797046.987305:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082044200/0xca7fc0c411f93be6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788797046.987317:0:5825:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 8 00010000:00010000:1.0:1788797046.987416:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045200/0xca7fc0c411f93bd8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797046.987424:0:5825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045200/0xca7fc0c411f93bd8 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797046.987431:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045200/0xca7fc0c411f93bd8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797046.987438:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb082045200 already unused, calling callback (ffffffffc1f014f0) 00010000:00010000:1.0:1788797046.987442:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045200/0xca7fc0c411f93bd8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797046.987450:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045200/0xca7fc0c411f93bd8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797046.987462:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8cb06ce84d00) 00010000:00010000:1.0:1788797046.987465:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788797046.987471:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045200/0xca7fc0c411f93bd8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797046.987478:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045200/0xca7fc0c411f93bd8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797046.987490:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045600/0xca7fc0c411f93bdf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797046.987496:0:5825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045600/0xca7fc0c411f93bdf lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797046.987509:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045600/0xca7fc0c411f93bdf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797046.987515:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb082045600 already unused, calling callback (ffffffffc1f014f0) 00010000:00010000:1.0:1788797046.987518:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045600/0xca7fc0c411f93bdf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797046.987524:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045600/0xca7fc0c411f93bdf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797046.987532:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8cb06ce84e00) 00010000:00010000:1.0:1788797046.987534:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788797046.987537:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045600/0xca7fc0c411f93bdf lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797046.987543:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045600/0xca7fc0c411f93bdf lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797046.987611:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045400/0xca7fc0c411f93bd1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee111c expref: 33 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797046.987636:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082044200/0xca7fc0c411f93be6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee111c expref: 32 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797046.987644:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cb058766200) 00010000:00010000:1.0:1788797046.987646:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788797046.987648:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb082044200, rc 0) 00000100:00100000:1.0:1788797046.987719:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb048e2a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6d050bb-169e-4784-be5b-7071799bf3b0+32:10516:x1875689351462144:12345-192.168.204.38@tcp:101:cat.0 Request processed in 930us (14841us total) trans 4294967373 rc 0/0 00000100:00100000:1.0:1788797046.987736:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 94 00000100:00100000:2.0:1788797046.999817:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1788797046.999899:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351462400 00000100:00100000:1.0:1788797046.999919:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351462400 00000100:00100000:1.0:1788797046.999979:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 24 00000100:00100000:1.0:1788797046.999991:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb050387480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e6d050bb-169e-4784-be5b-7071799bf3b0+32:10516:x1875689351462400:12345-192.168.204.38@tcp:35:cat.0 00000100:00100000:2.0:1788797047.000919:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb050387480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e6d050bb-169e-4784-be5b-7071799bf3b0+33:10516:x1875689351462400:12345-192.168.204.38@tcp:35:cat.0 Request processed in 928us (1110us total) trans 4294967374 rc 0/0 00000100:00100000:2.0:1788797047.000928:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 24 00000100:00100000:2.0:1788797047.047591:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1788797047.047807:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351462656 00000100:00100000:1.0:1788797047.047825:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351462656 00000100:00100000:1.0:1788797047.047966:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 95 00000100:00100000:1.0:1788797047.047984:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb050386a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6d050bb-169e-4784-be5b-7071799bf3b0+33:10517:x1875689351462656:12345-192.168.204.38@tcp:36:rm.0 00010000:00010000:1.0:1788797047.048122:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1788797047.048166:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082044200/0xca7fc0c411f93be6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee111c expref: 33 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797047.048487:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3400/0xca7fc0c411f93bbc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1115 expref: 32 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797047.048505:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2a00/0xca7fc0c411f93b84 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1107 expref: 31 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797047.048516:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cb058766200) 00010000:00010000:1.0:1788797047.048528:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788797047.048551:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045400/0xca7fc0c411f93bf4 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797047.048565:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045400/0xca7fc0c411f93bf4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797047.048593:0:5826:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045400/0xca7fc0c411f93bf4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797047.048608:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045600/0xca7fc0c411f93bfb lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797047.048616:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045600/0xca7fc0c411f93bfb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797047.048623:0:5826:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045600/0xca7fc0c411f93bfb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797047.048864:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045200/0xca7fc0c411f93c02 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797047.048873:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045200/0xca7fc0c411f93c02 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797047.048880:0:5826:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045200/0xca7fc0c411f93c02 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1788797047.049408:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:1.0:1788797047.053088:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8472 00000004:00080000:1.0:1788797047.053104:0:5826:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 336059074991ns, next at 337059071064ns, rc = 0 00010000:00010000:1.0:1788797047.053204:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082044600/0xca7fc0c411f93c09 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797047.053224:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082044600/0xca7fc0c411f93c09 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797047.053239:0:5826:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082044600/0xca7fc0c411f93c09 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797047.053268:0:5826:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082044600/0xca7fc0c411f93c09 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797047.053275:0:5826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082044600/0xca7fc0c411f93c09 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797047.053282:0:5826:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082044600/0xca7fc0c411f93c09 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797047.053319:0:5826:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788797047.053349:0:5826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045200/0xca7fc0c411f93c02 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797047.053355:0:5826:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045200/0xca7fc0c411f93c02 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797047.053361:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045200/0xca7fc0c411f93c02 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797047.053365:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb082045200 already unused, calling callback (ffffffffc1f014f0) 00010000:00010000:1.0:1788797047.053369:0:5826:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045200/0xca7fc0c411f93c02 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797047.053377:0:5826:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045200/0xca7fc0c411f93c02 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797047.053388:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cb06ce84200) 00010000:00010000:1.0:1788797047.053391:0:5826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788797047.053396:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045200/0xca7fc0c411f93c02 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797047.053423:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045200/0xca7fc0c411f93c02 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797047.053443:0:5826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045400/0xca7fc0c411f93bf4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797047.053450:0:5826:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045400/0xca7fc0c411f93bf4 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797047.053457:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045400/0xca7fc0c411f93bf4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797047.053461:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb082045400 already unused, calling callback (ffffffffc1f014f0) 00010000:00010000:1.0:1788797047.053464:0:5826:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045400/0xca7fc0c411f93bf4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797047.053470:0:5826:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045400/0xca7fc0c411f93bf4 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797047.053478:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8cb06ce84d00) 00010000:00010000:1.0:1788797047.053480:0:5826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788797047.053483:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045400/0xca7fc0c411f93bf4 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797047.053488:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045400/0xca7fc0c411f93bf4 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788797047.053497:0:5826:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007bfc8e3c reply state 00000000df4d0b4f transno 4294967375 ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045600/0xca7fc0c411f93bfb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788797047.053506:0:5826:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788797047.053605:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb050386a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6d050bb-169e-4784-be5b-7071799bf3b0+32:10517:x1875689351462656:12345-192.168.204.38@tcp:36:rm.0 Request processed in 5622us (6034us total) trans 4294967375 rc 0/0 00000100:00100000:1.0:1788797047.053614:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 95 00010000:00010000:2.0:1788797047.054064:0:5814:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788797047.054071:0:5814:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082044600/0xca7fc0c411f93c09 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797047.054077:0:5814:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb082044600 already unused, calling callback (ffffffffc14d98b0) 00010000:00010000:2.0:1788797047.054080:0:5814:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082044600/0xca7fc0c411f93c09 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797047.054086:0:5814:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082044600/0xca7fc0c411f93c09 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797047.054096:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cb06ce84200) 00010000:00010000:2.0:1788797047.054099:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788797047.054102:0:5814:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082044600/0xca7fc0c411f93c09 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797047.054108:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082044600/0xca7fc0c411f93c09 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797047.054137:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788797047.054139:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788797047.054141:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788797047.065064:0:3286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045600/0xca7fc0c411f93bfb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797047.065087:0:3286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045600/0xca7fc0c411f93bfb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797047.065096:0:3286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045600/0xca7fc0c411f93bfb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797047.065123:0:3286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb082045600 already unused, calling callback (ffffffffc1f014f0) 00010000:00010000:0.0:1788797047.065130:0:3286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045600/0xca7fc0c411f93bfb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797047.065139:0:3286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045600/0xca7fc0c411f93bfb lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797047.065157:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8cb06ce84e00) 00010000:00010000:0.0:1788797047.065161:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788797047.065167:0:3286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045600/0xca7fc0c411f93bfb lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797047.065175:0:3286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045600/0xca7fc0c411f93bfb lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788797047.143110:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1788797047.143186:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351462912 00000100:00100000:0.0:1788797047.143209:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351462912 00000100:00100000:0.0:1788797047.143277:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 96 00000100:00100000:0.0:1788797047.143288:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb050384000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6d050bb-169e-4784-be5b-7071799bf3b0+31:10523:x1875689351462912:12345-192.168.204.38@tcp:101:bash.0 00010000:00010000:0.0:1788797047.143321:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788797047.143341:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2600/0xca7fc0c411f93c10 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c99e04559ee1123 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797047.143488:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2400/0xca7fc0c411f93c17 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797047.143504:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2400/0xca7fc0c411f93c17 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797047.143527:0:5827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2400/0xca7fc0c411f93c17 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797047.143541:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2c00/0xca7fc0c411f93c1e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797047.143548:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2c00/0xca7fc0c411f93c1e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797047.143555:0:5827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2c00/0xca7fc0c411f93c1e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788797047.144148:0:5827:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3:0x0], index 1: 0 00010000:00010000:0.0:1788797047.144316:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2800/0xca7fc0c411f93c25 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797047.144327:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2800/0xca7fc0c411f93c25 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797047.144335:0:5827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2800/0xca7fc0c411f93c25 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797047.144369:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2400/0xca7fc0c411f93c17 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797047.144377:0:5827:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2400/0xca7fc0c411f93c17 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797047.144384:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2400/0xca7fc0c411f93c17 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797047.144391:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb042ea2400 already unused, calling callback (ffffffffc1f014f0) 00010000:00010000:0.0:1788797047.144401:0:5827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2400/0xca7fc0c411f93c17 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797047.144409:0:5827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2400/0xca7fc0c411f93c17 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797047.144421:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8cb06ce84d00) 00010000:00010000:0.0:1788797047.144425:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788797047.144431:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2400/0xca7fc0c411f93c17 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797047.144439:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2400/0xca7fc0c411f93c17 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788797047.144454:0:5827:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000dba9a1f2 reply state 00000000da1f1e66 transno 4294967376 ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2c00/0xca7fc0c411f93c1e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788797047.144463:0:5827:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788797047.144495:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2600/0xca7fc0c411f93c10 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1123 expref: 34 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797047.144509:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2800/0xca7fc0c411f93c25 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1123 expref: 33 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797047.144517:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8cb058766b00) 00010000:00010000:0.0:1788797047.144519:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788797047.144521:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb042ea2800, rc 0) 00000100:00100000:0.0:1788797047.144653:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb050384000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6d050bb-169e-4784-be5b-7071799bf3b0+34:10523:x1875689351462912:12345-192.168.204.38@tcp:101:bash.0 Request processed in 1366us (1552us total) trans 4294967376 rc 0/0 00000100:00100000:0.0:1788797047.144662:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 96 00010000:00010000:1.0:1788797047.148065:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2c00/0xca7fc0c411f93c1e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797047.148084:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2c00/0xca7fc0c411f93c1e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797047.148092:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2c00/0xca7fc0c411f93c1e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797047.148099:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb042ea2c00 already unused, calling callback (ffffffffc1f014f0) 00010000:00010000:1.0:1788797047.148104:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2c00/0xca7fc0c411f93c1e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797047.148112:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2c00/0xca7fc0c411f93c1e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797047.148128:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8cb058766700) 00010000:00010000:1.0:1788797047.148131:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788797047.148135:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2c00/0xca7fc0c411f93c1e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797047.148141:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2c00/0xca7fc0c411f93c1e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788797047.148537:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1788797047.148610:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351463040 00000100:00100000:3.0:1788797047.148621:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351463040 00000100:00100000:3.0:1788797047.148781:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 35 00000100:00100000:3.0:1788797047.148793:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb050385180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e6d050bb-169e-4784-be5b-7071799bf3b0+7:2354:x1875689351463040:12345-192.168.204.38@tcp:101:bash.0 00010000:00010000:3.0:1788797047.148812:0:6684:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788797047.148831:0:6684:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000043da56de/0xca7fc0c411f93c33 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7c99e04559ee112a expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788797047.148855:0:6684:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788797047.148884:0:6684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=336s v=(0 0) 00010000:00010000:3.0:1788797047.148889:0:6684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788797047.148911:0:6684:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000043da56de/0xca7fc0c411f93c33 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee112a expref: 8 pid: 6684 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797047.148933:0:6684:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000043da56de/0xca7fc0c411f93c33 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee112a expref: 8 pid: 6684 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797047.148946:0:6684:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb077c69800, rc 0) 00000100:00100000:3.0:1788797047.149009:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb050385180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e6d050bb-169e-4784-be5b-7071799bf3b0+8:2354:x1875689351463040:12345-192.168.204.38@tcp:101:bash.0 Request processed in 219us (476us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797047.149055:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 35 00000100:00100000:1.0:1788797047.151709:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1788797047.152193:0:10829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351463168 00000100:00100000:2.0:1788797047.152204:0:10829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351463168 00000100:00100000:2.0:1788797047.152274:0:10829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 36 00000100:00100000:2.0:1788797047.152286:0:10829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb050382a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e6d050bb-169e-4784-be5b-7071799bf3b0+8:10523:x1875689351463168:12345-192.168.204.38@tcp:101:bash.0 00010000:00010000:2.0:1788797047.152494:0:10829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788797047.152514:0:10829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c081d453/0xca7fc0c411f93c3a lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7c99e04559ee1131 expref: -99 pid: 10829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797047.152549:0:10829:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000043da56de/0xca7fc0c411f93c33 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee112a expref: 9 pid: 6684 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797047.152558:0:10829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788797047.152562:0:10829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788797047.152568:0:10829:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c081d453/0xca7fc0c411f93c3a lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1131 expref: 9 pid: 10829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797047.152605:0:10829:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000043da56de/0xca7fc0c411f93c33 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee112a expref: 9 pid: 6684 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797047.152620:0:10829:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000043da56de/0xca7fc0c411f93c33 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee112a expref: 9 pid: 6684 timeout: 436 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788797047.152652:0:10829:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb050384a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10829:1875689374548608:192.168.204.38@tcp:104: 00000100:00100000:2.0:1788797047.152775:0:10829:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb069810f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788797047.156332:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1788797047.156594:0:10829:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb050384a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10829:1875689374548608:192.168.204.38@tcp:104: 00010000:00010000:2.0:1788797047.156629:0:10829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c081d453/0xca7fc0c411f93c3a lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1131 expref: 9 pid: 10829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797047.156650:0:10829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb041484000, rc 0) 00000100:00100000:2.0:1788797047.156707:0:10829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb050382a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e6d050bb-169e-4784-be5b-7071799bf3b0+9:10523:x1875689351463168:12345-192.168.204.38@tcp:101:bash.0 Request processed in 4425us (5010us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797047.156717:0:10829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 36 00000100:00100000:3.0:1788797047.156801:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351463296 00000100:00100000:3.0:1788797047.156809:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351463296 00010000:00010000:3.0:1788797047.156841:0:5813:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000043da56de/0xca7fc0c411f93c33 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee112a expref: 9 pid: 6684 timeout: 436 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788797047.156876:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 49 00000100:00100000:3.0:1788797047.156885:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb042ed8050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e6d050bb-169e-4784-be5b-7071799bf3b0+9:2354:x1875689351463296:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788797047.156910:0:5813:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788797047.156931:0:5813:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000043da56de/0xca7fc0c411f93c33 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee112a expref: 9 pid: 6684 timeout: 436 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797047.156944:0:5813:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000043da56de/0xca7fc0c411f93c33 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee112a expref: 9 pid: 6684 timeout: 436 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797047.156967:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000043da56de/0xca7fc0c411f93c33 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee112a expref: 9 pid: 6684 timeout: 436 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797047.156982:0:5813:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788797047.156986:0:5813:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788797047.156995:0:5813:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c081d453/0xca7fc0c411f93c3a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1131 expref: 8 pid: 10829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797047.157005:0:5813:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c081d453/0xca7fc0c411f93c3a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1131 expref: 8 pid: 10829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797047.157092:0:5813:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000c081d453/0xca7fc0c411f93c3a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1131 expref: 8 pid: 10829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788797047.157105:0:5813:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb048e29f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5813:1875689374548736:192.168.204.38@tcp:105: 00000100:00100000:3.0:1788797047.157173:0:5813:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb0503cfe40 going to sleep for 11 seconds 00000100:00100000:1.0:1788797047.161430:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1788797047.161585:0:5813:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb048e29f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5813:1875689374548736:192.168.204.38@tcp:105: 00010000:00010000:3.0:1788797047.161611:0:5813:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788797047.161671:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb042ed8050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e6d050bb-169e-4784-be5b-7071799bf3b0+8:2354:x1875689351463296:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 4787us (5352us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797047.161683:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 49 00000100:00100000:2.0:1788797047.162002:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351463552 00000100:00100000:2.0:1788797047.162009:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351463552 00000100:00100000:2.0:1788797047.162092:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 25 00000100:00100000:2.0:1788797047.162101:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb050380000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e6d050bb-169e-4784-be5b-7071799bf3b0+33:10523:x1875689351463552:12345-192.168.204.38@tcp:35:bash.0 00000100:00100000:2.0:1788797047.162461:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb050380000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e6d050bb-169e-4784-be5b-7071799bf3b0+34:10523:x1875689351463552:12345-192.168.204.38@tcp:35:bash.0 Request processed in 360us (1038us total) trans 4294967377 rc 0/0 00000100:00100000:2.0:1788797047.162469:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 25 00000100:00100000:1.0:1788797047.393501:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1788797047.393659:0:7636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351463680 00000100:00100000:0.0:1788797047.393673:0:7636:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351463680 00000100:00100000:0.0:1788797047.393766:0:7636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 97 00000100:00100000:0.0:1788797047.393779:0:7636:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb050381180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6d050bb-169e-4784-be5b-7071799bf3b0+34:10539:x1875689351463680:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1788797047.393805:0:7636:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788797047.393830:0:7636:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2400/0xca7fc0c411f93c41 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c99e04559ee1138 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797047.393917:0:7636:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2200/0xca7fc0c411f93c48 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797047.393932:0:7636:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2200/0xca7fc0c411f93c48 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797047.393947:0:7636:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2200/0xca7fc0c411f93c48 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788797047.393987:0:7636:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:0.0:1788797047.393992:0:7636:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788797047.394123:0:7636:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2200/0xca7fc0c411f93c48 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797047.394152:0:7636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2400/0xca7fc0c411f93c41 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1138 expref: 36 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797047.394173:0:7636:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2200/0xca7fc0c411f93c48 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1138 expref: 35 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797047.394183:0:7636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8cb06ce84d00) 00010000:00010000:0.0:1788797047.394272:0:7636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788797047.394278:0:7636:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb042ea2200, rc 0) 00000100:00100000:0.0:1788797047.394354:0:7636:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb050381180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6d050bb-169e-4784-be5b-7071799bf3b0+35:10539:x1875689351463680:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 579us (867us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797047.394488:0:7636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 97 00000100:00100000:1.0:1788797047.398258:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1788797047.398418:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351463936 00000100:00100000:3.0:1788797047.398430:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351463936 00000100:00100000:3.0:1788797047.398482:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 98 00000100:00100000:3.0:1788797047.398494:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb050381500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6d050bb-169e-4784-be5b-7071799bf3b0+35:10539:x1875689351463936:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1788797047.398521:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788797047.398544:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c68200/0xca7fc0c411f93c4f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c99e04559ee113f expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797047.398659:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69c00/0xca7fc0c411f93c56 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797047.398673:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69c00/0xca7fc0c411f93c56 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797047.398686:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69c00/0xca7fc0c411f93c56 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788797047.398710:0:5825:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:3.0:1788797047.398850:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c68200/0xca7fc0c411f93c4f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee113f expref: 38 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797047.398871:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69c00/0xca7fc0c411f93c56 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee113f expref: 37 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797047.398880:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8cb058766b00) 00010000:00010000:3.0:1788797047.398884:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788797047.398888:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb077c69c00, rc 0) 00000100:00100000:3.0:1788797047.398968:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb050381500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6d050bb-169e-4784-be5b-7071799bf3b0+37:10539:x1875689351463936:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 476us (720us total) trans 4294967378 rc 0/0 00000100:00100000:3.0:1788797047.398975:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 98 00000100:00100000:3.0:1788797047.403667:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1788797047.403715:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1788797047.403821:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351464320 00000100:00100000:1.0:1788797047.403834:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351464320 00000100:00100000:1.0:1788797047.403923:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 6 00000100:00100000:1.0:1788797047.403936:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb048e29f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e6d050bb-169e-4784-be5b-7071799bf3b0+37:2352:x1875689351464320:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788797047.403958:0:5812:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788797047.403990:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69c00/0xca7fc0c411f93c56 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee113f expref: 37 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797047.404012:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8cb058766b00) 00010000:00010000:1.0:1788797047.404017:0:5812:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788797047.404132:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb048e29f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e6d050bb-169e-4784-be5b-7071799bf3b0+36:2352:x1875689351464320:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 199us (417us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797047.404140:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 6 00000100:00100000:0.0:1788797047.404922:0:7636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351464192 00000100:00100000:0.0:1788797047.404934:0:7636:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351464192 00000100:00100000:0.0:1788797047.404991:0:7636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 99 00000100:00100000:0.0:1788797047.405000:0:7636:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb048e2ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6d050bb-169e-4784-be5b-7071799bf3b0+36:10539:x1875689351464192:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1788797047.405047:0:7636:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788797047.405068:0:7636:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2400/0xca7fc0c411f93c64 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c99e04559ee1146 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797047.405467:0:7636:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3e00/0xca7fc0c411f93c6b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797047.405486:0:7636:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3e00/0xca7fc0c411f93c6b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797047.405499:0:7636:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3e00/0xca7fc0c411f93c6b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788797047.405514:0:7636:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:0.0:1788797047.405789:0:7636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2400/0xca7fc0c411f93c64 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1146 expref: 39 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797047.405807:0:7636:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3e00/0xca7fc0c411f93c6b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1146 expref: 38 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797047.405838:0:7636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8cb058766b00) 00010000:00010000:0.0:1788797047.405841:0:7636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1788797047.405845:0:7636:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb042ea3e00, rc 0) 00000100:00100000:0.0:1788797047.405923:0:7636:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb048e2ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6d050bb-169e-4784-be5b-7071799bf3b0+38:10539:x1875689351464192:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 924us (2270us total) trans 4294967379 rc 0/0 00000100:00100000:0.0:1788797047.405932:0:7636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 99 00000100:00100000:1.0:1788797047.411600:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1788797047.412229:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351464448 00000100:00100000:2.0:1788797047.412243:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351464448 00000100:00100000:2.0:1788797047.412314:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 37 00000100:00100000:2.0:1788797047.412326:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb050381880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e6d050bb-169e-4784-be5b-7071799bf3b0+8:2353:x1875689351464448:12345-192.168.204.38@tcp:1:lfs.0 00010000:00010000:2.0:1788797047.412378:0:6681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ae867b02/0xca7fc0c411f93c79 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797047.412425:0:6681:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c081d453/0xca7fc0c411f93c3a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1131 expref: 8 pid: 10829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797047.412435:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788797047.412440:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788797047.412445:0:6681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ae867b02/0xca7fc0c411f93c79 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797047.412494:0:6681:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c081d453/0xca7fc0c411f93c3a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1131 expref: 8 pid: 10829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797047.412510:0:6681:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c081d453/0xca7fc0c411f93c3a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1131 expref: 8 pid: 10829 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788797047.412526:0:6681:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb050384a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6681:1875689374548864:192.168.204.38@tcp:104: 00000100:00100000:2.0:1788797047.412773:0:6681:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb069810f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788797047.415597:0:6681:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb050384a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6681:1875689374548864:192.168.204.38@tcp:104: 00010000:00010000:2.0:1788797047.415631:0:6681:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000ae867b02/0xca7fc0c411f93c79 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788797047.418249:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1788797047.418809:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351464576 00000100:00100000:1.0:1788797047.418820:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351464576 00002000:00100000:1.0:1788797047.418869:0:6688:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff8cb048e2aa00 x1875689351464576/t0(0) o4->e6d050bb-169e-4784-be5b-7071799bf3b0@192.168.204.38@tcp:473/0 lens 504/0 e 0 to 0 dl 1788797058 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788797047.418879:0:6688:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8cb048e2aa00 with x1875689351464576 ext(0->8) 00010000:00010000:1.0:1788797047.418887:0:6688:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000c081d453/0xca7fc0c411f93c3a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1131 expref: 9 pid: 10829 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797047.418916:0:6688:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000c081d453/0xca7fc0c411f93c3a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1131 expref: 9 pid: 10829 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788797047.418924:0:6688:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8cb048e2aa00 00000100:00100000:1.0:1788797047.418958:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1 00000100:00100000:1.0:1788797047.418983:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb048e2aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:e6d050bb-169e-4784-be5b-7071799bf3b0+9:2354:x1875689351464576:12345-192.168.204.38@tcp:4:lfs.0 00000100:00100000:1.0:1788797047.419932:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb048e2aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:e6d050bb-169e-4784-be5b-7071799bf3b0+11:2354:x1875689351464576:12345-192.168.204.38@tcp:4:lfs.0 Request processed in 946us (1690us total) trans 4294967302 rc 0/0 00000100:00100000:1.0:1788797047.419944:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1 00002000:00100000:1.0:1788797047.419952:0:6688:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff8cb048e2aa00 x1875689351464576/t4294967302(0) o4->e6d050bb-169e-4784-be5b-7071799bf3b0@192.168.204.38@tcp:473/0 lens 504/448 e 0 to 0 dl 1788797058 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788797047.419961:0:6688:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8cb048e2aa00 with x1875689351464576 ext(0->8) 00010000:00010000:1.0:1788797047.419968:0:6688:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000c081d453/0xca7fc0c411f93c3a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1131 expref: 11 pid: 10829 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797047.419982:0:6688:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000c081d453/0xca7fc0c411f93c3a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1131 expref: 11 pid: 10829 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788797047.419989:0:6688:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8cb048e2aa00 00000100:00100000:2.0:1788797047.423397:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1788797047.423500:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351464704 00000100:00100000:0.0:1788797047.423513:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351464704 00010000:00010000:0.0:1788797047.423557:0:5811:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c081d453/0xca7fc0c411f93c3a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1131 expref: 11 pid: 10829 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788797047.423756:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 50 00000100:00100000:0.0:1788797047.423768:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb050384a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e6d050bb-169e-4784-be5b-7071799bf3b0+11:2352:x1875689351464704:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788797047.423808:0:5811:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1788797047.423832:0:5811:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1788797047.423835:0:5811:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1788797047 00002000:00010000:0.0:1788797047.423839:0:5811:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 1788797047 00002000:00010000:0.0:1788797047.423841:0:5811:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 0 -> 1788797047 00010000:00010000:0.0:1788797047.423847:0:5811:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c081d453/0xca7fc0c411f93c3a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1131 expref: 11 pid: 10829 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797047.423862:0:5811:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c081d453/0xca7fc0c411f93c3a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1131 expref: 11 pid: 10829 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797047.423889:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c081d453/0xca7fc0c411f93c3a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1131 expref: 11 pid: 10829 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797047.423944:0:5811:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788797047.423949:0:5811:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788797047.423956:0:5811:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ae867b02/0xca7fc0c411f93c79 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797047.423965:0:5811:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ae867b02/0xca7fc0c411f93c79 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797047.423999:0:5811:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788797047.424082:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb050384a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e6d050bb-169e-4784-be5b-7071799bf3b0+10:2352:x1875689351464704:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 317us (697us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797047.424090:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 50 00010000:00010000:3.0:1788797047.424382:0:6681:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000ae867b02/0xca7fc0c411f93c79 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797047.424395:0:6681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ae867b02/0xca7fc0c411f93c79 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797047.424420:0:6681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ae867b02/0xca7fc0c411f93c79 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797047.424429:0:6681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ae867b02/0xca7fc0c411f93c79 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797047.424445:0:6681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ae867b02/0xca7fc0c411f93c79 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797047.424452:0:6681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb041485c00 already unused, calling callback (ffffffffc14d98b0) 00010000:00010000:3.0:1788797047.424456:0:6681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ae867b02/0xca7fc0c411f93c79 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797047.424465:0:6681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ae867b02/0xca7fc0c411f93c79 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797047.424477:0:6681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ae867b02/0xca7fc0c411f93c79 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797047.424485:0:6681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ae867b02/0xca7fc0c411f93c79 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788797047.424529:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb050381880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e6d050bb-169e-4784-be5b-7071799bf3b0+9:2353:x1875689351464448:12345-192.168.204.38@tcp:1:lfs.0 Request processed in 12206us (12951us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797047.424535:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 37 00000100:00100000:3.0:1788797047.426806:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1788797047.427242:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351464960 00000100:00100000:2.0:1788797047.427255:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351464960 00000100:00100000:2.0:1788797047.427325:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 26 00000100:00100000:2.0:1788797047.427336:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb050634850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e6d050bb-169e-4784-be5b-7071799bf3b0+38:10539:x1875689351464960:12345-192.168.204.38@tcp:35:lfs.0 00000004:00010000:2.0:1788797047.427418:0:5829:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3e00/0xca7fc0c411f93c6b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1146 expref: 38 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788797047.427938:0:5829:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967380 00000001:00080000:2.0:1788797047.427983:0:5829:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967381 00000001:00080000:2.0:1788797047.428578:0:5829:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00010000:00010000:2.0:1788797047.428847:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484c00/0xca7fc0c411f93c80 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797047.428864:0:5829:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2800/0xca7fc0c411f93c25 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1123 expref: 42 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797047.428873:0:5829:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484c00/0xca7fc0c411f93c80 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797047.428922:0:5829:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2800/0xca7fc0c411f93c25 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1123 expref: 42 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797047.428940:0:5829:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2800/0xca7fc0c411f93c25 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1123 expref: 42 pid: 5827 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788797047.428956:0:5829:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb050386300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5829:1875689374548992:192.168.204.38@tcp:104: 00000100:00100000:2.0:1788797047.429171:0:5829:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb0467de000 going to sleep for 11 seconds 00000100:00100000:3.0:1788797047.434507:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1788797047.434602:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351465088 00000100:00100000:0.0:1788797047.434614:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351465088 00010000:00010000:0.0:1788797047.434667:0:5813:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2800/0xca7fc0c411f93c25 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1123 expref: 43 pid: 5827 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788797047.434713:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 51 00000100:00100000:0.0:1788797047.434725:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb048e2b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e6d050bb-169e-4784-be5b-7071799bf3b0+43:2354:x1875689351465088:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788797047.434743:0:5813:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788797047.434751:0:5813:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2800/0xca7fc0c411f93c25 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1123 expref: 43 pid: 5827 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797047.434766:0:5813:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2800/0xca7fc0c411f93c25 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1123 expref: 43 pid: 5827 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797047.434814:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8cb058766b00) 00010000:00010000:0.0:1788797047.434820:0:5813:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484c00/0xca7fc0c411f93c80 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797047.434830:0:5813:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484c00/0xca7fc0c411f93c80 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797047.434839:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484c00/0xca7fc0c411f93c80 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797047.434861:0:5813:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788797047.434979:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb048e2b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e6d050bb-169e-4784-be5b-7071799bf3b0+43:2354:x1875689351465088:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 256us (484us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797047.434987:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 51 00010000:00010000:2.0:1788797047.435195:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2800/0xca7fc0c411f93c25 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1123 expref: 42 pid: 5827 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788797047.435229:0:5829:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb050386300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5829:1875689374548992:192.168.204.38@tcp:104: 00010000:00010000:2.0:1788797047.435252:0:5829:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484c00/0xca7fc0c411f93c80 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797047.435268:0:5829:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484c00/0xca7fc0c411f93c80 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797047.435274:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484c00/0xca7fc0c411f93c80 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788797047.435404:0:5829:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:2.0:1788797047.435691:0:5829:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00000100:00100000:2.0:1788797047.435814:0:5829:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb050386300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5829:1875689374549120:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1788797047.435865:0:5829:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788797047.435990:0:5829:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb0467de000 going to sleep for 11 seconds 00000100:00100000:1.0:1788797047.437569:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374549120 00000100:00100000:1.0:1788797047.437584:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374549120 00000100:00100000:2.0:1788797047.437720:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788797047.437732:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb050386d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5829:x1875689374549120:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1788797047.437867:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb050386d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5829:x1875689374549120:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 137us (2000us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797047.437876:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788797047.437991:0:5829:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb050386300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5829:1875689374549120:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1788797047.438619:0:5829:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000100:00100000:0.0:1788797047.438720:0:5829:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb047c18700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5829:1875689374549248:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1788797047.438774:0:5829:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788797047.438803:0:5829:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb069810480 going to sleep for 11 seconds 00000100:00100000:2.0:1788797047.439051:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374549248 00000100:00100000:2.0:1788797047.439058:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374549248 00000100:00100000:2.0:1788797047.439091:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788797047.439098:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb047c1a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5829:x1875689374549248:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1788797047.439389:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb047c1a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+8:5829:x1875689374549248:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 291us (614us total) trans 4294967303 rc 0/0 00000100:00100000:2.0:1788797047.439397:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788797047.439478:0:5829:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb047c18700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5829:1875689374549248:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1788797047.439537:0:5829:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00010000:00010000:0.0:1788797047.439579:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484c00/0xca7fc0c411f93c80 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797047.439590:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484c00/0xca7fc0c411f93c80 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797047.439599:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484c00/0xca7fc0c411f93c80 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797047.439615:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb041484c00 already unused, calling callback (ffffffffc1f014f0) 00010000:00010000:0.0:1788797047.439620:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484c00/0xca7fc0c411f93c80 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797047.439628:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484c00/0xca7fc0c411f93c80 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797047.439647:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8cb058766b00) 00010000:00010000:0.0:1788797047.439649:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1788797047.439655:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484c00/0xca7fc0c411f93c80 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797047.439661:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484c00/0xca7fc0c411f93c80 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788797047.439857:0:5829:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1788797047.443766:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 64 off8384 00000004:00080000:0.0:1788797047.443796:0:5829:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 336449766359ns, next at 337449759396ns, rc = 0 00000001:00080000:0.0:1788797047.443814:0:5829:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00010000:00010000:0.0:1788797047.443903:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8cb058766b00) 00010000:00010000:0.0:1788797047.443908:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1788797047.443921:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3e00/0xca7fc0c411f93c6b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1146 expref: 46 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788797047.444125:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb050634850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e6d050bb-169e-4784-be5b-7071799bf3b0+45:10539:x1875689351464960:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 16788us (17328us total) trans 4294967388 rc 0/0 00000100:00100000:0.0:1788797047.444136:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 26 00000020:00080000:0.0:1788797047.444143:0:5829:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1788797047.448691:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1788797047.448785:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351465216 00000100:00100000:0.0:1788797047.448795:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351465216 00000100:00100000:0.0:1788797047.448901:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 100 00000100:00100000:0.0:1788797047.448912:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb07797a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6d050bb-169e-4784-be5b-7071799bf3b0+45:10539:x1875689351465216:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1788797047.448939:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788797047.448964:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2400/0xca7fc0c411f93c87 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c99e04559ee114d expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797047.449061:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2400/0xca7fc0c411f93c87 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee114d expref: 46 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797047.449077:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2400/0xca7fc0c411f93c87 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee114d expref: 46 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797047.449101:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8cb058766700) 00010000:00010000:0.0:1788797047.449105:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788797047.449109:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb042ea2400, rc 0) 00000100:00100000:0.0:1788797047.449175:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb07797a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6d050bb-169e-4784-be5b-7071799bf3b0+46:10539:x1875689351465216:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 265us (495us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797047.449183:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 100 00000100:00100000:3.0:1788797047.452145:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1788797047.452272:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351465472 00000100:00100000:2.0:1788797047.452286:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351465472 00000100:00100000:2.0:1788797047.452345:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 27 00000100:00100000:2.0:1788797047.452355:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb07902ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e6d050bb-169e-4784-be5b-7071799bf3b0+46:10539:x1875689351465472:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:2.0:1788797047.452637:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb07902ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e6d050bb-169e-4784-be5b-7071799bf3b0+47:10539:x1875689351465472:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 283us (501us total) trans 4294967389 rc 0/0 00000100:00100000:2.0:1788797047.452645:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 27 00000100:00100000:2.0:1788797047.560144:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1788797047.560269:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351465600 00000100:00100000:1.0:1788797047.560281:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351465600 00000100:00100000:1.0:1788797047.560355:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 101 00000100:00100000:1.0:1788797047.560366:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb050385880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6d050bb-169e-4784-be5b-7071799bf3b0+47:10549:x1875689351465600:12345-192.168.204.38@tcp:34:lfs.0 00010000:00010000:1.0:1788797047.560440:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045200/0xca7fc0c411f93c8e lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797047.560460:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045200/0xca7fc0c411f93c8e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797047.560473:0:5826:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045200/0xca7fc0c411f93c8e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797047.560508:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045400/0xca7fc0c411f93c95 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797047.560517:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045400/0xca7fc0c411f93c95 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797047.560524:0:5826:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045400/0xca7fc0c411f93c95 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797047.560620:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082044200/0xca7fc0c411f93c9c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797047.560629:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082044200/0xca7fc0c411f93c9c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797047.560636:0:5826:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082044200/0xca7fc0c411f93c9c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788797047.560690:0:5826:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082044200/0xca7fc0c411f93c9c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797047.560704:0:5826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045200/0xca7fc0c411f93c8e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797047.560710:0:5826:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045200/0xca7fc0c411f93c8e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797047.560718:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045200/0xca7fc0c411f93c8e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797047.560739:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb082045200 already unused, calling callback (ffffffffc1f014f0) 00010000:00010000:1.0:1788797047.560744:0:5826:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045200/0xca7fc0c411f93c8e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797047.560760:0:5826:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045200/0xca7fc0c411f93c8e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797047.560776:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8cb06ce84d00) 00010000:00010000:1.0:1788797047.560779:0:5826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788797047.560786:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045200/0xca7fc0c411f93c8e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797047.560792:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045200/0xca7fc0c411f93c8e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797047.560808:0:5826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045400/0xca7fc0c411f93c95 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797047.560813:0:5826:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045400/0xca7fc0c411f93c95 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797047.560819:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045400/0xca7fc0c411f93c95 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797047.560824:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb082045400 already unused, calling callback (ffffffffc1f014f0) 00010000:00010000:1.0:1788797047.560826:0:5826:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045400/0xca7fc0c411f93c95 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797047.560831:0:5826:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045400/0xca7fc0c411f93c95 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797047.560839:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8cb06ce84100) 00010000:00010000:1.0:1788797047.560841:0:5826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788797047.560844:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045400/0xca7fc0c411f93c95 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797047.560859:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045400/0xca7fc0c411f93c95 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797047.560873:0:5826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082044200/0xca7fc0c411f93c9c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797047.560879:0:5826:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082044200/0xca7fc0c411f93c9c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797047.560885:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082044200/0xca7fc0c411f93c9c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797047.560901:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb082044200 already unused, calling callback (ffffffffc1f014f0) 00010000:00010000:1.0:1788797047.560904:0:5826:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082044200/0xca7fc0c411f93c9c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797047.560909:0:5826:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082044200/0xca7fc0c411f93c9c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797047.560917:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8cb058766700) 00010000:00010000:1.0:1788797047.560919:0:5826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788797047.560922:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082044200/0xca7fc0c411f93c9c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797047.560928:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082044200/0xca7fc0c411f93c9c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788797047.561015:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb050385880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6d050bb-169e-4784-be5b-7071799bf3b0+47:10549:x1875689351465600:12345-192.168.204.38@tcp:34:lfs.0 Request processed in 649us (880us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797047.561023:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 101 00010000:00010000:0.0:1788797047.602359:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788797047.602526:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1788797047.602614:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351465856 00000100:00100000:1.0:1788797047.602633:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351465856 00000100:00100000:1.0:1788797047.602716:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 102 00000100:00100000:1.0:1788797047.602729:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb07902b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6d050bb-169e-4784-be5b-7071799bf3b0+47:10552:x1875689351465856:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1788797047.602758:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788797047.602784:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082044200/0xca7fc0c411f93ca3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c99e04559ee1154 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797047.602907:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045400/0xca7fc0c411f93caa lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797047.602926:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045400/0xca7fc0c411f93caa lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797047.602940:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045400/0xca7fc0c411f93caa lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797047.602957:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045200/0xca7fc0c411f93cb1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797047.602966:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045200/0xca7fc0c411f93cb1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797047.602972:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045200/0xca7fc0c411f93cb1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797047.603141:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045e00/0xca7fc0c411f93cb8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797047.603150:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045e00/0xca7fc0c411f93cb8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797047.603171:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045e00/0xca7fc0c411f93cb8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788797047.603733:0:5825:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:1.0:1788797047.603849:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045400/0xca7fc0c411f93caa lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797047.603858:0:5825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045400/0xca7fc0c411f93caa lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797047.603865:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045400/0xca7fc0c411f93caa lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797047.603871:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb082045400 already unused, calling callback (ffffffffc1f014f0) 00010000:00010000:1.0:1788797047.603876:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045400/0xca7fc0c411f93caa lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797047.603883:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045400/0xca7fc0c411f93caa lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797047.603908:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8cb06ce84d00) 00010000:00010000:1.0:1788797047.603912:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788797047.603916:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045400/0xca7fc0c411f93caa lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797047.603923:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045400/0xca7fc0c411f93caa lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797047.603937:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045200/0xca7fc0c411f93cb1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797047.603942:0:5825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045200/0xca7fc0c411f93cb1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797047.603955:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045200/0xca7fc0c411f93cb1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797047.603960:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb082045200 already unused, calling callback (ffffffffc1f014f0) 00010000:00010000:1.0:1788797047.603963:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045200/0xca7fc0c411f93cb1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797047.603969:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045200/0xca7fc0c411f93cb1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797047.603977:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8cb06ce84100) 00010000:00010000:1.0:1788797047.603979:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788797047.603982:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045200/0xca7fc0c411f93cb1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797047.603987:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045200/0xca7fc0c411f93cb1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797047.604159:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082044200/0xca7fc0c411f93ca3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1154 expref: 50 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797047.604190:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045e00/0xca7fc0c411f93cb8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1154 expref: 49 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797047.604198:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8cb058766700) 00010000:00010000:1.0:1788797047.604207:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788797047.604211:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb082045e00, rc 0) 00000100:00100000:1.0:1788797047.604314:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb07902b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6d050bb-169e-4784-be5b-7071799bf3b0+49:10552:x1875689351465856:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 1588us (1797us total) trans 4294967390 rc 0/0 00000100:00100000:1.0:1788797047.604331:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 102 00000100:00100000:3.0:1788797047.608770:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1788797047.608998:0:7636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351465984 00000100:00100000:0.0:1788797047.609011:0:7636:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351465984 00000100:00100000:0.0:1788797047.609113:0:7636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 103 00000100:00100000:0.0:1788797047.609142:0:7636:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb06ec6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6d050bb-169e-4784-be5b-7071799bf3b0+49:10552:x1875689351465984:12345-192.168.204.38@tcp:54:lfs.0 00010000:00010000:0.0:1788797047.609230:0:7636:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3e00/0xca7fc0c411f93cc6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797047.609276:0:7636:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3e00/0xca7fc0c411f93cc6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797047.609290:0:7636:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3e00/0xca7fc0c411f93cc6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797047.609323:0:7636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3e00/0xca7fc0c411f93cc6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797047.609332:0:7636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3e00/0xca7fc0c411f93cc6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797047.609340:0:7636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3e00/0xca7fc0c411f93cc6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797047.609348:0:7636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb042ea3e00 already unused, calling callback (ffffffffc1f014f0) 00010000:00010000:0.0:1788797047.609354:0:7636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3e00/0xca7fc0c411f93cc6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797047.609362:0:7636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3e00/0xca7fc0c411f93cc6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797047.609387:0:7636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8cb058766700) 00010000:00010000:0.0:1788797047.609398:0:7636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788797047.609404:0:7636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3e00/0xca7fc0c411f93cc6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797047.609411:0:7636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3e00/0xca7fc0c411f93cc6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788797047.609509:0:7636:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb06ec6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6d050bb-169e-4784-be5b-7071799bf3b0+49:10552:x1875689351465984:12345-192.168.204.38@tcp:54:lfs.0 Request processed in 381us (751us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797047.609523:0:7636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 103 00000100:00100000:1.0:1788797047.612550:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1788797047.612728:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351466240 00000100:00100000:2.0:1788797047.612737:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351466240 00000100:00100000:2.0:1788797047.612833:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 28 00000100:00100000:2.0:1788797047.612845:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb050380000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e6d050bb-169e-4784-be5b-7071799bf3b0+49:10552:x1875689351466240:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:2.0:1788797047.613189:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb050380000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e6d050bb-169e-4784-be5b-7071799bf3b0+50:10552:x1875689351466240:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 346us (647us total) trans 4294967391 rc 0/0 00000100:00100000:2.0:1788797047.613198:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 28 00000100:00100000:3.0:1788797047.731718:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1788797047.731859:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351466496 00000100:00100000:2.0:1788797047.731869:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351466496 00000100:00100000:2.0:1788797047.731941:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 104 00000100:00100000:2.0:1788797047.731952:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb06ec6f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6d050bb-169e-4784-be5b-7071799bf3b0+50:10562:x1875689351466496:12345-192.168.204.38@tcp:101:bash.0 00010000:00010000:2.0:1788797047.731976:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788797047.731979:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788797047.732005:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2200/0xca7fc0c411f93c48 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1138 expref: 50 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797047.732024:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8cb06ce84d00) 00010000:00010000:2.0:1788797047.732089:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788797047.732103:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484000/0xca7fc0c411f93ccd lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c99e04559ee115b expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797047.732209:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041485c00/0xca7fc0c411f93cd4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797047.732236:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041485c00/0xca7fc0c411f93cd4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797047.732247:0:5827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041485c00/0xca7fc0c411f93cd4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788797047.732259:0:5827:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:2.0:1788797047.732400:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484000/0xca7fc0c411f93ccd lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee115b expref: 52 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797047.732415:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041485c00/0xca7fc0c411f93cd4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee115b expref: 51 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797047.732423:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8cb058766700) 00010000:00010000:2.0:1788797047.732425:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788797047.732428:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb041485c00, rc 0) 00000100:00100000:2.0:1788797047.732493:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb06ec6f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6d050bb-169e-4784-be5b-7071799bf3b0+51:10562:x1875689351466496:12345-192.168.204.38@tcp:101:bash.0 Request processed in 543us (786us total) trans 4294967392 rc 0/0 00000100:00100000:2.0:1788797047.732500:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 104 00000100:00100000:3.0:1788797047.738959:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1788797047.739097:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351466752 00000100:00100000:1.0:1788797047.739108:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351466752 00000100:00100000:1.0:1788797047.739159:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 105 00000100:00100000:1.0:1788797047.739170:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb06ec6d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6d050bb-169e-4784-be5b-7071799bf3b0+51:10562:x1875689351466752:12345-192.168.204.38@tcp:36:bash.0 00010000:00010000:1.0:1788797047.739443:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1788797047.739471:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041485c00/0xca7fc0c411f93cd4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee115b expref: 51 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797047.739494:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045e00/0xca7fc0c411f93cb8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1154 expref: 50 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797047.739505:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8cb058766700) 00010000:00010000:1.0:1788797047.739510:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788797047.739732:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082044200/0xca7fc0c411f93ce2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797047.739746:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082044200/0xca7fc0c411f93ce2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797047.739755:0:5826:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082044200/0xca7fc0c411f93ce2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788797047.739800:0:5826:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967393 00000004:00010000:1.0:1788797047.739824:0:5826:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000659ff47 reply state 00000000740d61dc transno 4294967394 ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082044200/0xca7fc0c411f93ce2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788797047.739833:0:5826:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788797047.740095:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb06ec6d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6d050bb-169e-4784-be5b-7071799bf3b0+52:10562:x1875689351466752:12345-192.168.204.38@tcp:36:bash.0 Request processed in 925us (1144us total) trans 4294967394 rc 0/0 00000100:00100000:1.0:1788797047.740103:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 105 00000020:00080000:1.0:1788797047.740109:0:5826:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1788797047.749797:0:3286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082044200/0xca7fc0c411f93ce2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797047.749813:0:3286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082044200/0xca7fc0c411f93ce2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797047.749821:0:3286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082044200/0xca7fc0c411f93ce2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797047.749827:0:3286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb082044200 already unused, calling callback (ffffffffc1f014f0) 00010000:00010000:0.0:1788797047.749831:0:3286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082044200/0xca7fc0c411f93ce2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797047.749838:0:3286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082044200/0xca7fc0c411f93ce2 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797047.749856:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8cb058766700) 00010000:00010000:0.0:1788797047.749858:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788797047.749863:0:3286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082044200/0xca7fc0c411f93ce2 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797047.749868:0:3286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082044200/0xca7fc0c411f93ce2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788797047.751313:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1788797047.751458:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351466880 00000100:00100000:2.0:1788797047.751469:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351466880 00000100:00100000:2.0:1788797047.751529:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 106 00000100:00100000:2.0:1788797047.751540:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb06ec6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6d050bb-169e-4784-be5b-7071799bf3b0+51:10562:x1875689351466880:12345-192.168.204.38@tcp:101:bash.0 00010000:00010000:2.0:1788797047.751563:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788797047.751582:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484000/0xca7fc0c411f93ce9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c99e04559ee1162 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797047.751703:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484c00/0xca7fc0c411f93cf0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797047.751717:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484c00/0xca7fc0c411f93cf0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797047.751727:0:5827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484c00/0xca7fc0c411f93cf0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788797047.751755:0:5827:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:2.0:1788797047.751759:0:5827:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788797047.751776:0:5827:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484c00/0xca7fc0c411f93cf0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797047.751801:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484000/0xca7fc0c411f93ce9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1162 expref: 53 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797047.751817:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484c00/0xca7fc0c411f93cf0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1162 expref: 52 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797047.751824:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8cb058766700) 00010000:00010000:2.0:1788797047.751827:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788797047.751830:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb041484c00, rc 0) 00000100:00100000:2.0:1788797047.751899:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb06ec6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6d050bb-169e-4784-be5b-7071799bf3b0+52:10562:x1875689351466880:12345-192.168.204.38@tcp:101:bash.0 Request processed in 350us (592us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797047.751907:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 106 00000100:00100000:3.0:1788797047.762736:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1788797047.762838:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351467136 00000100:00100000:1.0:1788797047.762850:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351467136 00000100:00100000:1.0:1788797047.762927:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 29 00000100:00100000:1.0:1788797047.762941:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb06ec6ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e6d050bb-169e-4784-be5b-7071799bf3b0+52:10562:x1875689351467136:12345-192.168.204.38@tcp:35:bash.0 00000100:00100000:1.0:1788797047.763471:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb06ec6ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e6d050bb-169e-4784-be5b-7071799bf3b0+53:10562:x1875689351467136:12345-192.168.204.38@tcp:35:bash.0 Request processed in 532us (749us total) trans 4294967395 rc 0/0 00000100:00100000:1.0:1788797047.763481:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 29 00000100:00100000:3.0:1788797047.848150:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1788797047.848249:0:7636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351467264 00000100:00100000:0.0:1788797047.848260:0:7636:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351467264 00000100:00100000:0.0:1788797047.848331:0:7636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 107 00000100:00100000:0.0:1788797047.848341:0:7636:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb06ec6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6d050bb-169e-4784-be5b-7071799bf3b0+53:10569:x1875689351467264:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1788797047.848366:0:7636:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788797047.848408:0:7636:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3e00/0xca7fc0c411f93cf7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c99e04559ee1169 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797047.848484:0:7636:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2200/0xca7fc0c411f93cfe lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797047.848503:0:7636:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2200/0xca7fc0c411f93cfe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797047.848516:0:7636:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2200/0xca7fc0c411f93cfe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788797047.848560:0:7636:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:0.0:1788797047.848564:0:7636:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788797047.848582:0:7636:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2200/0xca7fc0c411f93cfe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797047.848610:0:7636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3e00/0xca7fc0c411f93cf7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1169 expref: 55 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797047.848631:0:7636:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2200/0xca7fc0c411f93cfe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1169 expref: 54 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797047.848640:0:7636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8cb06ce84d00) 00010000:00010000:0.0:1788797047.848643:0:7636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788797047.848646:0:7636:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb042ea2200, rc 0) 00000100:00100000:0.0:1788797047.848716:0:7636:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb06ec6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6d050bb-169e-4784-be5b-7071799bf3b0+54:10569:x1875689351467264:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 376us (577us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797047.848722:0:7636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 107 00000100:00100000:3.0:1788797047.855112:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1788797047.855234:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351467392 00000100:00100000:2.0:1788797047.855244:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351467392 00000100:00100000:2.0:1788797047.855329:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 108 00000100:00100000:2.0:1788797047.855340:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb06ec6d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6d050bb-169e-4784-be5b-7071799bf3b0+54:10569:x1875689351467392:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1788797047.855364:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788797047.855391:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484000/0xca7fc0c411f93d05 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c99e04559ee1170 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797047.855460:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484400/0xca7fc0c411f93d0c lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797047.855475:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484400/0xca7fc0c411f93d0c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797047.855488:0:5827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484400/0xca7fc0c411f93d0c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797047.855730:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041485c00/0xca7fc0c411f93d13 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797047.855740:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041485c00/0xca7fc0c411f93d13 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797047.855748:0:5827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041485c00/0xca7fc0c411f93d13 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797047.855860:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040030400/0xca7fc0c411f93d1a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797047.855870:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040030400/0xca7fc0c411f93d1a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797047.855877:0:5827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040030400/0xca7fc0c411f93d1a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788797047.855940:0:5827:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:2.0:1788797047.855945:0:5827:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788797047.855968:0:5827:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040030400/0xca7fc0c411f93d1a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797047.855983:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040030400/0xca7fc0c411f93d1a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797047.855991:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484400/0xca7fc0c411f93d0c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797047.855998:0:5827:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484400/0xca7fc0c411f93d0c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797047.856005:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484400/0xca7fc0c411f93d0c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797047.856011:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb041484400 already unused, calling callback (ffffffffc1f014f0) 00010000:00010000:2.0:1788797047.856016:0:5827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484400/0xca7fc0c411f93d0c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797047.856025:0:5827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484400/0xca7fc0c411f93d0c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797047.856068:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8cb06ce84d00) 00010000:00010000:2.0:1788797047.856070:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788797047.856075:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484400/0xca7fc0c411f93d0c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797047.856081:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484400/0xca7fc0c411f93d0c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797047.856108:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041485c00/0xca7fc0c411f93d13 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797047.856114:0:5827:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041485c00/0xca7fc0c411f93d13 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797047.856121:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041485c00/0xca7fc0c411f93d13 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797047.856126:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb041485c00 already unused, calling callback (ffffffffc1f014f0) 00010000:00010000:2.0:1788797047.856129:0:5827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041485c00/0xca7fc0c411f93d13 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797047.856136:0:5827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041485c00/0xca7fc0c411f93d13 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797047.856144:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8cb05088a500) 00010000:00010000:2.0:1788797047.856147:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788797047.856150:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041485c00/0xca7fc0c411f93d13 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797047.856156:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041485c00/0xca7fc0c411f93d13 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797047.856409:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484000/0xca7fc0c411f93d05 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1170 expref: 56 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797047.856429:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040030400/0xca7fc0c411f93d1a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1170 expref: 55 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797047.856447:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8cb058766700) 00010000:00010000:2.0:1788797047.856450:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788797047.856452:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb040030400, rc 0) 00000100:00100000:2.0:1788797047.856864:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb06ec6d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6d050bb-169e-4784-be5b-7071799bf3b0+55:10569:x1875689351467392:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 1523us (1760us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797047.856873:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 108 00000100:00100000:2.0:1788797047.858991:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb06f60a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875689374549376:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788797047.859112:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788797047.860736:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374549376 00000100:00100000:1.0:1788797047.860746:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374549376 00000100:00100000:1.0:1788797047.860818:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788797047.860829:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb050385c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3303:x1875689374549376:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788797047.860872:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788797047.860959:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb050385c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3303:x1875689374549376:12345-0@lo:13:osp-pre-0-0.0 Request processed in 132us (1846us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797047.860966:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788797047.861022:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb06f60a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875689374549376:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788797047.863462:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1788797047.863556:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351467520 00000100:00100000:2.0:1788797047.863566:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351467520 00000100:00100000:2.0:1788797047.863644:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 7 00000100:00100000:2.0:1788797047.863655:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb06ec6ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e6d050bb-169e-4784-be5b-7071799bf3b0+55:2355:x1875689351467520:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788797047.863676:0:6698:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788797047.863709:0:6698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040030400/0xca7fc0c411f93d1a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1170 expref: 55 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797047.863731:0:6698:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8cb058766700) 00010000:00010000:2.0:1788797047.863736:0:6698:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788797047.863980:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb06ec6ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e6d050bb-169e-4784-be5b-7071799bf3b0+54:2355:x1875689351467520:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 326us (528us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797047.863988:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 7 00000100:00100000:0.0:1788797047.865283:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1788797047.866098:0:7636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351467776 00000100:00100000:1.0:1788797047.866108:0:7636:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351467776 00000100:00100000:1.0:1788797047.866159:0:7636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 109 00000100:00100000:1.0:1788797047.866169:0:7636:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb047c18380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6d050bb-169e-4784-be5b-7071799bf3b0+54:10569:x1875689351467776:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1788797047.866187:0:7636:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788797047.866225:0:7636:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045e00/0xca7fc0c411f93d21 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c99e04559ee1177 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797047.866335:0:7636:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045200/0xca7fc0c411f93d28 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797047.866350:0:7636:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484c00/0xca7fc0c411f93cf0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1162 expref: 55 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797047.866359:0:7636:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045200/0xca7fc0c411f93d28 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797047.866393:0:7636:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484c00/0xca7fc0c411f93cf0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1162 expref: 55 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797047.866407:0:7636:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484c00/0xca7fc0c411f93cf0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1162 expref: 55 pid: 5827 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788797047.866421:0:7636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb06f60a300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7636:1875689374549504:192.168.204.38@tcp:104: 00000100:00100000:1.0:1788797047.866501:0:7636:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb0465d4e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788797047.871616:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1788797047.871736:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351467904 00000100:00100000:0.0:1788797047.871749:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351467904 00010000:00010000:0.0:1788797047.871794:0:5811:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484c00/0xca7fc0c411f93cf0 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1162 expref: 56 pid: 5827 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788797047.871839:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 52 00000100:00100000:0.0:1788797047.871848:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb06ec6c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e6d050bb-169e-4784-be5b-7071799bf3b0+56:2354:x1875689351467904:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788797047.871864:0:5811:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788797047.871871:0:5811:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484c00/0xca7fc0c411f93cf0 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1162 expref: 56 pid: 5827 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797047.871895:0:5811:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484c00/0xca7fc0c411f93cf0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1162 expref: 56 pid: 5827 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797047.871918:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8cb058766700) 00010000:00010000:0.0:1788797047.871923:0:5811:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045200/0xca7fc0c411f93d28 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797047.871934:0:5811:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045200/0xca7fc0c411f93d28 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797047.871943:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045200/0xca7fc0c411f93d28 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797047.871963:0:5811:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788797047.872021:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb06ec6c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e6d050bb-169e-4784-be5b-7071799bf3b0+56:2354:x1875689351467904:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 173us (414us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797047.872048:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 52 00010000:00010000:1.0:1788797047.872523:0:7636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484c00/0xca7fc0c411f93cf0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1162 expref: 55 pid: 5827 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788797047.872539:0:7636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb06f60a300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7636:1875689374549504:192.168.204.38@tcp:104: 00010000:00010000:1.0:1788797047.872560:0:7636:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045200/0xca7fc0c411f93d28 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797047.872569:0:7636:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045200/0xca7fc0c411f93d28 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797047.872594:0:7636:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045200/0xca7fc0c411f93d28 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788797047.872613:0:7636:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:1.0:1788797047.872756:0:7636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045e00/0xca7fc0c411f93d21 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1177 expref: 56 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797047.872774:0:7636:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045200/0xca7fc0c411f93d28 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1177 expref: 55 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797047.872781:0:7636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8cb058766700) 00010000:00010000:1.0:1788797047.872784:0:7636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788797047.872786:0:7636:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb082045200, rc 0) 00000100:00100000:1.0:1788797047.872828:0:7636:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb047c18380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6d050bb-169e-4784-be5b-7071799bf3b0+55:10569:x1875689351467776:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 6660us (7551us total) trans 4294967396 rc 0/0 00000100:00100000:1.0:1788797047.872835:0:7636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 109 00000100:00100000:3.0:1788797047.876970:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1788797047.877086:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351468160 00000100:00100000:1.0:1788797047.877099:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351468160 00000100:00100000:1.0:1788797047.877169:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 8 00000100:00100000:1.0:1788797047.877181:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb06ec6e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e6d050bb-169e-4784-be5b-7071799bf3b0+55:10569:x1875689351468160:12345-192.168.204.38@tcp:103:lfs.0 00010000:00010000:1.0:1788797047.877380:0:5812:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788797047.877410:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2400/0xca7fc0c411f93c87 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee114d expref: 55 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797047.877431:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8cb058766700) 00010000:00010000:1.0:1788797047.877436:0:5812:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788797047.877516:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb06ec6e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e6d050bb-169e-4784-be5b-7071799bf3b0+54:10569:x1875689351468160:12345-192.168.204.38@tcp:103:lfs.0 Request processed in 337us (555us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797047.877525:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 8 00000100:00100000:0.0:1788797047.880174:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1788797047.880355:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351468288 00000100:00100000:1.0:1788797047.880364:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351468288 00000100:00100000:1.0:1788797047.880418:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 110 00000100:00100000:1.0:1788797047.880429:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb047c1ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6d050bb-169e-4784-be5b-7071799bf3b0+54:10569:x1875689351468288:12345-192.168.204.38@tcp:58:lfs.0 00010000:00010000:1.0:1788797047.880544:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045e00/0xca7fc0c411f93d36 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797047.880560:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045e00/0xca7fc0c411f93d36 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797047.880571:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045e00/0xca7fc0c411f93d36 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788797047.880878:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:1.0:1788797047.881066:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb047c1ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6d050bb-169e-4784-be5b-7071799bf3b0+54:10569:x1875689351468288:12345-192.168.204.38@tcp:58:lfs.0 Request processed in 638us (899us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797047.881074:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 110 00000100:00100000:2.0:1788797047.883337:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1788797047.883416:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351468416 00000100:00100000:1.0:1788797047.883425:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351468416 00000100:00100000:1.0:1788797047.883480:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 111 00000100:00100000:1.0:1788797047.883491:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb050387800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6d050bb-169e-4784-be5b-7071799bf3b0+54:10569:x1875689351468416:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1788797047.883512:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788797047.883533:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045400/0xca7fc0c411f93d3d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c99e04559ee117e expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797047.883607:0:5826:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045e00/0xca7fc0c411f93d36 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797047.883629:0:5826:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045400/0xca7fc0c411f93d3d lrc: 4/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee117e expref: 55 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797047.883647:0:5826:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045e00/0xca7fc0c411f93d36 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797047.883661:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045400/0xca7fc0c411f93d3d lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee117e expref: 55 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797047.883674:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8cb058766700) 00010000:00010000:1.0:1788797047.883677:0:5826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788797047.883681:0:5826:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045400/0xca7fc0c411f93d3d lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee117e expref: 55 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797047.883689:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb082045400, rc 0) 00000100:00100000:1.0:1788797047.883751:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb050387800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6d050bb-169e-4784-be5b-7071799bf3b0+55:10569:x1875689351468416:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 262us (420us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797047.883757:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 111 00000040:00080000:0.0:1788797048.306423:0:11679:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788797048.306438:0:11679:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788797048.306517:0:11679:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:0.0:1788797048.306526:0:11679:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788797048.306839:0:11679:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb047c19880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11679:1875689374549632:192.168.204.38@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788797048.307059:0:11679:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb06cfc1180 going to sleep for 11 seconds 00000100:00100000:0.0:1788797048.312093:0:11679:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb047c19880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11679:1875689374549632:192.168.204.38@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788797048.315870:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1788797048.315974:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351468544 00000100:00100000:2.0:1788797048.315985:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351468544 00000100:00100000:2.0:1788797048.316082:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 112 00000100:00100000:2.0:1788797048.316110:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb06ec6c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6d050bb-169e-4784-be5b-7071799bf3b0+55:10570:x1875689351468544:12345-192.168.204.38@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788797048.316151:0:5827:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788797048.316294:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb06ec6c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6d050bb-169e-4784-be5b-7071799bf3b0+55:10570:x1875689351468544:12345-192.168.204.38@tcp:53:lhsmtool_posix.0 Request processed in 186us (434us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797048.316302:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 112 00000100:00100000:2.0:1788797048.325503:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1788797048.325671:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351468672 00000100:00100000:1.0:1788797048.325683:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351468672 00000100:00100000:1.0:1788797048.325754:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 113 00000100:00100000:1.0:1788797048.325765:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb050385500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6d050bb-169e-4784-be5b-7071799bf3b0+55:10570:x1875689351468672:12345-192.168.204.38@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1788797048.325870:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045c00/0xca7fc0c411f93d44 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797048.325900:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045c00/0xca7fc0c411f93d44 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797048.325941:0:5826:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045c00/0xca7fc0c411f93d44 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797048.326017:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082044200/0xca7fc0c411f93d4b lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797048.326056:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082044200/0xca7fc0c411f93d4b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797048.326065:0:5826:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082044200/0xca7fc0c411f93d4b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797048.326092:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045600/0xca7fc0c411f93d52 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797048.326100:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045600/0xca7fc0c411f93d52 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797048.326106:0:5826:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045600/0xca7fc0c411f93d52 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788797048.326149:0:5826:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:1.0:1788797048.326155:0:5826:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788797048.326168:0:5826:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045600/0xca7fc0c411f93d52 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797048.327468:0:5826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045c00/0xca7fc0c411f93d44 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797048.327487:0:5826:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045c00/0xca7fc0c411f93d44 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797048.327516:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045c00/0xca7fc0c411f93d44 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797048.327522:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb082045c00 already unused, calling callback (ffffffffc1f014f0) 00010000:00010000:1.0:1788797048.327527:0:5826:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045c00/0xca7fc0c411f93d44 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797048.327536:0:5826:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045c00/0xca7fc0c411f93d44 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797048.327557:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8cb05088a400) 00010000:00010000:1.0:1788797048.327561:0:5826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788797048.327567:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045c00/0xca7fc0c411f93d44 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797048.327574:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045c00/0xca7fc0c411f93d44 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797048.327591:0:5826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082044200/0xca7fc0c411f93d4b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797048.327598:0:5826:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082044200/0xca7fc0c411f93d4b lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797048.327604:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082044200/0xca7fc0c411f93d4b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797048.327609:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb082044200 already unused, calling callback (ffffffffc1f014f0) 00010000:00010000:1.0:1788797048.327612:0:5826:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082044200/0xca7fc0c411f93d4b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797048.327630:0:5826:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082044200/0xca7fc0c411f93d4b lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797048.327639:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x77a79f1b (ffff8cb06ce84100) 00010000:00010000:1.0:1788797048.327641:0:5826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788797048.327644:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082044200/0xca7fc0c411f93d4b lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797048.327649:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082044200/0xca7fc0c411f93d4b lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797048.327669:0:5826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045600/0xca7fc0c411f93d52 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797048.327676:0:5826:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045600/0xca7fc0c411f93d52 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797048.327682:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045600/0xca7fc0c411f93d52 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797048.327687:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb082045600 already unused, calling callback (ffffffffc1f014f0) 00010000:00010000:1.0:1788797048.327690:0:5826:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045600/0xca7fc0c411f93d52 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797048.327697:0:5826:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045600/0xca7fc0c411f93d52 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797048.327705:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8cb058766700) 00010000:00010000:1.0:1788797048.327707:0:5826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788797048.327710:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045600/0xca7fc0c411f93d52 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797048.327726:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045600/0xca7fc0c411f93d52 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788797048.327912:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb050385500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6d050bb-169e-4784-be5b-7071799bf3b0+55:10570:x1875689351468672:12345-192.168.204.38@tcp:34:lhsmtool_posix.0 Request processed in 2145us (2417us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797048.327923:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 113 00000100:00100000:3.0:1788797048.339805:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1788797048.339905:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351468928 00000100:00100000:2.0:1788797048.339917:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351468928 00000100:00100000:2.0:1788797048.339972:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 114 00000100:00100000:2.0:1788797048.339982:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb06ec6ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6d050bb-169e-4784-be5b-7071799bf3b0+55:10570:x1875689351468928:12345-192.168.204.38@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788797048.340003:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788797048.340064:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040031e00/0xca7fc0c411f93d59 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c99e04559ee1185 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797048.340181:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040030800/0xca7fc0c411f93d60 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797048.340215:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040030800/0xca7fc0c411f93d60 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797048.340227:0:5827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040030800/0xca7fc0c411f93d60 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788797048.340239:0:5827:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:2.0:1788797048.340346:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040030800/0xca7fc0c411f93d60 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797048.340354:0:5827:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040030800/0xca7fc0c411f93d60 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797048.340379:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040030800/0xca7fc0c411f93d60 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797048.340386:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb040030800 already unused, calling callback (ffffffffc1f014f0) 00010000:00010000:2.0:1788797048.340608:0:5827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040030800/0xca7fc0c411f93d60 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797048.340619:0:5827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040030800/0xca7fc0c411f93d60 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797048.340632:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8cb058766700) 00010000:00010000:2.0:1788797048.340635:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788797048.340641:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040030800/0xca7fc0c411f93d60 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797048.340648:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040030800/0xca7fc0c411f93d60 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797048.340689:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040031e00/0xca7fc0c411f93d59 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1185 expref: 57 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797048.340699:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8cb05088a400) 00010000:00010000:2.0:1788797048.340701:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788797048.340705:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040031e00/0xca7fc0c411f93d59 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1185 expref: 57 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797048.340716:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb040031e00, rc 0) 00000100:00100000:2.0:1788797048.340783:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb06ec6ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6d050bb-169e-4784-be5b-7071799bf3b0+56:10570:x1875689351468928:12345-192.168.204.38@tcp:101:lhsmtool_posix.0 Request processed in 801us (987us total) trans 4294967397 rc 301/301 00000100:00100000:2.0:1788797048.340801:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 114 00000100:00100000:3.0:1788797048.343423:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1788797048.343717:0:7636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351469056 00000100:00100000:2.0:1788797048.343730:0:7636:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351469056 00000100:00100000:2.0:1788797048.343840:0:7636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 115 00000100:00100000:2.0:1788797048.343853:0:7636:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb06ec6d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6d050bb-169e-4784-be5b-7071799bf3b0+56:10570:x1875689351469056:12345-192.168.204.38@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788797048.343914:0:7636:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788797048.344043:0:7636:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb06ec6d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6d050bb-169e-4784-be5b-7071799bf3b0+56:10570:x1875689351469056:12345-192.168.204.38@tcp:53:lhsmtool_posix.0 Request processed in 175us (610us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797048.344052:0:7636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 115 00000100:00100000:0.0:1788797048.346903:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1788797048.346974:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351469312 00000100:00100000:1.0:1788797048.346987:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351469312 00000100:00100000:1.0:1788797048.347084:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 116 00000100:00100000:1.0:1788797048.347096:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb047c19880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6d050bb-169e-4784-be5b-7071799bf3b0+56:10570:x1875689351469312:12345-192.168.204.38@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788797048.347121:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788797048.347124:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1788797048.347158:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2200/0xca7fc0c411f93cfe lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1169 expref: 56 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797048.347179:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8cb06ce84d00) 00010000:00010000:1.0:1788797048.347194:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788797048.347216:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045600/0xca7fc0c411f93d6e lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c99e04559ee118c expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788797048.347673:0:5825:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4:0x0], index 0: 0 00010000:00010000:1.0:1788797048.347864:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082044200/0xca7fc0c411f93d75 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797048.347892:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082044200/0xca7fc0c411f93d75 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797048.347903:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082044200/0xca7fc0c411f93d75 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797048.347971:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045600/0xca7fc0c411f93d6e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee118c expref: 58 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797048.347987:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082044200/0xca7fc0c411f93d75 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee118c expref: 57 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797048.347995:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8cb06ce84100) 00010000:00010000:1.0:1788797048.347997:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788797048.348000:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb082044200, rc 0) 00000100:00100000:1.0:1788797048.348095:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb047c19880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6d050bb-169e-4784-be5b-7071799bf3b0+57:10570:x1875689351469312:12345-192.168.204.38@tcp:101:lhsmtool_posix.0 Request processed in 1001us (1201us total) trans 4294967398 rc 0/0 00000100:00100000:1.0:1788797048.348104:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 116 00000100:00100000:3.0:1788797048.350979:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1788797048.351051:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351469568 00000100:00100000:1.0:1788797048.351062:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351469568 00000100:00100000:2.0:1788797048.351267:0:7636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 117 00000100:00100000:2.0:1788797048.351282:0:7636:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb06ec6dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6d050bb-169e-4784-be5b-7071799bf3b0+57:10570:x1875689351469568:12345-192.168.204.38@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788797048.351351:0:7636:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788797048.351380:0:7636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082044200/0xca7fc0c411f93d75 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee118c expref: 57 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797048.351412:0:7636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8cb06ce84100) 00010000:00010000:2.0:1788797048.351424:0:7636:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788797048.351448:0:7636:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040031e00/0xca7fc0c411f93d83 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797048.351464:0:7636:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040031e00/0xca7fc0c411f93d83 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797048.351474:0:7636:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040031e00/0xca7fc0c411f93d83 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797048.351488:0:7636:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040030800/0xca7fc0c411f93d8a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x5add78c2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797048.351512:0:7636:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040030800/0xca7fc0c411f93d8a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x5add78c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797048.351520:0:7636:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040030800/0xca7fc0c411f93d8a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x5add78c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797048.351589:0:7636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040031e00/0xca7fc0c411f93d83 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797048.351597:0:7636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040031e00/0xca7fc0c411f93d83 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797048.351603:0:7636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040031e00/0xca7fc0c411f93d83 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797048.351610:0:7636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb040031e00 already unused, calling callback (ffffffffc1f014f0) 00010000:00010000:2.0:1788797048.351615:0:7636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040031e00/0xca7fc0c411f93d83 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797048.351623:0:7636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040031e00/0xca7fc0c411f93d83 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797048.351632:0:7636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8cb06ce84d00) 00010000:00010000:2.0:1788797048.351635:0:7636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788797048.351639:0:7636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040031e00/0xca7fc0c411f93d83 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797048.351646:0:7636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040031e00/0xca7fc0c411f93d83 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797048.351657:0:7636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040030800/0xca7fc0c411f93d8a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x5add78c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797048.351670:0:7636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040030800/0xca7fc0c411f93d8a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x5add78c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797048.351676:0:7636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040030800/0xca7fc0c411f93d8a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x5add78c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797048.351680:0:7636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb040030800 already unused, calling callback (ffffffffc1f014f0) 00010000:00010000:2.0:1788797048.351683:0:7636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040030800/0xca7fc0c411f93d8a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x5add78c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797048.351689:0:7636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040030800/0xca7fc0c411f93d8a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x5add78c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797048.351696:0:7636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x5add78c2 (ffff8cb05088a500) 00010000:00010000:2.0:1788797048.351699:0:7636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788797048.351701:0:7636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040030800/0xca7fc0c411f93d8a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x5add78c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797048.351707:0:7636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040030800/0xca7fc0c411f93d8a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x5add78c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788797048.351795:0:7636:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb06ec6dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6d050bb-169e-4784-be5b-7071799bf3b0+56:10570:x1875689351469568:12345-192.168.204.38@tcp:36:lhsmtool_posix.0 Request processed in 517us (824us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788797048.351803:0:7636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 117 00000100:00100000:3.0:1788797048.353774:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1788797048.353869:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351469696 00000100:00100000:1.0:1788797048.353889:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351469696 00000100:00100000:1.0:1788797048.353944:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 118 00000100:00100000:1.0:1788797048.353956:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb06ec6e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6d050bb-169e-4784-be5b-7071799bf3b0+56:10570:x1875689351469696:12345-192.168.204.38@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788797048.353976:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788797048.353999:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045600/0xca7fc0c411f93d91 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c99e04559ee1193 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797048.354106:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045c00/0xca7fc0c411f93d98 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797048.354133:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045c00/0xca7fc0c411f93d98 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797048.354162:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045c00/0xca7fc0c411f93d98 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797048.354278:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045600/0xca7fc0c411f93d91 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1193 expref: 58 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797048.354296:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045c00/0xca7fc0c411f93d98 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1193 expref: 57 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797048.354307:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8cb06ce84f00) 00010000:00010000:1.0:1788797048.354310:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788797048.354313:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb082045c00, rc 0) 00000100:00100000:1.0:1788797048.354606:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb06ec6e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6d050bb-169e-4784-be5b-7071799bf3b0+57:10570:x1875689351469696:12345-192.168.204.38@tcp:101:lhsmtool_posix.0 Request processed in 651us (840us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797048.354615:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 118 00000100:00100000:0.0:1788797048.356792:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1788797048.356887:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351469952 00000100:00100000:2.0:1788797048.356896:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351469952 00000100:00100000:2.0:1788797048.356984:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 119 00000100:00100000:2.0:1788797048.356995:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb047c19c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6d050bb-169e-4784-be5b-7071799bf3b0+57:10570:x1875689351469952:12345-192.168.204.38@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788797048.358486:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040030800/0xca7fc0c411f93d9f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797048.358528:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040030800/0xca7fc0c411f93d9f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797048.358540:0:5826:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040030800/0xca7fc0c411f93d9f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788797048.358821:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 88 off8560 00000004:00080000:2.0:1788797048.358831:0:5826:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 337364802412ns, next at 338364799760ns, rc = 0 00000004:00010000:2.0:1788797048.358938:0:5826:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000044997ec0 reply state 00000000d1ddb9d7 transno 4294967399 ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040030800/0xca7fc0c411f93d9f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788797048.358948:0:5826:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788797048.359075:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb047c19c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6d050bb-169e-4784-be5b-7071799bf3b0+59:10570:x1875689351469952:12345-192.168.204.38@tcp:36:lhsmtool_posix.0 Request processed in 2080us (2287us total) trans 4294967399 rc 0/0 00000100:00100000:2.0:1788797048.359084:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 119 00010000:00010000:1.0:1788797048.361523:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040030800/0xca7fc0c411f93d9f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797048.361543:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040030800/0xca7fc0c411f93d9f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797048.361551:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040030800/0xca7fc0c411f93d9f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797048.361558:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb040030800 already unused, calling callback (ffffffffc1f014f0) 00010000:00010000:1.0:1788797048.361563:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040030800/0xca7fc0c411f93d9f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797048.361573:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040030800/0xca7fc0c411f93d9f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797048.361611:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8cb06ce84f00) 00010000:00010000:1.0:1788797048.361614:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788797048.361620:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040030800/0xca7fc0c411f93d9f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797048.361628:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040030800/0xca7fc0c411f93d9f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788797048.361695:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1788797048.361909:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351470080 00000100:00100000:2.0:1788797048.361922:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351470080 00000100:00100000:2.0:1788797048.361977:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 120 00000100:00100000:2.0:1788797048.361989:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb06ec6fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6d050bb-169e-4784-be5b-7071799bf3b0+58:10570:x1875689351470080:12345-192.168.204.38@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788797048.362012:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788797048.362073:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040031e00/0xca7fc0c411f93da6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c99e04559ee119a expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797048.362150:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040031e00/0xca7fc0c411f93da6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee119a expref: 59 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797048.362165:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040031e00/0xca7fc0c411f93da6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee119a expref: 59 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797048.362199:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8cb06ce84f00) 00010000:00010000:2.0:1788797048.362203:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788797048.362205:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb040031e00, rc 0) 00000100:00100000:2.0:1788797048.362279:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb06ec6fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6d050bb-169e-4784-be5b-7071799bf3b0+59:10570:x1875689351470080:12345-192.168.204.38@tcp:101:lhsmtool_posix.0 Request processed in 293us (588us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797048.362287:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 120 00000100:00100000:3.0:1788797048.364533:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1788797048.364702:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351470208 00000100:00100000:1.0:1788797048.364712:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351470208 00000100:00100000:1.0:1788797048.364838:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 38 00000100:00100000:1.0:1788797048.364851:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb06ec6ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e6d050bb-169e-4784-be5b-7071799bf3b0+8:2354:x1875689351470208:12345-192.168.204.38@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1788797048.365281:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb06ec6ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e6d050bb-169e-4784-be5b-7071799bf3b0+9:2354:x1875689351470208:12345-192.168.204.38@tcp:2:lhsmtool_posix.0 Request processed in 433us (769us total) trans 4294967307 rc 0/0 00000100:00100000:1.0:1788797048.365289:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 38 00000100:00080000:2.0:1788797048.365694:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788797048.368061:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1788797048.368329:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351470464 00000100:00100000:1.0:1788797048.368340:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351470464 00000100:00100000:1.0:1788797048.368395:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30 00000100:00100000:1.0:1788797048.368406:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb047c1a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e6d050bb-169e-4784-be5b-7071799bf3b0+59:10570:x1875689351470464:12345-192.168.204.38@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788797048.368683:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb047c1a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e6d050bb-169e-4784-be5b-7071799bf3b0+60:10570:x1875689351470464:12345-192.168.204.38@tcp:35:lhsmtool_posix.0 Request processed in 278us (660us total) trans 4294967400 rc 0/0 00000100:00100000:1.0:1788797048.368691:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30 00000100:00100000:1.0:1788797048.370304:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb080684e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3303:1875689374550144:0@lo:400:kworker.0 00000100:00100000:1.0:1788797048.370376:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788797048.370436:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788797048.370443:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb080685500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875689374550016:0@lo:400:kworker.0 00000100:00100000:1.0:1788797048.370478:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788797048.370515:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374550016 00000100:00100000:1.0:1788797048.370521:0:6683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374550016 00000100:00100000:1.0:1788797048.370566:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788797048.370575:0:6683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb077e32300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3303:x1875689374550016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788797048.370623:0:6683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb077e32300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3303:x1875689374550016:12345-0@lo:400:kworker.0 Request processed in 49us (144us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797048.370630:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788797048.370667:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb080685500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875689374550016:0@lo:400:kworker.0 00000100:00100000:1.0:1788797048.370689:0:7636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374550144 00000100:00100000:1.0:1788797048.370692:0:7636:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374550144 00000100:00100000:1.0:1788797048.370717:0:7636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1788797048.370723:0:7636:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb077e30700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875689374550144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788797048.370770:0:7636:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb077e30700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875689374550144:12345-0@lo:400:kworker.0 Request processed in 47us (394us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797048.370777:0:7636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1788797048.370956:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb047c1bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875689374550528:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788797048.370988:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788797048.371056:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374550528 00000100:00100000:0.0:1788797048.371060:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374550528 00000100:00100000:0.0:1788797048.371092:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788797048.371100:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb047c18e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3302:x1875689374550528:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788797048.371115:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 3407872 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788797048.371151:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb047c18e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3302:x1875689374550528:12345-0@lo:13:osp-pre-1-0.0 Request processed in 52us (162us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797048.371157:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788797048.371190:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb047c1bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875689374550528:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788797048.371400:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb06f60b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3301:1875689374549888:0@lo:400:kworker.0 00000100:00100000:3.0:1788797048.371431:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788797048.371457:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb077e30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875689374550400:0@lo:400:kworker.0 00000100:00100000:3.0:1788797048.371491:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788797048.371519:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1788797048.371526:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb06f60a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:3301:1875689374549760:0@lo:400:kworker.0 00000100:00100000:3.0:1788797048.371555:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788797048.371578:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb077f0b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3301:1875689374550272:0@lo:400:kworker.0 00000100:00100000:3.0:1788797048.371600:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788797048.371629:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374549760 00000100:00100000:3.0:1788797048.371633:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374549760 00000100:00100000:3.0:1788797048.371673:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 293 00000100:00100000:3.0:1788797048.371680:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb060706450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+19:3301:x1875689374549760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788797048.371717:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb060706450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+19:3301:x1875689374549760:12345-0@lo:400:kworker.0 Request processed in 38us (160us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797048.371724:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 293 00000100:00100000:3.0:1788797048.371760:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb06f60a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:3301:1875689374549760:0@lo:400:kworker.0 00000100:00100000:3.0:1788797048.371795:0:10829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374550400 00000100:00100000:3.0:1788797048.371798:0:10829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374550400 00000100:00100000:3.0:1788797048.371824:0:10829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788797048.371830:0:10829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb079bc2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3301:x1875689374550400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788797048.371861:0:10829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb079bc2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3301:x1875689374550400:12345-0@lo:400:kworker.0 Request processed in 32us (369us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797048.371867:0:10829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788797048.371902:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb077e30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875689374550400:0@lo:400:kworker.0 00000100:00100000:3.0:1788797048.371926:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374549888 00000100:00100000:3.0:1788797048.371929:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374549888 00000100:00100000:3.0:1788797048.371943:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374550272 00000100:00100000:3.0:1788797048.371946:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374550272 00000100:00100000:3.0:1788797048.371959:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1788797048.371964:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb06ec6df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1875689374549888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788797048.371996:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb06ec6df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1875689374549888:12345-0@lo:400:kworker.0 Request processed in 31us (564us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797048.372001:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1788797048.372022:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb06f60b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3301:1875689374549888:0@lo:400:kworker.0 00000100:00100000:3.0:1788797048.372063:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1788797048.372069:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb079bc0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1875689374550272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788797048.372108:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb079bc0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1875689374550272:12345-0@lo:400:kworker.0 Request processed in 39us (506us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797048.372114:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1788797048.372135:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb077f0b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3301:1875689374550272:0@lo:400:kworker.0 00000100:00100000:1.0:1788797048.372407:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb080684e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3303:1875689374550144:0@lo:400:kworker.0 00000100:00080000:2.0:1788797048.372489:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788797048.372495:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788797048.372498:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788797048.374423:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1788797048.374544:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351470720 00000100:00100000:3.0:1788797048.374553:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351470720 00000100:00100000:3.0:1788797048.374711:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 121 00000100:00100000:3.0:1788797048.374722:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb047c1bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6d050bb-169e-4784-be5b-7071799bf3b0+60:10570:x1875689351470720:12345-192.168.204.38@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788797048.374979:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb047c1bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6d050bb-169e-4784-be5b-7071799bf3b0+60:10570:x1875689351470720:12345-192.168.204.38@tcp:57:lhsmtool_posix.0 Request processed in 258us (564us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797048.374987:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 121 00000100:00100000:3.0:1788797048.377417:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1788797048.377531:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351470848 00000100:00100000:2.0:1788797048.377543:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351470848 00000100:00100000:2.0:1788797048.377618:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 122 00000100:00100000:2.0:1788797048.377630:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb079bc2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6d050bb-169e-4784-be5b-7071799bf3b0+60:10570:x1875689351470848:12345-192.168.204.38@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788797048.377654:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788797048.377676:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040031400/0xca7fc0c411f93dad lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c99e04559ee11a1 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797048.377750:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040030c00/0xca7fc0c411f93db4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797048.377767:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040030c00/0xca7fc0c411f93db4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797048.377960:0:5826:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040030c00/0xca7fc0c411f93db4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788797048.378002:0:5826:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788797048.378299:0:5826:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040030c00/0xca7fc0c411f93db4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797048.378330:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040031400/0xca7fc0c411f93dad lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee11a1 expref: 62 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797048.378350:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040030c00/0xca7fc0c411f93db4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee11a1 expref: 61 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797048.378359:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8cb06ce84f00) 00010000:00010000:3.0:1788797048.378362:0:5826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1788797048.378365:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb040030c00, rc 0) 00000100:00100000:3.0:1788797048.378465:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb079bc2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6d050bb-169e-4784-be5b-7071799bf3b0+61:10570:x1875689351470848:12345-192.168.204.38@tcp:101:lhsmtool_posix.0 Request processed in 837us (1056us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797048.378484:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 122 00000100:00100000:0.0:1788797048.381660:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1788797048.381755:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351470976 00000100:00100000:1.0:1788797048.381765:0:6683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351470976 00000100:00100000:1.0:1788797048.381836:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 39 00000100:00100000:1.0:1788797048.381846:0:6683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb047c19f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e6d050bb-169e-4784-be5b-7071799bf3b0+9:2355:x1875689351470976:12345-192.168.204.38@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788797048.381865:0:6683:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788797048.381897:0:6683:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000301718fa/0xca7fc0c411f93dbb lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7c99e04559ee11a8 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788797048.381925:0:6683:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9ee078, blocks: 0x1 00010000:00010000:1.0:1788797048.381958:0:6683:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=337s v=(0 0) 00010000:00010000:1.0:1788797048.381963:0:6683:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788797048.381973:0:6683:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000301718fa/0xca7fc0c411f93dbb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee11a8 expref: 10 pid: 6683 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797048.381996:0:6683:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000301718fa/0xca7fc0c411f93dbb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee11a8 expref: 10 pid: 6683 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797048.382011:0:6683:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb082045600, rc 0) 00000100:00100000:1.0:1788797048.382116:0:6683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb047c19f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e6d050bb-169e-4784-be5b-7071799bf3b0+10:2355:x1875689351470976:12345-192.168.204.38@tcp:101:lhsmtool_posix.0 Request processed in 270us (466us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797048.382124:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 39 00000100:00100000:0.0:1788797048.385661:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1788797048.385808:0:7636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351471232 00000100:00100000:1.0:1788797048.385819:0:7636:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351471232 00000100:00100000:1.0:1788797048.385891:0:7636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 123 00000100:00100000:1.0:1788797048.385902:0:7636:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb047c1b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6d050bb-169e-4784-be5b-7071799bf3b0+61:10570:x1875689351471232:12345-192.168.204.38@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788797048.386075:0:7636:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb047c1b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6d050bb-169e-4784-be5b-7071799bf3b0+61:10570:x1875689351471232:12345-192.168.204.38@tcp:57:lhsmtool_posix.0 Request processed in 174us (425us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797048.386082:0:7636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 123 00000100:00100000:0.0:1788797048.388616:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1788797048.388752:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351471360 00000100:00100000:3.0:1788797048.388762:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351471360 00000100:00100000:3.0:1788797048.388834:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 40 00000100:00100000:3.0:1788797048.388847:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb047c1b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e6d050bb-169e-4784-be5b-7071799bf3b0+10:10570:x1875689351471360:12345-192.168.204.38@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788797048.388869:0:6681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788797048.388900:0:6681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000081d7bd36/0xca7fc0c411f93dc2 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7c99e04559ee11af expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797048.388940:0:6681:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000301718fa/0xca7fc0c411f93dbb lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee11a8 expref: 11 pid: 6683 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797048.388950:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788797048.388954:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788797048.388960:0:6681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000081d7bd36/0xca7fc0c411f93dc2 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee11af expref: 11 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797048.388995:0:6681:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000301718fa/0xca7fc0c411f93dbb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee11a8 expref: 11 pid: 6683 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797048.389010:0:6681:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000301718fa/0xca7fc0c411f93dbb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee11a8 expref: 11 pid: 6683 timeout: 437 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788797048.389058:0:6681:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb079bc1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6681:1875689374550656:192.168.204.38@tcp:104: 00000100:00100000:3.0:1788797048.389143:0:6681:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb0503cff00 going to sleep for 11 seconds 00000100:00100000:0.0:1788797048.392023:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1788797048.392584:0:6681:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb079bc1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6681:1875689374550656:192.168.204.38@tcp:104: 00010000:00010000:3.0:1788797048.392629:0:6681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000081d7bd36/0xca7fc0c411f93dc2 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee11af expref: 11 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797048.392651:0:6681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb077c69a00, rc 0) 00000100:00100000:3.0:1788797048.392723:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb047c1b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e6d050bb-169e-4784-be5b-7071799bf3b0+11:10570:x1875689351471360:12345-192.168.204.38@tcp:101:lhsmtool_posix.0 Request processed in 3879us (4115us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797048.392732:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 40 00000100:00100000:2.0:1788797048.393927:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351471488 00000100:00100000:2.0:1788797048.393944:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351471488 00010000:00010000:2.0:1788797048.393993:0:6698:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000301718fa/0xca7fc0c411f93dbb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee11a8 expref: 11 pid: 6683 timeout: 437 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788797048.394067:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 53 00000100:00100000:3.0:1788797048.394146:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb042eda450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e6d050bb-169e-4784-be5b-7071799bf3b0+11:2355:x1875689351471488:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788797048.394167:0:6698:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788797048.394203:0:6698:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000301718fa/0xca7fc0c411f93dbb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee11a8 expref: 11 pid: 6683 timeout: 437 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797048.394224:0:6698:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000301718fa/0xca7fc0c411f93dbb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee11a8 expref: 11 pid: 6683 timeout: 437 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797048.394251:0:6698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000301718fa/0xca7fc0c411f93dbb lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee11a8 expref: 11 pid: 6683 timeout: 437 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797048.394267:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788797048.394272:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788797048.394280:0:6698:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000081d7bd36/0xca7fc0c411f93dc2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee11af expref: 10 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797048.394292:0:6698:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000081d7bd36/0xca7fc0c411f93dc2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee11af expref: 10 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797048.394347:0:6698:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000081d7bd36/0xca7fc0c411f93dc2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee11af expref: 10 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788797048.394361:0:6698:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb079bc1880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:6698:1875689374550784:192.168.204.38@tcp:105: 00000100:00100000:3.0:1788797048.394448:0:6698:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb0503cff00 going to sleep for 11 seconds 00000100:00100000:3.0:1788797048.397803:0:6698:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb079bc1880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:6698:1875689374550784:192.168.204.38@tcp:105: 00010000:00010000:3.0:1788797048.397831:0:6698:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788797048.397899:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb042eda450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e6d050bb-169e-4784-be5b-7071799bf3b0+10:2355:x1875689351471488:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 3823us (5888us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797048.397911:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 53 00000100:00100000:1.0:1788797048.401147:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1788797048.402367:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351471616 00000100:00100000:2.0:1788797048.402380:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351471616 00002000:00100000:2.0:1788797048.402436:0:6689:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff8cb077e30380 x1875689351471616/t0(0) o4->e6d050bb-169e-4784-be5b-7071799bf3b0@192.168.204.38@tcp:474/0 lens 504/0 e 0 to 0 dl 1788797059 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788797048.402447:0:6689:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8cb077e30380 with x1875689351471616 ext(0->12) 00002000:00010000:2.0:1788797048.402453:0:6689:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8cb077e30380 00000100:00100000:2.0:1788797048.402589:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2 00000100:00100000:2.0:1788797048.402600:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb077e30380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e6d050bb-169e-4784-be5b-7071799bf3b0+10:2352:x1875689351471616:12345-192.168.204.38@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1788797048.403128:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb077e30380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e6d050bb-169e-4784-be5b-7071799bf3b0+12:2352:x1875689351471616:12345-192.168.204.38@tcp:4:lhsmtool_posix.0 Request processed in 528us (1991us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1788797048.403137:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2 00002000:00100000:2.0:1788797048.403145:0:6689:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff8cb077e30380 x1875689351471616/t4294967308(0) o4->e6d050bb-169e-4784-be5b-7071799bf3b0@192.168.204.38@tcp:474/0 lens 504/448 e 0 to 0 dl 1788797059 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788797048.403154:0:6689:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8cb077e30380 with x1875689351471616 ext(0->12) 00002000:00010000:2.0:1788797048.403157:0:6689:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8cb077e30380 00000100:00100000:0.0:1788797048.405756:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1788797048.405845:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351471744 00000100:00100000:1.0:1788797048.405857:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351471744 00000100:00100000:1.0:1788797048.405926:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 124 00000100:00100000:1.0:1788797048.405937:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb047c19500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6d050bb-169e-4784-be5b-7071799bf3b0+61:10570:x1875689351471744:12345-192.168.204.38@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1788797048.443539:0:5848:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967388 is committed 00000004:00080000:2.0:1788797048.443552:0:5848:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000020:00080000:2.0:1788797048.443580:0:5848:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8cb0484ea240 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:2.0:1788797048.443586:0:5848:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8cb0436e5000 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8cb046b36540 00000020:00080000:2.0:1788797048.443617:0:5848:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8cb0436e5400 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8cb07795a000 00000001:00080000:2.0:1788797048.443650:0:5848:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967400 is committed 00000004:00080000:2.0:1788797048.443667:0:5848:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000004:00080000:2.0:1788797048.443693:0:5848:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000020:00080000:2.0:1788797048.443729:0:5848:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000020:00080000:2.0:1788797048.443748:0:5848:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8cb061f6b9c0 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:2.0:1788797048.443751:0:5848:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8cb079095100 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8cb0484ea9c0 00000020:00080000:2.0:1788797048.443753:0:5848:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8cb079095400 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8cb081375000 00000020:00080000:2.0:1788797048.443766:0:5859:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000020:00080000:2.0:1788797048.443985:0:5859:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:2.0:1788797048.444833:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb077e32d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875689374550912:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788797048.444920:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788797048.445162:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374550912 00000100:00100000:1.0:1788797048.445192:0:6683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374550912 00000100:00100000:2.0:1788797048.445582:0:10829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788797048.445594:0:10829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb050387480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3303:x1875689374550912:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1788797048.445635:0:10829:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:3 count 1 00002000:00010000:2.0:1788797048.445670:0:10829:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a9ee077, atime: 0x6a9ee077, ctime: 0x6a9ee077, blocks: 0x1 00010000:00010000:2.0:1788797048.445679:0:10829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008bf68295/0xca7fc0c411f93dc9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797048.445698:0:10829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=337s v=(0 0) 00010000:00010000:2.0:1788797048.445832:0:10829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788797048.445840:0:10829:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008bf68295/0xca7fc0c411f93dc9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797048.445861:0:10829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008bf68295/0xca7fc0c411f93dc9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797048.445895:0:10829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008bf68295/0xca7fc0c411f93dc9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797048.445903:0:10829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008bf68295/0xca7fc0c411f93dc9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 10829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797048.445926:0:10829:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788797048.447198:0:10829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb050387480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+9:3303:x1875689374550912:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1594us (2264us total) trans 4294967304 rc 0/0 00000100:00100000:2.0:1788797048.447208:0:10829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00010000:2.0:1788797048.447409:0:5815:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788797048.447417:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008bf68295/0xca7fc0c411f93dc9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797048.447429:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb040030000 already unused, calling callback (ffffffffc14d98b0) 00010000:00010000:2.0:1788797048.447434:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008bf68295/0xca7fc0c411f93dc9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797048.447444:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008bf68295/0xca7fc0c411f93dc9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 10829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797048.447464:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008bf68295/0xca7fc0c411f93dc9 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797048.447472:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008bf68295/0xca7fc0c411f93dc9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797048.447501:0:5815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788797048.447502:0:5815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788797048.447504:0:5815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1788797048.447540:0:3303:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8cb077e32d80/2, rc 0, transno 4294967304 00000100:00100000:2.0:1788797048.447547:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb077e32d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875689374550912:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788797048.447836:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb047c19500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6d050bb-169e-4784-be5b-7071799bf3b0+15:10570:x1875689351471744:12345-192.168.204.38@tcp:44:lhsmtool_posix.0 Request processed in 41898us (42087us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797048.447845:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 124 00000100:00100000:2.0:1788797048.449834:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb050384a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875689374551168:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1788797048.449929:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788797048.449991:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788797048.449998:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb050386300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875689374551040:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788797048.450022:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788797048.450086:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374551168 00000100:00100000:2.0:1788797048.450096:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374551168 00000100:00100000:2.0:1788797048.450144:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374551040 00000100:00100000:2.0:1788797048.450147:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374551040 00000100:00100000:2.0:1788797048.450167:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788797048.450176:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb06f57e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3301:x1875689374551168:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1788797048.450433:0:6684:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1788797048.450437:0:6684:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1788797048 00002000:00010000:2.0:1788797048.450439:0:6684:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1788797048.450441:0:6684:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 1788797048 -> 1788797048 00002000:00010000:2.0:1788797048.450442:0:6684:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1788797048.450483:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb06f57e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3301:x1875689374551168:12345-0@lo:2:osp-syn-0-0.0 Request processed in 308us (553us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1788797048.450490:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788797048.450507:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788797048.450520:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb06f57fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3301:x1875689374551040:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1788797048.450534:0:6684:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:3 count 1 00010000:00010000:2.0:1788797048.450552:0:6684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d500f348/0xca7fc0c411f93dd0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797048.450574:0:6684:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000076e75d25/0xca7fc0c411f93b8b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee110e expref: 11 pid: 10829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797048.450584:0:6684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=2s v=(0 0) 00010000:00010000:2.0:1788797048.450588:0:6684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788797048.450593:0:6684:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d500f348/0xca7fc0c411f93dd0 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797048.450940:0:6684:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000076e75d25/0xca7fc0c411f93b8b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee110e expref: 11 pid: 10829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797048.450957:0:6684:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000076e75d25/0xca7fc0c411f93b8b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee110e expref: 11 pid: 10829 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788797048.450970:0:6684:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb06f57ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6684:1875689374551296:192.168.204.38@tcp:104: 00000100:00100000:2.0:1788797048.451100:0:6684:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb048fde240 going to sleep for 11 seconds 00000004:00080000:2.0:1788797048.451142:0:3301:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8cb050384a80/2, rc 0, transno 4294967309 00000100:00100000:2.0:1788797048.451148:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb050384a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875689374551168:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1788797048.455837:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1788797048.456054:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351471872 00000100:00100000:2.0:1788797048.456064:0:6683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351471872 00000100:00100000:2.0:1788797048.456121:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 44 00000100:00100000:2.0:1788797048.456152:0:6683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb077ffe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e6d050bb-169e-4784-be5b-7071799bf3b0+12:2354:x1875689351471872:12345-192.168.204.38@tcp:16:lhsmtool_posix.0 00000100:00100000:0.0:1788797048.463260:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1788797048.463332:0:6684:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb06f57ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6684:1875689374551296:192.168.204.38@tcp:104: 00010000:00010000:0.0:1788797048.463359:0:6684:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d500f348/0xca7fc0c411f93dd0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788797048.465072:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351472000 00000100:00100000:3.0:1788797048.465088:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351472000 00010000:00010000:3.0:1788797048.465140:0:5813:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000076e75d25/0xca7fc0c411f93b8b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee110e expref: 13 pid: 10829 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788797048.465198:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 54 00000100:00100000:3.0:1788797048.465217:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb047c19180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e6d050bb-169e-4784-be5b-7071799bf3b0+13:2355:x1875689351472000:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788797048.465237:0:5813:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788797048.465242:0:5813:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000076e75d25/0xca7fc0c411f93b8b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee110e expref: 13 pid: 10829 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797048.465257:0:5813:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000076e75d25/0xca7fc0c411f93b8b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee110e expref: 13 pid: 10829 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797048.465306:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000076e75d25/0xca7fc0c411f93b8b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee110e expref: 13 pid: 10829 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797048.465325:0:5813:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788797048.465329:0:5813:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788797048.465334:0:5813:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d500f348/0xca7fc0c411f93dd0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797048.465344:0:5813:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d500f348/0xca7fc0c411f93dd0 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797048.465371:0:5813:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788797048.465426:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb047c19180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e6d050bb-169e-4784-be5b-7071799bf3b0+12:2355:x1875689351472000:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 219us (2175us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797048.465434:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 54 00010000:00010000:0.0:1788797048.465733:0:6684:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d500f348/0xca7fc0c411f93dd0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797048.465745:0:6684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d500f348/0xca7fc0c411f93dd0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797048.465758:0:6684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d500f348/0xca7fc0c411f93dd0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797048.465766:0:6684:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d500f348/0xca7fc0c411f93dd0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797048.465795:0:6684:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788797048.466467:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb06f57fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3301:x1875689374551040:12345-0@lo:6:osp-syn-0-0.0 Request processed in 15944us (16441us total) trans 4294967310 rc 0/0 00000100:00100000:0.0:1788797048.466478:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000004:00080000:0.0:1788797048.466541:0:3301:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8cb050386300/2, rc 0, transno 4294967310 00000100:00100000:0.0:1788797048.466549:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb050386300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875689374551040:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1788797048.466821:0:5814:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788797048.466830:0:5814:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d500f348/0xca7fc0c411f93dd0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797048.466841:0:5814:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb040031400 already unused, calling callback (ffffffffc14d98b0) 00010000:00010000:3.0:1788797048.466846:0:5814:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d500f348/0xca7fc0c411f93dd0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797048.466858:0:5814:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d500f348/0xca7fc0c411f93dd0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797048.466896:0:5814:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d500f348/0xca7fc0c411f93dd0 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797048.466905:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d500f348/0xca7fc0c411f93dd0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797048.466927:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788797048.466929:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788797048.466930:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1788797048.496427:0:6713:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967307 is committed 00000001:00080000:0.0:1788797048.496450:0:6713:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967305 is committed 00000001:00080000:0.0:1788797048.496458:0:6713:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967309 is committed 00000001:00080000:0.0:1788797048.496461:0:6713:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967308 is committed 00000100:00100000:1.0:1788797048.496698:0:6683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb077ffe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e6d050bb-169e-4784-be5b-7071799bf3b0+6:2354:x1875689351471872:12345-192.168.204.38@tcp:16:lhsmtool_posix.0 Request processed in 40542us (40863us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797048.496720:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 44 00000100:00100000:0.0:1788797048.501143:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1788797048.501230:0:7636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351472256 00000100:00100000:1.0:1788797048.501242:0:7636:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351472256 00000100:00100000:1.0:1788797048.501348:0:7636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 125 00000100:00100000:1.0:1788797048.501359:0:7636:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb047c18a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6d050bb-169e-4784-be5b-7071799bf3b0+15:10570:x1875689351472256:12345-192.168.204.38@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788797048.501425:0:7636:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788797048.501468:0:7636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040030c00/0xca7fc0c411f93db4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee11a1 expref: 15 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797048.501496:0:7636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8cb06ce84f00) 00010000:00010000:1.0:1788797048.501502:0:7636:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788797048.501536:0:7636:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082044600/0xca7fc0c411f93dd7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797048.501551:0:7636:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082044600/0xca7fc0c411f93dd7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797048.501560:0:7636:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082044600/0xca7fc0c411f93dd7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788797048.502273:0:7636:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d92e5d9b reply state 0000000014cf5a51 transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082044600/0xca7fc0c411f93dd7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788797048.502285:0:7636:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788797048.502441:0:7636:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb047c18a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6d050bb-169e-4784-be5b-7071799bf3b0+16:10570:x1875689351472256:12345-192.168.204.38@tcp:36:lhsmtool_posix.0 Request processed in 1082us (1306us total) trans 4294967401 rc 0/0 00000100:00100000:1.0:1788797048.502450:0:7636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 125 00000100:00100000:2.0:1788797048.507914:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1788797048.507949:0:10829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351472384 00000100:00100000:2.0:1788797048.507959:0:10829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351472384 00000100:00100000:2.0:1788797048.508012:0:10829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 45 00000100:00100000:2.0:1788797048.508024:0:10829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb06f57df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e6d050bb-169e-4784-be5b-7071799bf3b0+6:2352:x1875689351472384:12345-192.168.204.38@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1788797048.508298:0:10829:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:2.0:1788797048.508303:0:10829:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 1788797048 -> 1788797048 00002000:00010000:2.0:1788797048.508305:0:10829:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 1788797047 00002000:00010000:2.0:1788797048.508307:0:10829:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 1788797048 -> 1788797048 00002000:00010000:2.0:1788797048.508310:0:10829:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:2.0:1788797048.508366:0:10829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb06f57df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e6d050bb-169e-4784-be5b-7071799bf3b0+7:2352:x1875689351472384:12345-192.168.204.38@tcp:2:lhsmtool_posix.0 Request processed in 344us (463us total) trans 4294967311 rc 0/0 00000100:00100000:2.0:1788797048.508374:0:10829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 45 00010000:00010000:1.0:1788797048.509161:0:3286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082044600/0xca7fc0c411f93dd7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797048.509176:0:3286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082044600/0xca7fc0c411f93dd7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797048.509193:0:3286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082044600/0xca7fc0c411f93dd7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797048.509200:0:3286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb082044600 already unused, calling callback (ffffffffc1f014f0) 00010000:00010000:1.0:1788797048.509210:0:3286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082044600/0xca7fc0c411f93dd7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797048.509220:0:3286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082044600/0xca7fc0c411f93dd7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797048.509239:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8cb06ce84f00) 00010000:00010000:1.0:1788797048.509242:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788797048.509248:0:3286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082044600/0xca7fc0c411f93dd7 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797048.509254:0:3286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082044600/0xca7fc0c411f93dd7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788797048.512826:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1788797048.513120:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351472640 00000100:00100000:0.0:1788797048.513130:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351472640 00000100:00100000:0.0:1788797048.513196:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 126 00000100:00100000:0.0:1788797048.513215:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb06f57f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6d050bb-169e-4784-be5b-7071799bf3b0+15:10570:x1875689351472640:12345-192.168.204.38@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1788797048.513285:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3400/0xca7fc0c411f93dde lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797048.513303:0:5826:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045c00/0xca7fc0c411f93d98 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1193 expref: 15 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797048.513313:0:5826:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3400/0xca7fc0c411f93dde lrc: 4/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797048.513348:0:5826:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045c00/0xca7fc0c411f93d98 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1193 expref: 15 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797048.513363:0:5826:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045c00/0xca7fc0c411f93d98 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1193 expref: 15 pid: 5825 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788797048.513377:0:5826:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb047c18000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5826:1875689374551424:192.168.204.38@tcp:104: 00000100:00100000:0.0:1788797048.513481:0:5826:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb043739540 going to sleep for 11 seconds 00000100:00100000:1.0:1788797048.518791:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1788797048.521456:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351472768 00000100:00100000:2.0:1788797048.521473:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351472768 00010000:00010000:2.0:1788797048.521524:0:5812:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045c00/0xca7fc0c411f93d98 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1193 expref: 16 pid: 5825 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788797048.521586:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 55 00000100:00100000:2.0:1788797048.521598:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb077e32300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e6d050bb-169e-4784-be5b-7071799bf3b0+16:2354:x1875689351472768:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788797048.521618:0:5812:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788797048.521626:0:5812:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045c00/0xca7fc0c411f93d98 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1193 expref: 16 pid: 5825 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797048.521667:0:5812:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045c00/0xca7fc0c411f93d98 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1193 expref: 16 pid: 5825 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797048.521694:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8cb06ce84f00) 00010000:00010000:2.0:1788797048.521699:0:5812:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3400/0xca7fc0c411f93dde lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797048.521711:0:5812:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3400/0xca7fc0c411f93dde lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797048.521719:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3400/0xca7fc0c411f93dde lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797048.521738:0:5812:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788797048.521815:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb077e32300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e6d050bb-169e-4784-be5b-7071799bf3b0+16:2354:x1875689351472768:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 220us (3035us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797048.521822:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 55 00010000:00010000:0.0:1788797048.522157:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045c00/0xca7fc0c411f93d98 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1193 expref: 15 pid: 5825 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788797048.522176:0:5826:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb047c18000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5826:1875689374551424:192.168.204.38@tcp:104: 00010000:00010000:0.0:1788797048.522200:0:5826:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3400/0xca7fc0c411f93dde lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797048.522209:0:5826:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3400/0xca7fc0c411f93dde lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797048.522216:0:5826:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3400/0xca7fc0c411f93dde lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797048.522243:0:5826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3400/0xca7fc0c411f93dde lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797048.522250:0:5826:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3400/0xca7fc0c411f93dde lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797048.522257:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3400/0xca7fc0c411f93dde lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797048.522263:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb042ea3400 already unused, calling callback (ffffffffc1f014f0) 00010000:00010000:0.0:1788797048.522267:0:5826:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3400/0xca7fc0c411f93dde lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797048.522274:0:5826:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3400/0xca7fc0c411f93dde lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797048.522284:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8cb06ce84f00) 00010000:00010000:0.0:1788797048.522286:0:5826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1788797048.522299:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3400/0xca7fc0c411f93dde lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797048.522306:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3400/0xca7fc0c411f93dde lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788797048.522350:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb06f57f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6d050bb-169e-4784-be5b-7071799bf3b0+14:10570:x1875689351472640:12345-192.168.204.38@tcp:55:lhsmtool_posix.0 Request processed in 9145us (9535us total) trans 0 rc -22/-22 00000100:00100000:0.0:1788797048.522358:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 126 00000100:00100000:2.0:1788797048.530053:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1788797048.530153:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351472896 00000100:00100000:0.0:1788797048.530164:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351472896 00000100:00100000:0.0:1788797048.530215:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 46 00000100:00100000:0.0:1788797048.530225:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb06f57f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e6d050bb-169e-4784-be5b-7071799bf3b0+7:2355:x1875689351472896:12345-192.168.204.38@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1788797048.530268:0:6684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000448ef9a1/0xca7fc0c411f93de5 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797048.530288:0:6684:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000081d7bd36/0xca7fc0c411f93dc2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee11af expref: 7 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797048.530297:0:6684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788797048.530301:0:6684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788797048.530305:0:6684:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000448ef9a1/0xca7fc0c411f93de5 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797048.530341:0:6684:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000081d7bd36/0xca7fc0c411f93dc2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee11af expref: 7 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797048.530356:0:6684:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000081d7bd36/0xca7fc0c411f93dc2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee11af expref: 7 pid: 6681 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788797048.530385:0:6684:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb047c18000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6684:1875689374551552:192.168.204.38@tcp:104: 00000100:00100000:0.0:1788797048.530471:0:6684:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb043739540 going to sleep for 11 seconds 00000100:00100000:0.0:1788797048.537613:0:6684:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb047c18000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6684:1875689374551552:192.168.204.38@tcp:104: 00010000:00010000:0.0:1788797048.537651:0:6684:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000448ef9a1/0xca7fc0c411f93de5 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788797048.538235:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1788797048.538417:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351473024 00000100:00100000:3.0:1788797048.538426:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351473024 00010000:00010000:3.0:1788797048.538485:0:6698:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000081d7bd36/0xca7fc0c411f93dc2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee11af expref: 8 pid: 6681 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788797048.538584:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 56 00000100:00100000:3.0:1788797048.538596:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb06f57d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e6d050bb-169e-4784-be5b-7071799bf3b0+8:2355:x1875689351473024:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788797048.538614:0:6698:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788797048.538640:0:6698:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000081d7bd36/0xca7fc0c411f93dc2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee11af expref: 8 pid: 6681 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797048.538654:0:6698:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000081d7bd36/0xca7fc0c411f93dc2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee11af expref: 8 pid: 6681 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797048.538684:0:6698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000081d7bd36/0xca7fc0c411f93dc2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee11af expref: 8 pid: 6681 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797048.538723:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788797048.538727:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788797048.538747:0:6698:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000448ef9a1/0xca7fc0c411f93de5 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797048.538758:0:6698:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000448ef9a1/0xca7fc0c411f93de5 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797048.538791:0:6698:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788797048.538892:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb06f57d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e6d050bb-169e-4784-be5b-7071799bf3b0+7:2355:x1875689351473024:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 298us (660us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797048.538900:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 56 00010000:00010000:1.0:1788797048.539061:0:6684:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000448ef9a1/0xca7fc0c411f93de5 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797048.539071:0:6684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000448ef9a1/0xca7fc0c411f93de5 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797048.539113:0:6684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000448ef9a1/0xca7fc0c411f93de5 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797048.539429:0:6684:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000448ef9a1/0xca7fc0c411f93de5 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797048.539439:0:6684:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000448ef9a1/0xca7fc0c411f93de5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797048.539446:0:6684:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb042ea3400 already unused, calling callback (ffffffffc14d98b0) 00010000:00010000:1.0:1788797048.539450:0:6684:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000448ef9a1/0xca7fc0c411f93de5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797048.539460:0:6684:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000448ef9a1/0xca7fc0c411f93de5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797048.539474:0:6684:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000448ef9a1/0xca7fc0c411f93de5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797048.539482:0:6684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000448ef9a1/0xca7fc0c411f93de5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788797048.539538:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb06f57f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e6d050bb-169e-4784-be5b-7071799bf3b0+6:2355:x1875689351472896:12345-192.168.204.38@tcp:1:lhsmtool_posix.0 Request processed in 9313us (9522us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797048.539547:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 46 00000100:00100000:3.0:1788797048.546591:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1788797048.549868:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351473280 00000100:00100000:1.0:1788797048.549896:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351473280 00000100:00100000:0.0:1788797048.550114:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 127 00000100:00100000:0.0:1788797048.550238:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb079bc1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6d050bb-169e-4784-be5b-7071799bf3b0+14:10570:x1875689351473280:12345-192.168.204.38@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1788797048.550318:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2a00/0xca7fc0c411f93dec lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797048.550338:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2a00/0xca7fc0c411f93dec lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797048.550350:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2a00/0xca7fc0c411f93dec lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797048.550716:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3800/0xca7fc0c411f93df3 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797048.550728:0:5825:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040031e00/0xca7fc0c411f93da6 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee119a expref: 15 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797048.550801:0:5825:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3800/0xca7fc0c411f93df3 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797048.550836:0:5825:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040031e00/0xca7fc0c411f93da6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee119a expref: 15 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797048.550865:0:5825:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040031e00/0xca7fc0c411f93da6 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee119a expref: 15 pid: 5827 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788797048.550891:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb047c18000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5825:1875689374551680:192.168.204.38@tcp:104: 00000100:00100000:0.0:1788797048.551060:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb043739540 going to sleep for 11 seconds 00000100:00100000:0.0:1788797048.557489:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb047c18000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5825:1875689374551680:192.168.204.38@tcp:104: 00010000:00010000:0.0:1788797048.557528:0:5825:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3800/0xca7fc0c411f93df3 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788797048.567971:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1788797048.568294:0:11663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351473408 00000100:00100000:0.0:1788797048.568307:0:11663:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351473408 00010000:00010000:0.0:1788797048.568359:0:11663:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040031e00/0xca7fc0c411f93da6 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee119a expref: 16 pid: 5827 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788797048.568408:0:11663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 57 00000100:00100000:0.0:1788797048.568427:0:11663:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb079bc1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e6d050bb-169e-4784-be5b-7071799bf3b0+16:2352:x1875689351473408:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788797048.568443:0:11663:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788797048.568449:0:11663:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040031e00/0xca7fc0c411f93da6 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee119a expref: 16 pid: 5827 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797048.568464:0:11663:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040031e00/0xca7fc0c411f93da6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee119a expref: 16 pid: 5827 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797048.568489:0:11663:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040031e00/0xca7fc0c411f93da6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee119a expref: 16 pid: 5827 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797048.568526:0:11663:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8cb06ce84f00) 00010000:00010000:0.0:1788797048.568532:0:11663:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3800/0xca7fc0c411f93df3 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797048.568542:0:11663:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3800/0xca7fc0c411f93df3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797048.568550:0:11663:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3800/0xca7fc0c411f93df3 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797048.568586:0:11663:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788797048.568655:0:11663:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb079bc1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e6d050bb-169e-4784-be5b-7071799bf3b0+15:2352:x1875689351473408:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 237us (3202us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797048.568663:0:11663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 57 00010000:00010000:3.0:1788797048.569430:0:5825:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3800/0xca7fc0c411f93df3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797048.569441:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3800/0xca7fc0c411f93df3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788797048.569653:0:5825:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967402 00000001:00080000:3.0:1788797048.569831:0:5825:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967403 00000001:00080000:3.0:1788797048.569891:0:5825:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000100:00100000:3.0:1788797048.569981:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb079bc2680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5825:1875689374551808:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1788797048.570077:0:5825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788797048.570243:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374551808 00000100:00100000:2.0:1788797048.570249:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374551808 00000100:00100000:2.0:1788797048.570297:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788797048.570306:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb079bc3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5825:x1875689374551808:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1788797048.570397:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb079bc3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5825:x1875689374551808:12345-0@lo:1000:mdt00_000.0 Request processed in 92us (320us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797048.570404:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788797048.570984:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb0467de840 going to sleep for 11 seconds 00000100:00100000:3.0:1788797048.571011:0:5825:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967309 gen 2 00000004:00080000:3.0:1788797048.571025:0:5825:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967305 committed transno 4294967309 00000004:00080000:3.0:1788797048.571084:0:5825:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8cb050384a80, transno 4294967309 00000100:00100000:3.0:1788797048.571848:0:5825:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff8cb050386300 x1875689374551040/t4294967310(4294967310) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788797064 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788797048.571866:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb079bc2680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5825:1875689374551808:0@lo:1000:mdt00_000.0 00000001:00080000:3.0:1788797048.572516:0:5825:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000100:00100000:3.0:1788797048.572620:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb079bc2680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5825:1875689374551936:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1788797048.572671:0:5825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788797048.572715:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb06cfc1840 going to sleep for 11 seconds 00000100:00100000:0.0:1788797048.573279:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374551936 00000100:00100000:0.0:1788797048.573287:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374551936 00000100:00100000:0.0:1788797048.573336:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788797048.573346:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb079bc0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5825:x1875689374551936:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1788797048.574407:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb079bc0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5825:x1875689374551936:12345-0@lo:1000:mdt00_000.0 Request processed in 1057us (1729us total) trans 4294967312 rc 0/0 00000100:00100000:1.0:1788797048.574570:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb079bc2680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5825:1875689374551936:0@lo:1000:mdt00_000.0 00010000:00010000:1.0:1788797048.574622:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3800/0xca7fc0c411f93df3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797048.574633:0:5825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3800/0xca7fc0c411f93df3 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797048.574640:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3800/0xca7fc0c411f93df3 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797048.574646:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb042ea3800 already unused, calling callback (ffffffffc1f014f0) 00010000:00010000:1.0:1788797048.574650:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3800/0xca7fc0c411f93df3 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797048.574658:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3800/0xca7fc0c411f93df3 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797048.574672:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8cb06ce84f00) 00010000:00010000:1.0:1788797048.574675:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788797048.574680:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3800/0xca7fc0c411f93df3 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797048.574686:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3800/0xca7fc0c411f93df3 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797048.574717:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045e00/0xca7fc0c411f93d36 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797048.574724:0:5825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045e00/0xca7fc0c411f93d36 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797048.574730:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045e00/0xca7fc0c411f93d36 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797048.574744:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb082045e00 already unused, calling callback (ffffffffc1f014f0) 00010000:00010000:1.0:1788797048.574748:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045e00/0xca7fc0c411f93d36 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797048.574754:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045e00/0xca7fc0c411f93d36 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797048.574763:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8cb058766700) 00010000:00010000:1.0:1788797048.574765:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788797048.574772:0:5825:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045400/0xca7fc0c411f93d3d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee117e expref: 18 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797048.574783:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045400/0xca7fc0c411f93d3d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee117e expref: 18 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797048.574793:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045400/0xca7fc0c411f93d3d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee117e expref: 18 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797048.574826:0:5825:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045400/0xca7fc0c411f93d3d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee117e expref: 18 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788797048.574839:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb077e31880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5825:1875689374552064:192.168.204.38@tcp:105: 00000100:00100000:0.0:1788797048.574930:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788797048.575376:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb0698eff00 going to sleep for 11 seconds 00000100:00100000:0.0:1788797048.580484:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb077e31880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5825:1875689374552064:192.168.204.38@tcp:105: 00010000:00010000:0.0:1788797048.580514:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045e00/0xca7fc0c411f93d36 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797048.580525:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045e00/0xca7fc0c411f93d36 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797048.580568:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2200/0xca7fc0c411f93dfa lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797048.580584:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2200/0xca7fc0c411f93dfa lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797048.580597:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2200/0xca7fc0c411f93dfa lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797048.580608:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2200/0xca7fc0c411f93dfa lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797048.580614:0:5825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2200/0xca7fc0c411f93dfa lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797048.580621:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2200/0xca7fc0c411f93dfa lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797048.580626:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb042ea2200 already unused, calling callback (ffffffffc1f014f0) 00010000:00010000:0.0:1788797048.580630:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2200/0xca7fc0c411f93dfa lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797048.580636:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2200/0xca7fc0c411f93dfa lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797048.580647:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8cb058766700) 00010000:00010000:0.0:1788797048.580650:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788797048.580654:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2200/0xca7fc0c411f93dfa lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797048.580659:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2200/0xca7fc0c411f93dfa lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797048.580674:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2a00/0xca7fc0c411f93dec lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797048.580679:0:5825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2a00/0xca7fc0c411f93dec lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797048.580685:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2a00/0xca7fc0c411f93dec lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797048.580690:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb042ea2a00 already unused, calling callback (ffffffffc1f014f0) 00010000:00010000:0.0:1788797048.580692:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2a00/0xca7fc0c411f93dec lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797048.580697:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2a00/0xca7fc0c411f93dec lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797048.580705:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8cb058766700) 00010000:00010000:0.0:1788797048.580707:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788797048.580710:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2a00/0xca7fc0c411f93dec lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797048.580886:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2a00/0xca7fc0c411f93dec lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788797048.581367:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb079bc1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6d050bb-169e-4784-be5b-7071799bf3b0+18:10570:x1875689351473280:12345-192.168.204.38@tcp:57:lhsmtool_posix.0 Request processed in 31131us (34788us total) trans 4294967406 rc 0/0 00000100:00100000:0.0:1788797048.581377:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 127 00000020:00080000:0.0:1788797048.581383:0:5825:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1788797048.581584:0:11679:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788797048.581595:0:11679:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788797048.582982:0:11679:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:2.0:1788797048.582999:0:11679:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788797048.585559:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1788797048.585640:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1788797048.585881:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351473536 00000100:00100000:0.0:1788797048.585899:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351473536 00000100:00100000:0.0:1788797048.585954:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351473792 00000100:00100000:0.0:1788797048.585958:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351473792 00000100:00100000:0.0:1788797048.585977:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 31 00000100:00100000:0.0:1788797048.585986:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb077e31c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e6d050bb-169e-4784-be5b-7071799bf3b0+19:10569:x1875689351473536:12345-192.168.204.38@tcp:49:lfs.0 00000100:00100000:0.0:1788797048.586182:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb077e31c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e6d050bb-169e-4784-be5b-7071799bf3b0+19:10569:x1875689351473536:12345-192.168.204.38@tcp:49:lfs.0 Request processed in 196us (632us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797048.586190:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 31 00000100:00100000:0.0:1788797048.586209:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 32 00000100:00100000:0.0:1788797048.586216:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb050637c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e6d050bb-169e-4784-be5b-7071799bf3b0+18:10570:x1875689351473792:12345-192.168.204.38@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1788797048.586905:0:5829:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1788797048.587019:0:5829:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00010000:00010000:0.0:1788797048.587104:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2c00/0xca7fc0c411f93e01 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797048.587123:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2c00/0xca7fc0c411f93e01 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797048.587137:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2c00/0xca7fc0c411f93e01 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797048.587147:0:5829:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2c00/0xca7fc0c411f93e01 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797048.587154:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2c00/0xca7fc0c411f93e01 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797048.587161:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2c00/0xca7fc0c411f93e01 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797048.587177:0:5829:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788797048.587258:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb050637c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e6d050bb-169e-4784-be5b-7071799bf3b0+20:10570:x1875689351473792:12345-192.168.204.38@tcp:35:lhsmtool_posix.0 Request processed in 1038us (1614us total) trans 4294967408 rc 0/0 00000100:00100000:0.0:1788797048.587267:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 32 00000020:00080000:0.0:1788797048.587271:0:5829:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788797048.587348:0:8446:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788797048.587355:0:8446:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2c00/0xca7fc0c411f93e01 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797048.587373:0:8446:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb042ea2c00 already unused, calling callback (ffffffffc14d98b0) 00010000:00010000:1.0:1788797048.587377:0:8446:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2c00/0xca7fc0c411f93e01 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797048.587385:0:8446:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2c00/0xca7fc0c411f93e01 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797048.587398:0:8446:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8cb058766b00) 00010000:00010000:1.0:1788797048.587401:0:8446:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788797048.587666:0:8446:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2c00/0xca7fc0c411f93e01 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797048.587674:0:8446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2c00/0xca7fc0c411f93e01 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797048.587694:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788797048.587696:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788797048.587845:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788797048.592670:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1788797048.592899:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351474048 00000100:00100000:0.0:1788797048.592909:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351474048 00000100:00100000:0.0:1788797048.593017:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 128 00000100:00100000:0.0:1788797048.593053:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb077e32680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6d050bb-169e-4784-be5b-7071799bf3b0+20:10569:x1875689351474048:12345-192.168.204.38@tcp:58:lfs.0 00000040:00080000:0.0:1788797048.593337:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:0.0:1788797048.593410:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb077e32680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6d050bb-169e-4784-be5b-7071799bf3b0+20:10569:x1875689351474048:12345-192.168.204.38@tcp:58:lfs.0 Request processed in 384us (754us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797048.593426:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 128 00010000:00010000:2.0:1788797048.632529:0:5815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788797048.642572:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1788797048.642866:0:7636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351474176 00000100:00100000:1.0:1788797048.642887:0:7636:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351474176 00000100:00100000:1.0:1788797048.643011:0:7636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 129 00000100:00100000:1.0:1788797048.643023:0:7636:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb079bc1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6d050bb-169e-4784-be5b-7071799bf3b0+20:10572:x1875689351474176:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1788797048.643086:0:7636:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788797048.643118:0:7636:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045c00/0xca7fc0c411f93e08 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c99e04559ee11b6 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797048.643197:0:7636:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082044600/0xca7fc0c411f93e0f lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797048.643232:0:7636:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082044600/0xca7fc0c411f93e0f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797048.643243:0:7636:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082044600/0xca7fc0c411f93e0f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797048.643260:0:7636:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045600/0xca7fc0c411f93e16 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797048.643268:0:7636:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045600/0xca7fc0c411f93e16 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797048.643275:0:7636:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045600/0xca7fc0c411f93e16 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797048.643539:0:7636:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082044200/0xca7fc0c411f93e1d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797048.643550:0:7636:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045200/0xca7fc0c411f93d28 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1177 expref: 21 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797048.643560:0:7636:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082044200/0xca7fc0c411f93e1d lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797048.643609:0:7636:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045200/0xca7fc0c411f93d28 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1177 expref: 21 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797048.643625:0:7636:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045200/0xca7fc0c411f93d28 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1177 expref: 21 pid: 7636 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788797048.643651:0:7636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb077e33b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7636:1875689374552192:192.168.204.38@tcp:104: 00000100:00100000:1.0:1788797048.643765:0:7636:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb0698ef300 going to sleep for 11 seconds 00000100:00100000:1.0:1788797048.645848:0:7636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb077e33b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7636:1875689374552192:192.168.204.38@tcp:104: 00010000:00010000:1.0:1788797048.645906:0:7636:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082044200/0xca7fc0c411f93e1d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788797048.646487:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1788797048.647206:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351474432 00000100:00100000:0.0:1788797048.647216:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351474432 00000100:00100000:0.0:1788797048.647312:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 33 00000100:00100000:0.0:1788797048.647322:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb079bc3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e6d050bb-169e-4784-be5b-7071799bf3b0+22:5609:x1875689351474432:12345-192.168.204.38@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1788797048.647579:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb079bc3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e6d050bb-169e-4784-be5b-7071799bf3b0+23:5609:x1875689351474432:12345-192.168.204.38@tcp:35:ldlm_bl.0 Request processed in 251us (1087us total) trans 4294967409 rc 0/0 00000100:00100000:0.0:1788797048.647594:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 33 00000100:00100000:2.0:1788797048.650594:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1788797048.650749:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351474560 00000100:00100000:1.0:1788797048.650759:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351474560 00010000:00010000:1.0:1788797048.650796:0:5811:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045200/0xca7fc0c411f93d28 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1177 expref: 23 pid: 7636 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788797048.650838:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 58 00000100:00100000:1.0:1788797048.650848:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb06f57f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e6d050bb-169e-4784-be5b-7071799bf3b0+23:2355:x1875689351474560:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788797048.650862:0:5811:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788797048.650878:0:5811:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045200/0xca7fc0c411f93d28 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1177 expref: 23 pid: 7636 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797048.650892:0:5811:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045200/0xca7fc0c411f93d28 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1177 expref: 23 pid: 7636 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797048.650916:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045200/0xca7fc0c411f93d28 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1177 expref: 23 pid: 7636 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797048.650934:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8cb058766700) 00010000:00010000:1.0:1788797048.650939:0:5811:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082044200/0xca7fc0c411f93e1d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797048.650965:0:5811:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082044200/0xca7fc0c411f93e1d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797048.650973:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082044200/0xca7fc0c411f93e1d lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797048.651008:0:5811:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788797048.651052:0:7636:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082044200/0xca7fc0c411f93e1d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797048.651060:0:7636:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082044200/0xca7fc0c411f93e1d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788797048.651128:0:7636:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:2.0:1788797048.651133:0:7636:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788797048.651156:0:7636:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082044200/0xca7fc0c411f93e1d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797048.651170:0:7636:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082044200/0xca7fc0c411f93e1d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797048.651179:0:7636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082044600/0xca7fc0c411f93e0f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797048.651186:0:7636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082044600/0xca7fc0c411f93e0f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797048.651193:0:7636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082044600/0xca7fc0c411f93e0f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797048.651199:0:7636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb082044600 already unused, calling callback (ffffffffc1f014f0) 00010000:00010000:2.0:1788797048.651203:0:7636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082044600/0xca7fc0c411f93e0f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797048.651211:0:7636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082044600/0xca7fc0c411f93e0f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797048.651228:0:7636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8cb06ce84d00) 00010000:00010000:2.0:1788797048.651231:0:7636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788797048.651236:0:7636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082044600/0xca7fc0c411f93e0f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797048.651242:0:7636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082044600/0xca7fc0c411f93e0f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797048.651255:0:7636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045600/0xca7fc0c411f93e16 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797048.651261:0:7636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045600/0xca7fc0c411f93e16 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797048.651268:0:7636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045600/0xca7fc0c411f93e16 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797048.651274:0:7636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb082045600 already unused, calling callback (ffffffffc1f014f0) 00010000:00010000:2.0:1788797048.651276:0:7636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045600/0xca7fc0c411f93e16 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797048.651282:0:7636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045600/0xca7fc0c411f93e16 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797048.651290:0:7636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8cb06ce84f00) 00010000:00010000:2.0:1788797048.651293:0:7636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788797048.651296:0:7636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045600/0xca7fc0c411f93e16 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797048.651302:0:7636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045600/0xca7fc0c411f93e16 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788797048.651319:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb06f57f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e6d050bb-169e-4784-be5b-7071799bf3b0+22:2355:x1875689351474560:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 278us (554us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797048.651326:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 58 00010000:00010000:2.0:1788797048.651351:0:7636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045c00/0xca7fc0c411f93e08 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee11b6 expref: 22 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797048.651370:0:7636:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082044200/0xca7fc0c411f93e1d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee11b6 expref: 21 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797048.651378:0:7636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8cb058766700) 00010000:00010000:2.0:1788797048.651380:0:7636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788797048.651382:0:7636:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb082044200, rc 0) 00000100:00100000:2.0:1788797048.651418:0:7636:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb079bc1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6d050bb-169e-4784-be5b-7071799bf3b0+21:10572:x1875689351474176:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 8388us (8848us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797048.651426:0:7636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 129 00000001:00080000:1.0:1788797048.936127:0:7640:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00000001:00080000:1.0:1788797048.936887:0:7640:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967301 is committed 00000001:00080000:1.0:1788797048.942625:0:7640:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967304 is committed 00000040:00080000:1.0:1788797049.557417:0:12048:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788797049.559556:0:12048:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788797049.559677:0:12048:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1788797049.559686:0:12048:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:2.0:1788797049.586836:0:11679:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788797049.586860:0:11679:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788797049.586929:0:11679:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1788797049.586942:0:11679:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788797049.587128:0:11679:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb06f57ea00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11679:1875689374552320:192.168.204.38@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788797049.587253:0:11679:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb04887e0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788797049.594558:0:11679:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb06f57ea00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11679:1875689374552320:192.168.204.38@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788797049.623576:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1788797049.623657:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351474688 00000100:00100000:2.0:1788797049.623671:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351474688 00000100:00100000:2.0:1788797049.623769:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 130 00000100:00100000:2.0:1788797049.623782:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb079bc3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6d050bb-169e-4784-be5b-7071799bf3b0+21:10583:x1875689351474688:12345-192.168.204.38@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788797049.623828:0:5826:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788797049.624017:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb079bc3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6d050bb-169e-4784-be5b-7071799bf3b0+21:10583:x1875689351474688:12345-192.168.204.38@tcp:53:lhsmtool_posix.0 Request processed in 239us (454us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797049.624055:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 130 00000100:00080000:2.0:1788797049.624080:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788797049.641158:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1788797049.641382:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351474944 00000100:00100000:1.0:1788797049.641397:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351474944 00000100:00100000:1.0:1788797049.641501:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 131 00000100:00100000:1.0:1788797049.641514:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb079bc1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6d050bb-169e-4784-be5b-7071799bf3b0+21:10583:x1875689351474944:12345-192.168.204.38@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788797049.641537:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788797049.641563:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045200/0xca7fc0c411f93e24 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c99e04559ee11bd expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797049.641707:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045e00/0xca7fc0c411f93e2b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797049.641739:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045e00/0xca7fc0c411f93e2b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797049.641759:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045e00/0xca7fc0c411f93e2b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788797049.641775:0:5825:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:1.0:1788797049.641968:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045200/0xca7fc0c411f93e24 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee11bd expref: 24 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797049.641989:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045e00/0xca7fc0c411f93e2b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee11bd expref: 23 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797049.641999:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8cb058766700) 00010000:00010000:1.0:1788797049.642002:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788797049.642006:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb082045e00, rc 0) 00000100:00100000:1.0:1788797049.642112:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb079bc1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6d050bb-169e-4784-be5b-7071799bf3b0+23:10583:x1875689351474944:12345-192.168.204.38@tcp:101:lhsmtool_posix.0 Request processed in 601us (966us total) trans 4294967410 rc 0/0 00000100:00100000:1.0:1788797049.642119:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 131 00000100:00100000:3.0:1788797049.645714:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1788797049.645776:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1788797049.645959:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351475072 00000100:00100000:1.0:1788797049.645974:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351475072 00000100:00100000:1.0:1788797049.646083:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9 00000100:00100000:1.0:1788797049.646097:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb079bc3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e6d050bb-169e-4784-be5b-7071799bf3b0+23:2353:x1875689351475072:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788797049.646120:0:6698:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788797049.646159:0:6698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045e00/0xca7fc0c411f93e2b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee11bd expref: 23 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797049.646200:0:6698:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8cb058766700) 00010000:00010000:1.0:1788797049.646206:0:6698:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788797049.646284:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb079bc3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e6d050bb-169e-4784-be5b-7071799bf3b0+22:2353:x1875689351475072:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 190us (581us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797049.646943:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9 00000100:00100000:2.0:1788797049.647077:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351475328 00000100:00100000:2.0:1788797049.647085:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351475328 00000100:00100000:2.0:1788797049.647134:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 132 00000100:00100000:2.0:1788797049.647142:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb079bc2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6d050bb-169e-4784-be5b-7071799bf3b0+22:10583:x1875689351475328:12345-192.168.204.38@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1788797049.647233:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040030800/0xca7fc0c411f93e39 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797049.647250:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040030800/0xca7fc0c411f93e39 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797049.647263:0:5827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040030800/0xca7fc0c411f93e39 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797049.647618:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040030800/0xca7fc0c411f93e39 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797049.647628:0:5827:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040030800/0xca7fc0c411f93e39 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797049.647636:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040030800/0xca7fc0c411f93e39 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797049.647643:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb040030800 already unused, calling callback (ffffffffc1f014f0) 00010000:00010000:2.0:1788797049.647649:0:5827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040030800/0xca7fc0c411f93e39 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797049.647658:0:5827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040030800/0xca7fc0c411f93e39 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797049.647688:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8cb058766700) 00010000:00010000:2.0:1788797049.647690:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788797049.647697:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040030800/0xca7fc0c411f93e39 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797049.647703:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040030800/0xca7fc0c411f93e39 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788797049.647964:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb079bc2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6d050bb-169e-4784-be5b-7071799bf3b0+23:10583:x1875689351475328:12345-192.168.204.38@tcp:57:lhsmtool_posix.0 Request processed in 821us (2185us total) trans 4294967411 rc 0/0 00000100:00100000:2.0:1788797049.647973:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 132 00000040:00080000:3.0:1788797049.649846:0:11679:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788797049.650130:0:11679:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788797049.650626:0:11679:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:3.0:1788797049.650636:0:11679:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1788797049.650777:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788797049.653049:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1788797049.653132:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351475584 00000100:00100000:2.0:1788797049.653146:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351475584 00000100:00100000:2.0:1788797049.653218:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 34 00000100:00100000:2.0:1788797049.653230:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb079bc0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e6d050bb-169e-4784-be5b-7071799bf3b0+23:10583:x1875689351475584:12345-192.168.204.38@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788797049.653593:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb079bc0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e6d050bb-169e-4784-be5b-7071799bf3b0+24:10583:x1875689351475584:12345-192.168.204.38@tcp:35:lhsmtool_posix.0 Request processed in 363us (583us total) trans 4294967412 rc 0/0 00000100:00100000:2.0:1788797049.653603:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 34 00010000:00010000:1.0:1788797050.676223:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788797051.535223:0:12100:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788797051.535238:0:12100:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788797051.535285:0:12100:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1788797051.535292:0:12100:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1788797051.698505:0:5815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788797051.803624:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1788797051.803670:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1788797051.803708:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1788797051.803742:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1788797051.803767:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1788797051.803798:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351475712 00000100:00100000:2.0:1788797051.803818:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351475712 00000100:00100000:2.0:1788797051.803868:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 294 00000100:00100000:2.0:1788797051.803880:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb060704c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4d9d1a9-601d-459e-8721-8bfc2fdde84f+13:2354:x1875689351475712:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:2.0:1788797051.804205:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb060704c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4d9d1a9-601d-459e-8721-8bfc2fdde84f+13:2354:x1875689351475712:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 92us (260us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797051.804214:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 294 00000100:00100000:2.0:1788797051.804339:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351476096 00000100:00100000:2.0:1788797051.804344:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351476096 00000100:00100000:2.0:1788797051.804391:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351475968 00000100:00100000:2.0:1788797051.804395:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351475968 00000100:00100000:0.0:1788797051.804523:0:10829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 56 00000100:00100000:0.0:1788797051.804534:0:10829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb06f57d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e6d050bb-169e-4784-be5b-7071799bf3b0+5:2354:x1875689351476096:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:0.0:1788797051.804575:0:10829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb06f57d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e6d050bb-169e-4784-be5b-7071799bf3b0+5:2354:x1875689351476096:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 45us (905us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797051.804582:0:10829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 56 00000100:00080000:0.0:1788797051.804621:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788797051.804637:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351475840 00000100:00100000:0.0:1788797051.804648:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351475840 00000100:00100000:0.0:1788797051.804687:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351476224 00000100:00100000:0.0:1788797051.804689:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351476224 00000100:00100000:0.0:1788797051.804709:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 147 00000100:00100000:0.0:1788797051.804725:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb06f57c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6d050bb-169e-4784-be5b-7071799bf3b0+24:2354:x1875689351475840:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:0.0:1788797051.804759:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb06f57c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6d050bb-169e-4784-be5b-7071799bf3b0+24:2354:x1875689351475840:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 43us (1150us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797051.804766:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 147 00000100:00100000:0.0:1788797051.804781:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 148 00000100:00100000:0.0:1788797051.804787:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb06f57c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed124ec0-b908-4000-b768-8e53d5def0fc+5:2354:x1875689351476224:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:0.0:1788797051.804823:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb06f57c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed124ec0-b908-4000-b768-8e53d5def0fc+5:2354:x1875689351476224:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 36us (1055us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797051.804830:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 148 00000100:00080000:0.0:1788797051.804845:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788797051.805366:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 57 00000100:00100000:2.0:1788797051.805374:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb06f57ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e6d050bb-169e-4784-be5b-7071799bf3b0+6:2354:x1875689351475968:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:2.0:1788797051.805472:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb06f57ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e6d050bb-169e-4784-be5b-7071799bf3b0+6:2354:x1875689351475968:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 99us (1729us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797051.805480:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 57 00000100:00080000:0.0:1788797051.805565:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788797051.881464:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1788797051.882228:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351476480 00000100:00100000:3.0:1788797051.882242:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351476480 00000100:00100000:3.0:1788797051.882369:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 133 00000100:00100000:3.0:1788797051.882383:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb079bc1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6d050bb-169e-4784-be5b-7071799bf3b0+24:10604:x1875689351476480:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1788797051.882420:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788797051.882448:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c68800/0xca7fc0c411f93e40 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c99e04559ee11c4 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797051.882583:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69000/0xca7fc0c411f93e47 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797051.882601:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69000/0xca7fc0c411f93e47 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797051.882880:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69000/0xca7fc0c411f93e47 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788797051.882895:0:5825:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:3.0:1788797051.885475:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c68800/0xca7fc0c411f93e40 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee11c4 expref: 27 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797051.885508:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69000/0xca7fc0c411f93e47 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee11c4 expref: 26 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797051.885519:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8cb058766700) 00010000:00010000:3.0:1788797051.885522:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1788797051.885525:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb077c69000, rc 0) 00000100:00100000:3.0:1788797051.890738:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb079bc1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6d050bb-169e-4784-be5b-7071799bf3b0+26:10604:x1875689351476480:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 5349us (6278us total) trans 4294967413 rc 0/0 00000100:00100000:3.0:1788797051.890785:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 133 00000100:00100000:0.0:1788797051.906994:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1788797051.907092:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351476608 00000100:00100000:0.0:1788797051.907115:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351476608 00000100:00100000:0.0:1788797051.907212:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 134 00000100:00100000:0.0:1788797051.907226:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb047c1a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6d050bb-169e-4784-be5b-7071799bf3b0+26:10604:x1875689351476608:12345-192.168.204.38@tcp:54:lfs.0 00010000:00010000:0.0:1788797051.907534:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3400/0xca7fc0c411f93e55 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797051.907572:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3400/0xca7fc0c411f93e55 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797051.907600:0:5827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3400/0xca7fc0c411f93e55 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797051.907992:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3400/0xca7fc0c411f93e55 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797051.908003:0:5827:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3400/0xca7fc0c411f93e55 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797051.908011:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3400/0xca7fc0c411f93e55 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797051.908018:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb042ea3400 already unused, calling callback (ffffffffc1f014f0) 00010000:00010000:0.0:1788797051.908024:0:5827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3400/0xca7fc0c411f93e55 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797051.908070:0:5827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3400/0xca7fc0c411f93e55 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797051.908087:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8cb058766700) 00010000:00010000:0.0:1788797051.908090:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788797051.908097:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3400/0xca7fc0c411f93e55 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797051.910443:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3400/0xca7fc0c411f93e55 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788797051.910695:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb047c1a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6d050bb-169e-4784-be5b-7071799bf3b0+26:10604:x1875689351476608:12345-192.168.204.38@tcp:54:lfs.0 Request processed in 3460us (3707us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797051.910707:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 134 00000100:00100000:1.0:1788797052.124265:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1788797052.127504:0:10829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351476736 00000100:00100000:2.0:1788797052.127548:0:10829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351476736 00000100:00100000:2.0:1788797052.128411:0:10829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 47 00000100:00100000:2.0:1788797052.128438:0:10829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb077e33b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e6d050bb-169e-4784-be5b-7071799bf3b0+6:2352:x1875689351476736:12345-192.168.204.38@tcp:101:cat.0 00010000:00010000:2.0:1788797052.128473:0:10829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788797052.128512:0:10829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000042895792/0xca7fc0c411f93e5c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7c99e04559ee11cb expref: -99 pid: 10829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788797052.128702:0:10829:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a9ee078, atime: 0x6a9ee077, ctime: 0x6a9ee078, blocks: 0xb 00010000:00010000:2.0:1788797052.128831:0:10829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=341s v=(0 0) 00010000:00010000:2.0:1788797052.128837:0:10829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788797052.128858:0:10829:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000042895792/0xca7fc0c411f93e5c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee11cb expref: 7 pid: 10829 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797052.128939:0:10829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000042895792/0xca7fc0c411f93e5c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee11cb expref: 7 pid: 10829 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797052.128960:0:10829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb040030400, rc 0) 00000100:00100000:2.0:1788797052.129232:0:10829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb077e33b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e6d050bb-169e-4784-be5b-7071799bf3b0+7:2352:x1875689351476736:12345-192.168.204.38@tcp:101:cat.0 Request processed in 807us (4981us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797052.136963:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1788797052.137304:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351476864 00000100:00100000:3.0:1788797052.137321:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351476864 00002000:00100000:3.0:1788797052.137403:0:6688:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x4:0x0] (0->4095) req@ffff8cb077e30e00 x1875689351476864/t0(0) o3->e6d050bb-169e-4784-be5b-7071799bf3b0@192.168.204.38@tcp:478/0 lens 488/0 e 0 to 0 dl 1788797063 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788797052.137415:0:6688:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8cb077e30e00 with x1875689351476864 ext(0->4095) 00002000:00010000:3.0:1788797052.137423:0:6688:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8cb077e30e00 00000100:00100000:3.0:1788797052.137483:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3 00000100:00100000:3.0:1788797052.137498:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb077e30e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:e6d050bb-169e-4784-be5b-7071799bf3b0+8:2352:x1875689351476864:12345-192.168.204.38@tcp:3:cat.0 00000100:00100000:2.0:1788797052.137672:0:10829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 47 00000100:00100000:3.0:1788797052.137844:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb077e30e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:e6d050bb-169e-4784-be5b-7071799bf3b0+7:2352:x1875689351476864:12345-192.168.204.38@tcp:3:cat.0 Request processed in 348us (897us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1788797052.137852:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3 00002000:00100000:3.0:1788797052.137858:0:6688:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x4:0x0] (0->4095) req@ffff8cb077e30e00 x1875689351476864/t0(0) o3->e6d050bb-169e-4784-be5b-7071799bf3b0@192.168.204.38@tcp:478/0 lens 488/4536 e 0 to 0 dl 1788797063 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788797052.137866:0:6688:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8cb077e30e00 with x1875689351476864 ext(0->4095) 00002000:00010000:3.0:1788797052.137869:0:6688:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8cb077e30e00 00010000:00010000:3.0:1788797052.722261:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788797052.978380:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788797052.981113:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb077e31f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875689374552448:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788797052.981246:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788797052.983548:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374552448 00000100:00100000:0.0:1788797052.983574:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374552448 00000100:00100000:0.0:1788797052.983762:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788797052.983805:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb079bc0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3303:x1875689374552448:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788797052.983864:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788797052.983984:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb079bc0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3303:x1875689374552448:12345-0@lo:13:osp-pre-0-0.0 Request processed in 184us (2737us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797052.983991:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788797052.985848:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb077e31f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875689374552448:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788797052.987119:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788797053.490352:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb048e29c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3302:1875689374552960:0@lo:400:kworker.0 00000100:00100000:3.0:1788797053.490418:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788797053.490481:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1788797053.490487:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb079bc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:3302:1875689374552576:0@lo:400:kworker.0 00000100:00100000:3.0:1788797053.490512:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788797053.490535:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb048e29180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3302:1875689374553088:0@lo:400:kworker.0 00000100:00100000:3.0:1788797053.490555:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788797053.490578:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb048e2b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875689374552832:0@lo:400:kworker.0 00000100:00100000:3.0:1788797053.490612:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788797053.490627:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1788797053.490631:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb079bc2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3301:1875689374552704:0@lo:400:kworker.0 00000100:00100000:3.0:1788797053.490647:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788797053.490661:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb048e29f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875689374553216:0@lo:400:kworker.0 00000100:00100000:3.0:1788797053.490676:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788797053.490697:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374552960 00000100:00100000:3.0:1788797053.490704:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374552960 00000100:00100000:3.0:1788797053.490746:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374553088 00000100:00100000:3.0:1788797053.490749:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374553088 00000100:00100000:3.0:1788797053.490760:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374552704 00000100:00100000:3.0:1788797053.490762:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374552704 00000100:00100000:3.0:1788797053.490787:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1788797053.490795:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb048e2b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1875689374552960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788797053.490839:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb048e2b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1875689374552960:12345-0@lo:400:kworker.0 Request processed in 45us (421us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797053.490847:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1788797053.490862:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1788797053.490868:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb06ec6ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1875689374553088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788797053.490887:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb06ec6ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1875689374553088:12345-0@lo:400:kworker.0 Request processed in 20us (331us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797053.490900:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1788797053.490911:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1788797053.490915:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb06ec6ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1875689374552704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788797053.490940:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb06ec6ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1875689374552704:12345-0@lo:400:kworker.0 Request processed in 25us (292us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797053.490945:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1788797053.490959:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374552576 00000100:00100000:3.0:1788797053.490962:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374552576 00000100:00100000:3.0:1788797053.490981:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 295 00000100:00100000:3.0:1788797053.490987:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb060706c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+19:3302:x1875689374552576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788797053.491009:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb060706c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+19:3302:x1875689374552576:12345-0@lo:400:kworker.0 Request processed in 23us (496us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797053.491015:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 295 00000100:00100000:3.0:1788797053.491082:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb079bc2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3301:1875689374552704:0@lo:400:kworker.0 00000100:00100000:3.0:1788797053.491103:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb079bc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:3302:1875689374552576:0@lo:400:kworker.0 00000100:00100000:3.0:1788797053.491123:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb048e29180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3302:1875689374553088:0@lo:400:kworker.0 00000100:00100000:3.0:1788797053.491131:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb048e29c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3302:1875689374552960:0@lo:400:kworker.0 00000100:00100000:1.0:1788797053.491342:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374552832 00000100:00100000:1.0:1788797053.491347:0:6683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374552832 00000100:00100000:1.0:1788797053.491386:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374553216 00000100:00100000:1.0:1788797053.491389:0:6683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374553216 00000100:00100000:1.0:1788797053.491428:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788797053.491444:0:6683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb06ec6ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3301:x1875689374552832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788797053.491512:0:6683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb06ec6ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3301:x1875689374552832:12345-0@lo:400:kworker.0 Request processed in 76us (898us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797053.491518:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788797053.491531:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788797053.491536:0:6683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb06ec6c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3301:x1875689374553216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788797053.491563:0:6683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb06ec6c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3301:x1875689374553216:12345-0@lo:400:kworker.0 Request processed in 27us (886us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797053.491568:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788797053.491607:0:3301:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:1.0:1788797053.491614:0:3301:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967300 committed transno 4294967304 00000004:00080000:1.0:1788797053.491628:0:3301:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8cb050380700, transno 4294967301 00000004:00080000:1.0:1788797053.491644:0:3301:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967303 committed transno 4294967304 00000004:00080000:1.0:1788797053.491656:0:3301:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8cb077e32d80, transno 4294967304 00000100:00100000:1.0:1788797053.491662:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb048e29f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875689374553216:0@lo:400:kworker.0 00000100:00100000:1.0:1788797053.491676:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb048e2b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875689374552832:0@lo:400:kworker.0 00000100:00080000:2.0:1788797053.492465:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788797053.492477:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788797053.498879:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb06ec6e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875689374553344:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788797053.498964:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788797053.499324:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374553344 00000100:00100000:1.0:1788797053.499332:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374553344 00000100:00100000:1.0:1788797053.499377:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788797053.499387:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb077e32d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1875689374553344:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788797053.499423:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788797053.499470:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb077e32d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1875689374553344:12345-0@lo:13:osp-pre-1-0.0 Request processed in 84us (506us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797053.499477:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788797053.499650:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb06ec6e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875689374553344:0@lo:13:osp-pre-1-0.0 00000001:00080000:2.0:1788797053.567719:0:5848:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967409 is committed 00000001:00080000:2.0:1788797053.567756:0:5848:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967410 is committed 00000001:00080000:2.0:1788797053.567769:0:5848:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967412 is committed 00000020:00080000:2.0:1788797053.567794:0:5848:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000001:00080000:2.0:1788797053.567831:0:5848:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967413 is committed 00000020:00080000:2.0:1788797053.567854:0:5848:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8cb0464b2cc0 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:2.0:1788797053.567863:0:5848:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8cb079095700 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8cb0464b20c0 00000020:00080000:2.0:1788797053.567869:0:5848:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8cb079095300 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8cb080504c00 00000020:00080000:3.0:1788797053.568133:0:5859:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:3.0:1788797053.568479:0:5859:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00000001:00080000:0.0:1788797053.589444:0:6713:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967312 is committed 00000001:00080000:0.0:1788797053.589465:0:6713:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967311 is committed 00010000:00010000:0.0:1788797053.756374:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788797054.775361:0:5815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788797055.794156:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788797055.796072:0:11679:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788797055.796087:0:11679:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788797055.796172:0:11679:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1788797055.796186:0:11679:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1788797056.819622:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788797056.948022:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1788797056.948483:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1788797056.948574:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1788797056.948596:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1788797056.948621:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1788797056.948745:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351476992 00000100:00100000:3.0:1788797056.948766:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351476992 00000100:00100000:3.0:1788797056.948857:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 296 00000100:00100000:3.0:1788797056.948872:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb060704450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4d9d1a9-601d-459e-8721-8bfc2fdde84f+13:2354:x1875689351476992:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:3.0:1788797056.948983:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb060704450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4d9d1a9-601d-459e-8721-8bfc2fdde84f+13:2354:x1875689351476992:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 113us (987us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797056.948991:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 296 00000100:00100000:3.0:1788797056.949097:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351477504 00000100:00100000:3.0:1788797056.949102:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351477504 00000100:00100000:3.0:1788797056.949150:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351477120 00000100:00100000:3.0:1788797056.949154:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351477120 00000100:00100000:3.0:1788797056.949181:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 152 00000100:00100000:3.0:1788797056.949190:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb06f57c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed124ec0-b908-4000-b768-8e53d5def0fc+5:2354:x1875689351477504:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:3.0:1788797056.949227:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb06f57c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed124ec0-b908-4000-b768-8e53d5def0fc+5:2354:x1875689351477504:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 38us (652us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797056.949234:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 152 00000100:00100000:3.0:1788797056.949246:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 153 00000100:00100000:3.0:1788797056.949253:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb06f57ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6d050bb-169e-4784-be5b-7071799bf3b0+13:2354:x1875689351477120:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:3.0:1788797056.949283:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb06f57ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6d050bb-169e-4784-be5b-7071799bf3b0+13:2354:x1875689351477120:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 31us (685us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797056.949290:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 153 00000100:00080000:2.0:1788797056.949347:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788797056.949767:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351477248 00000100:00100000:1.0:1788797056.949774:0:6683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351477248 00000100:00100000:1.0:1788797056.949873:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351477376 00000100:00100000:1.0:1788797056.949877:0:6683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351477376 00000100:00080000:2.0:1788797056.949906:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788797056.949910:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788797056.949927:0:10829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 60 00000100:00100000:2.0:1788797056.949996:0:10829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb06f57e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e6d050bb-169e-4784-be5b-7071799bf3b0+6:2354:x1875689351477248:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:2.0:1788797056.950160:0:10829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb06f57e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e6d050bb-169e-4784-be5b-7071799bf3b0+6:2354:x1875689351477248:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 167us (1677us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797056.950169:0:10829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 60 00000100:00100000:1.0:1788797056.950666:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 61 00000100:00100000:1.0:1788797056.950677:0:6683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb06f57d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e6d050bb-169e-4784-be5b-7071799bf3b0+5:2354:x1875689351477376:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:1.0:1788797056.950731:0:6683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb06f57d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e6d050bb-169e-4784-be5b-7071799bf3b0+5:2354:x1875689351477376:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 57us (2108us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797056.950739:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 61 00010000:00010000:1.0:1788797057.846345:0:5815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788797058.043135:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1788797058.043272:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351477632 00000100:00100000:3.0:1788797058.043282:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351477632 00000100:00100000:3.0:1788797058.043356:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 135 00000100:00100000:3.0:1788797058.043367:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb06f57dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6d050bb-169e-4784-be5b-7071799bf3b0+13:10257:x1875689351477632:12345-192.168.204.38@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1788797058.043489:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb06f57dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6d050bb-169e-4784-be5b-7071799bf3b0+13:10257:x1875689351477632:12345-192.168.204.38@tcp:60:lhsmtool_posix.0 Request processed in 124us (364us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797058.043519:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 135 00000100:00080000:2.0:1788797058.044072:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788797058.049794:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1788797058.050108:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351477888 00000100:00100000:3.0:1788797058.050120:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351477888 00000100:00100000:3.0:1788797058.050221:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 35 00000100:00100000:3.0:1788797058.050232:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb06f57ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e6d050bb-169e-4784-be5b-7071799bf3b0+13:10257:x1875689351477888:12345-192.168.204.38@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788797058.050670:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb06f57ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e6d050bb-169e-4784-be5b-7071799bf3b0+14:10257:x1875689351477888:12345-192.168.204.38@tcp:35:lhsmtool_posix.0 Request processed in 437us (889us total) trans 4294967414 rc 0/0 00000100:00100000:3.0:1788797058.050678:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 35 00000100:00100000:1.0:1788797058.099976:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788797058.100000:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb077e33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875689374553472:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788797058.100112:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788797058.100207:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374553472 00000100:00100000:3.0:1788797058.100216:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374553472 00000100:00100000:3.0:1788797058.100289:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788797058.100299:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb077846850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875689374553472:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788797058.100330:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788797058.100383:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb077846850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875689374553472:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (270us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797058.100390:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788797058.100485:0:3303:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967312 gen 2 00000004:00080000:0.0:1788797058.100492:0:3303:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8cb050386300, transno 4294967310 00000004:00080000:0.0:1788797058.100502:0:3303:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967312 committed transno 4294967312 00000100:00100000:0.0:1788797058.100538:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb077e33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875689374553472:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788797058.100805:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788797058.610361:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb047c18000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:3300:1875689374553728:0@lo:400:kworker.0 00000100:00100000:0.0:1788797058.610439:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788797058.610493:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb047c18700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875689374554240:0@lo:400:kworker.0 00000100:00100000:0.0:1788797058.610536:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb047c1b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3302:1875689374553984:0@lo:400:kworker.0 00000100:00100000:0.0:1788797058.610567:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788797058.610595:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788797058.610601:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb06ec6e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875689374553600:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788797058.610638:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788797058.610644:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374553728 00000100:00100000:2.0:1788797058.610653:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374553728 00000100:00100000:0.0:1788797058.610659:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb047c18e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3302:1875689374554112:0@lo:400:kworker.0 00000100:00100000:0.0:1788797058.610696:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788797058.610714:0:7636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374553984 00000100:00100000:3.0:1788797058.610721:0:7636:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374553984 00000100:00100000:2.0:1788797058.610722:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 297 00000100:00100000:0.0:1788797058.610729:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374553600 00000100:00100000:0.0:1788797058.610734:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374553600 00000100:00100000:2.0:1788797058.610737:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb060705450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+19:3300:x1875689374553728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788797058.610764:0:7636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374554112 00000100:00100000:3.0:1788797058.610768:0:7636:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374554112 00000100:00100000:0.0:1788797058.610787:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788797058.610798:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb077921500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875689374553600:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788797058.610805:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb060705450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+19:3300:x1875689374553728:12345-0@lo:400:kworker.0 Request processed in 71us (364us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797058.610812:0:7636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1788797058.610817:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 297 00000100:00100000:3.0:1788797058.610823:0:7636:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb077922680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1875689374553984:12345-0@lo:400:kworker.0 00002000:00000024:0.0:1788797058.610827:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788797058.610871:0:7636:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb077922680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1875689374553984:12345-0@lo:400:kworker.0 Request processed in 50us (303us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797058.610880:0:7636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1788797058.610896:0:7636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1788797058.610908:0:7636:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb077920000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1875689374554112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788797058.610941:0:7636:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb077920000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1875689374554112:12345-0@lo:400:kworker.0 Request processed in 34us (245us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797058.610948:0:7636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1788797058.611058:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb047c19f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3301:1875689374553856:0@lo:400:kworker.0 00000100:00100000:1.0:1788797058.611093:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788797058.611203:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374553856 00000100:00100000:2.0:1788797058.611208:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374553856 00000100:00100000:2.0:1788797058.611283:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1788797058.611291:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb077e33800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1875689374553856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788797058.611335:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb077e33800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1875689374553856:12345-0@lo:400:kworker.0 Request processed in 44us (240us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797058.611341:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00080000:1.0:1788797058.611394:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788797058.611413:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788797058.611458:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb047c19f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3301:1875689374553856:0@lo:400:kworker.0 00000100:00100000:1.0:1788797058.611518:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788797058.611551:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb047c18000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:3300:1875689374553728:0@lo:400:kworker.0 00000100:00100000:1.0:1788797058.611572:0:10829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374554240 00000100:00100000:1.0:1788797058.611576:0:10829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374554240 00000100:00100000:1.0:1788797058.611619:0:10829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788797058.611627:0:10829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb077e31500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3300:x1875689374554240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788797058.611672:0:10829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb077e31500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3300:x1875689374554240:12345-0@lo:400:kworker.0 Request processed in 46us (154us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797058.611689:0:10829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788797058.611726:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb047c18700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875689374554240:0@lo:400:kworker.0 00000100:00100000:1.0:1788797058.611916:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb047c18e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3302:1875689374554112:0@lo:400:kworker.0 00000100:00100000:1.0:1788797058.611927:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb047c1b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3302:1875689374553984:0@lo:400:kworker.0 00000100:00100000:0.0:1788797058.613505:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb077921500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875689374553600:12345-0@lo:13:osp-pre-1-0.0 Request processed in 2707us (2864us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797058.613517:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788797058.613706:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb06ec6e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875689374553600:0@lo:13:osp-pre-1-0.0 00000001:00080000:2.0:1788797058.657372:0:5848:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967414 is committed 00000020:00080000:2.0:1788797058.657390:0:5848:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000020:00080000:3.0:1788797058.657546:0:5859:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:3.0:1788797058.657558:0:5859:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00010000:00010000:3.0:1788797058.866462:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788797059.890254:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788797060.008838:0:12302:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 12:04:19 (1788797059) 00010000:00010000:1.0:1788797060.914300:0:5815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788797061.611688:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1788797061.611881:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351478144 00000100:00100000:2.0:1788797061.611893:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351478144 00000100:00100000:2.0:1788797061.612011:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 136 00000100:00100000:2.0:1788797061.612024:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb077e33480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6d050bb-169e-4784-be5b-7071799bf3b0+13:11315:x1875689351478144:12345-192.168.204.38@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788797061.612102:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788797061.612124:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040031400/0xca7fc0c411f93e63 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c99e04559ee11d2 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1788797061.612220:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788797061.612551:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040030000/0xca7fc0c411f93e6a lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797061.612567:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040030000/0xca7fc0c411f93e6a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797061.612583:0:5826:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040030000/0xca7fc0c411f93e6a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797061.612600:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040030c00/0xca7fc0c411f93e71 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797061.612607:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040030c00/0xca7fc0c411f93e71 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797061.612613:0:5826:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040030c00/0xca7fc0c411f93e71 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797061.612889:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040031a00/0xca7fc0c411f93e78 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797061.612899:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040031a00/0xca7fc0c411f93e78 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797061.612919:0:5826:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040031a00/0xca7fc0c411f93e78 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788797061.612939:0:5826:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:2.0:1788797061.613314:0:5826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040030000/0xca7fc0c411f93e6a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797061.613322:0:5826:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040030000/0xca7fc0c411f93e6a lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797061.613329:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040030000/0xca7fc0c411f93e6a lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797061.613335:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb040030000 already unused, calling callback (ffffffffc1f014f0) 00010000:00010000:2.0:1788797061.613340:0:5826:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040030000/0xca7fc0c411f93e6a lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797061.613347:0:5826:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040030000/0xca7fc0c411f93e6a lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797061.613360:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8cb065cc2f00) 00010000:00010000:2.0:1788797061.613363:0:5826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788797061.613368:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040030000/0xca7fc0c411f93e6a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797061.613374:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040030000/0xca7fc0c411f93e6a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797061.613387:0:5826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040030c00/0xca7fc0c411f93e71 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797061.613392:0:5826:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040030c00/0xca7fc0c411f93e71 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797061.614018:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040030c00/0xca7fc0c411f93e71 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797061.614025:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb040030c00 already unused, calling callback (ffffffffc1f014f0) 00010000:00010000:2.0:1788797061.614127:0:5826:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040030c00/0xca7fc0c411f93e71 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797061.614145:0:5826:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040030c00/0xca7fc0c411f93e71 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797061.614156:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8cb05088a000) 00010000:00010000:2.0:1788797061.614158:0:5826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788797061.614162:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040030c00/0xca7fc0c411f93e71 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797061.614168:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040030c00/0xca7fc0c411f93e71 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797061.614592:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040031400/0xca7fc0c411f93e63 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee11d2 expref: 16 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797061.614610:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040031a00/0xca7fc0c411f93e78 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee11d2 expref: 15 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797061.614627:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8cb05088a400) 00010000:00010000:2.0:1788797061.614630:0:5826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788797061.614632:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb040031a00, rc 0) 00000100:00100000:2.0:1788797061.614715:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb077e33480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6d050bb-169e-4784-be5b-7071799bf3b0+15:11315:x1875689351478144:12345-192.168.204.38@tcp:101:lhsmtool_posix.0 Request processed in 2693us (3037us total) trans 4294967415 rc 0/0 00000100:00100000:2.0:1788797061.614732:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 136 00000100:00100000:2.0:1788797061.624442:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1788797061.624513:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1788797061.625253:0:7636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351478272 00000100:00100000:3.0:1788797061.625267:0:7636:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351478272 00000100:00100000:3.0:1788797061.625349:0:7636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 137 00000100:00100000:3.0:1788797061.625361:0:7636:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb06f57e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6d050bb-169e-4784-be5b-7071799bf3b0+15:11315:x1875689351478272:12345-192.168.204.38@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1788797061.625500:0:7636:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb06f57e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6d050bb-169e-4784-be5b-7071799bf3b0+15:11315:x1875689351478272:12345-192.168.204.38@tcp:59:lhsmtool_posix.0 Request processed in 142us (1072us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797061.625507:0:7636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 137 00000100:00100000:0.0:1788797061.626502:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351478400 00000100:00100000:0.0:1788797061.626512:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351478400 00000100:00100000:0.0:1788797061.626575:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 10 00000100:00100000:0.0:1788797061.626585:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0484c7450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e6d050bb-169e-4784-be5b-7071799bf3b0+15:2352:x1875689351478400:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788797061.626599:0:5813:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788797061.626640:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040031a00/0xca7fc0c411f93e78 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee11d2 expref: 15 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797061.626666:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8cb05088a400) 00010000:00010000:0.0:1788797061.626673:0:5813:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788797061.626712:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0484c7450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e6d050bb-169e-4784-be5b-7071799bf3b0+14:2352:x1875689351478400:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 130us (2198us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797061.626720:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 10 00010000:00010000:3.0:1788797061.938460:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788797061.938717:0:11679:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788797061.938724:0:11679:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788797061.939541:0:11679:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:2.0:1788797061.939553:0:11679:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788797062.045496:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1788797062.045542:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1788797062.045571:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1788797062.045590:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1788797062.045631:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351479040 00000100:00100000:2.0:1788797062.045636:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1788797062.045643:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351479040 00000100:00100000:2.0:1788797062.045660:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351478656 00000100:00100000:2.0:1788797062.045666:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351478656 00000100:00100000:3.0:1788797062.045730:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 157 00000100:00100000:1.0:1788797062.045733:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351478784 00000100:00100000:1.0:1788797062.045738:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351478784 00000100:00100000:3.0:1788797062.045744:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb06f57ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed124ec0-b908-4000-b768-8e53d5def0fc+5:2355:x1875689351479040:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:1.0:1788797062.045778:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351478912 00000100:00100000:1.0:1788797062.045782:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351478912 00000100:00100000:1.0:1788797062.045813:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 63 00000100:00100000:1.0:1788797062.045821:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb06f57fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e6d050bb-169e-4784-be5b-7071799bf3b0+6:2355:x1875689351478784:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:1.0:1788797062.045851:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb06f57fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e6d050bb-169e-4784-be5b-7071799bf3b0+6:2355:x1875689351478784:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 32us (308us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797062.045858:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 63 00000100:00100000:1.0:1788797062.045872:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 64 00000100:00100000:1.0:1788797062.045878:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb06f57f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e6d050bb-169e-4784-be5b-7071799bf3b0+5:2355:x1875689351478912:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:1.0:1788797062.045899:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb06f57f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e6d050bb-169e-4784-be5b-7071799bf3b0+5:2355:x1875689351478912:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 21us (264us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797062.045904:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 64 00000100:00080000:1.0:1788797062.045927:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788797062.045931:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788797062.045933:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788797062.045963:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb06f57ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed124ec0-b908-4000-b768-8e53d5def0fc+5:2355:x1875689351479040:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 89us (256us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797062.045975:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 157 00000100:00100000:3.0:1788797062.046556:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 158 00000100:00100000:3.0:1788797062.046568:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb06f57d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6d050bb-169e-4784-be5b-7071799bf3b0+14:2355:x1875689351478656:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:3.0:1788797062.046652:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb06f57d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6d050bb-169e-4784-be5b-7071799bf3b0+14:2355:x1875689351478656:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 87us (1061us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797062.046661:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 158 00000100:00100000:0.0:1788797062.048283:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351478528 00000100:00100000:0.0:1788797062.048297:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351478528 00000100:00100000:0.0:1788797062.048348:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 298 00000100:00100000:0.0:1788797062.048359:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb060706850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4d9d1a9-601d-459e-8721-8bfc2fdde84f+13:2355:x1875689351478528:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:0.0:1788797062.048429:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb060706850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4d9d1a9-601d-459e-8721-8bfc2fdde84f+13:2355:x1875689351478528:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 72us (2943us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797062.048457:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 298 00010000:00010000:3.0:1788797062.962491:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788797063.218472:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb077922d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875689374554368:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788797063.218815:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788797063.218984:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374554368 00000100:00100000:0.0:1788797063.218992:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374554368 00000100:00100000:0.0:1788797063.219085:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788797063.219095:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb04982ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1875689374554368:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788797063.219129:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788797063.219173:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb04982ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1875689374554368:12345-0@lo:13:osp-pre-0-0.0 Request processed in 80us (360us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797063.219180:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788797063.219230:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb077922d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875689374554368:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788797063.219490:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788797063.731666:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb04982d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875689374554496:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788797063.732817:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788797063.736297:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374554496 00000100:00100000:1.0:1788797063.736315:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374554496 00000100:00100000:1.0:1788797063.742188:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788797063.742209:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb04982c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875689374554496:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788797063.742260:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788797063.742376:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb04982c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875689374554496:12345-0@lo:13:osp-pre-1-0.0 Request processed in 176us (9563us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797063.742383:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00080000:2.0:1788797063.752160:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788797063.754983:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb077e31180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3301:1875689374554880:0@lo:400:kworker.0 00000100:00100000:0.0:1788797063.755155:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788797063.755220:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788797063.755227:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb077e30000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3301:1875689374554752:0@lo:400:kworker.0 00000100:00100000:0.0:1788797063.755253:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788797063.756018:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb077e32a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:3303:1875689374554624:0@lo:400:kworker.0 00000100:00100000:0.0:1788797063.756020:0:7636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374554880 00000100:00100000:0.0:1788797063.756052:0:7636:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374554880 00000100:00100000:0.0:1788797063.756116:0:7636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374554752 00000100:00100000:0.0:1788797063.756119:0:7636:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374554752 00000100:00100000:0.0:1788797063.756141:0:7636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1788797063.756150:0:7636:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb077922d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1875689374554880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788797063.756216:0:7636:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb077922d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1875689374554880:12345-0@lo:400:kworker.0 Request processed in 67us (1061us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797063.756222:0:7636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1788797063.756239:0:7636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1788797063.756245:0:7636:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb077920700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1875689374554752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788797063.756444:0:7636:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb077920700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1875689374554752:12345-0@lo:400:kworker.0 Request processed in 198us (1188us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797063.756459:0:7636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00080000:0.0:1788797063.756487:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788797063.756520:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb077e30000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3301:1875689374554752:0@lo:400:kworker.0 00000100:00100000:0.0:1788797063.756528:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb077e31180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3301:1875689374554880:0@lo:400:kworker.0 00000100:00100000:0.0:1788797063.765150:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb077e32300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3302:1875689374555008:0@lo:400:kworker.0 00000100:00100000:0.0:1788797063.765249:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788797063.765361:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb04982d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875689374554496:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788797063.765413:0:7636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374555008 00000100:00100000:0.0:1788797063.765421:0:7636:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374555008 00000100:00100000:0.0:1788797063.765485:0:7636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1788797063.765495:0:7636:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb079b90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1875689374555008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788797063.765563:0:7636:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb079b90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1875689374555008:12345-0@lo:400:kworker.0 Request processed in 56us (300us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797063.765570:0:7636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00080000:0.0:1788797063.765603:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788797063.765634:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb077e32300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3302:1875689374555008:0@lo:400:kworker.0 00000100:00100000:2.0:1788797063.766166:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788797063.766225:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374554624 00000100:00100000:2.0:1788797063.766230:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374554624 00000100:00100000:2.0:1788797063.766266:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 299 00000100:00100000:2.0:1788797063.766285:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb060707c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+19:3303:x1875689374554624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788797063.766354:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb060707c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+19:3303:x1875689374554624:12345-0@lo:400:kworker.0 Request processed in 71us (188us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797063.766361:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 299 00000100:00100000:0.0:1788797063.766408:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb077e32a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:3303:1875689374554624:0@lo:400:kworker.0 00000001:00080000:3.0:1788797063.849084:0:5848:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967415 is committed 00010000:00010000:1.0:1788797063.999054:0:5815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788797064.525304:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1788797064.525386:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351479168 00000100:00100000:0.0:1788797064.525414:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351479168 00000100:00100000:0.0:1788797064.525619:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 138 00000100:00100000:0.0:1788797064.525633:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb077e33100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6d050bb-169e-4784-be5b-7071799bf3b0+13:11357:x1875689351479168:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1788797064.525661:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788797064.525694:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2600/0xca7fc0c411f93e86 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c99e04559ee11d9 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797064.525908:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2800/0xca7fc0c411f93e8d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797064.525923:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2800/0xca7fc0c411f93e8d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797064.525934:0:5827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2800/0xca7fc0c411f93e8d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1788797064.525935:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788797064.525949:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3e00/0xca7fc0c411f93e94 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797064.525956:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3e00/0xca7fc0c411f93e94 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797064.525962:0:5827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3e00/0xca7fc0c411f93e94 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797064.527957:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2800/0xca7fc0c411f93e8d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797064.527976:0:5827:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2800/0xca7fc0c411f93e8d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797064.527984:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2800/0xca7fc0c411f93e8d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797064.527991:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb042ea2800 already unused, calling callback (ffffffffc1f014f0) 00010000:00010000:0.0:1788797064.527996:0:5827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2800/0xca7fc0c411f93e8d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797064.528018:0:5827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2800/0xca7fc0c411f93e8d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797064.528281:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cb065cc2500) 00010000:00010000:0.0:1788797064.528286:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788797064.528328:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2800/0xca7fc0c411f93e8d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797064.528336:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2800/0xca7fc0c411f93e8d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797064.528379:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3e00/0xca7fc0c411f93e94 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797064.528393:0:5827:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3e00/0xca7fc0c411f93e94 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797064.528401:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3e00/0xca7fc0c411f93e94 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797064.528406:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb042ea3e00 already unused, calling callback (ffffffffc1f014f0) 00010000:00010000:0.0:1788797064.528409:0:5827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3e00/0xca7fc0c411f93e94 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797064.528426:0:5827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3e00/0xca7fc0c411f93e94 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797064.528435:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8cb058766400) 00010000:00010000:0.0:1788797064.528438:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788797064.528441:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3e00/0xca7fc0c411f93e94 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797064.528492:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3e00/0xca7fc0c411f93e94 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797064.530214:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2600/0xca7fc0c411f93e86 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee11d9 expref: 14 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797064.530243:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cb065cc2500) 00010000:00010000:0.0:1788797064.530246:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788797064.530252:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2600/0xca7fc0c411f93e86 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee11d9 expref: 14 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797064.530583:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb042ea2600, rc 0) 00000100:00100000:0.0:1788797064.530674:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb077e33100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6d050bb-169e-4784-be5b-7071799bf3b0+13:11357:x1875689351479168:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 5044us (5380us total) trans 0 rc 301/301 00000100:00100000:0.0:1788797064.530682:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 138 00000100:00100000:2.0:1788797064.544448:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1788797064.544513:0:7636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351479424 00000100:00100000:1.0:1788797064.544524:0:7636:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351479424 00000100:00100000:1.0:1788797064.544591:0:7636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 139 00000100:00100000:1.0:1788797064.544602:0:7636:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb04982f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6d050bb-169e-4784-be5b-7071799bf3b0+13:11357:x1875689351479424:12345-192.168.204.38@tcp:36:lfs.0 00010000:00010000:1.0:1788797064.544664:0:7636:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788797064.544691:0:7636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080437a00/0xca7fc0c411f93812 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1019 expref: 13 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797064.544706:0:7636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cb065cc2500) 00010000:00010000:1.0:1788797064.544717:0:7636:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788797064.545163:0:7636:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045200/0xca7fc0c411f93e9b lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797064.545178:0:7636:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045200/0xca7fc0c411f93e9b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797064.545188:0:7636:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045200/0xca7fc0c411f93e9b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797064.545202:0:7636:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045e00/0xca7fc0c411f93ea2 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797064.545209:0:7636:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045e00/0xca7fc0c411f93ea2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797064.545216:0:7636:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045e00/0xca7fc0c411f93ea2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788797064.546818:0:7636:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:1.0:1788797064.546837:0:7636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045200/0xca7fc0c411f93e9b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797064.546853:0:7636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045200/0xca7fc0c411f93e9b lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797064.546860:0:7636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045200/0xca7fc0c411f93e9b lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797064.546867:0:7636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb082045200 already unused, calling callback (ffffffffc1f014f0) 00010000:00010000:1.0:1788797064.547640:0:7636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045200/0xca7fc0c411f93e9b lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797064.547651:0:7636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045200/0xca7fc0c411f93e9b lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797064.547671:0:7636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cb06ce84200) 00010000:00010000:1.0:1788797064.547675:0:7636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788797064.547680:0:7636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045200/0xca7fc0c411f93e9b lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797064.547686:0:7636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045200/0xca7fc0c411f93e9b lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788797064.547713:0:7636:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000deacbc3f reply state 0000000001a5edea transno 4294967416 ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045e00/0xca7fc0c411f93ea2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788797064.547722:0:7636:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788797064.547859:0:7636:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb04982f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6d050bb-169e-4784-be5b-7071799bf3b0+14:11357:x1875689351479424:12345-192.168.204.38@tcp:36:lfs.0 Request processed in 3254us (3416us total) trans 4294967416 rc 0/0 00000100:00100000:1.0:1788797064.548117:0:7636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 139 00010000:00010000:1.0:1788797064.551444:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045e00/0xca7fc0c411f93ea2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797064.551490:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045e00/0xca7fc0c411f93ea2 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797064.551507:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045e00/0xca7fc0c411f93ea2 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797064.551514:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb082045e00 already unused, calling callback (ffffffffc1f014f0) 00010000:00010000:1.0:1788797064.551520:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045e00/0xca7fc0c411f93ea2 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797064.551528:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045e00/0xca7fc0c411f93ea2 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797064.551548:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8cb06ce84300) 00010000:00010000:1.0:1788797064.551551:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788797064.551557:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045e00/0xca7fc0c411f93ea2 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797064.551575:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045e00/0xca7fc0c411f93ea2 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788797064.722710:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1788797064.723167:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351479552 00000100:00100000:0.0:1788797064.723178:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351479552 00000100:00100000:0.0:1788797064.723234:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 140 00000100:00100000:0.0:1788797064.723245:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb04982d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6d050bb-169e-4784-be5b-7071799bf3b0+13:11365:x1875689351479552:12345-192.168.204.38@tcp:101:lctl.0 00010000:00010000:0.0:1788797064.723269:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788797064.723294:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2800/0xca7fc0c411f93ea9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c99e04559ee11e0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797064.723440:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3e00/0xca7fc0c411f93eb0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797064.723457:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3e00/0xca7fc0c411f93eb0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797064.723547:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3e00/0xca7fc0c411f93eb0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788797064.723601:0:5825:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788797064.723605:0:5825:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788797064.723633:0:5825:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3e00/0xca7fc0c411f93eb0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797064.723659:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2800/0xca7fc0c411f93ea9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee11e0 expref: 15 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797064.723676:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3e00/0xca7fc0c411f93eb0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee11e0 expref: 14 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797064.723685:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cb058766400) 00010000:00010000:0.0:1788797064.723688:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788797064.723692:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb042ea3e00, rc 0) 00000100:00100000:0.0:1788797064.723778:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb04982d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6d050bb-169e-4784-be5b-7071799bf3b0+14:11365:x1875689351479552:12345-192.168.204.38@tcp:101:lctl.0 Request processed in 534us (1089us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797064.723786:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 140 00000100:00100000:2.0:1788797064.791066:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1788797064.791531:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351479680 00000100:00100000:0.0:1788797064.791542:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351479680 00000100:00100000:0.0:1788797064.791713:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 141 00000100:00100000:0.0:1788797064.791725:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb079176680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6d050bb-169e-4784-be5b-7071799bf3b0+14:11371:x1875689351479680:12345-192.168.204.38@tcp:101:bash.0 00010000:00010000:0.0:1788797064.791751:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788797064.791774:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2800/0xca7fc0c411f93eb7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c99e04559ee11e7 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797064.791860:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2600/0xca7fc0c411f93ebe lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797064.791873:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2600/0xca7fc0c411f93ebe lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797064.791893:0:5826:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2600/0xca7fc0c411f93ebe lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797064.791908:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2400/0xca7fc0c411f93ec5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797064.791915:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2400/0xca7fc0c411f93ec5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797064.791922:0:5826:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2400/0xca7fc0c411f93ec5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797064.792023:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2200/0xca7fc0c411f93ecc lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797064.792064:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2200/0xca7fc0c411f93ecc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797064.792072:0:5826:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2200/0xca7fc0c411f93ecc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788797064.792097:0:5826:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:0.0:1788797064.792101:0:5826:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788797064.792118:0:5826:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2200/0xca7fc0c411f93ecc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797064.792140:0:5826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2600/0xca7fc0c411f93ebe lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797064.792146:0:5826:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2600/0xca7fc0c411f93ebe lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797064.792152:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2600/0xca7fc0c411f93ebe lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797064.792158:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb042ea2600 already unused, calling callback (ffffffffc1f014f0) 00010000:00010000:0.0:1788797064.792162:0:5826:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2600/0xca7fc0c411f93ebe lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797064.792168:0:5826:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2600/0xca7fc0c411f93ebe lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797064.795689:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cb058766400) 00010000:00010000:0.0:1788797064.795695:0:5826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788797064.795705:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2600/0xca7fc0c411f93ebe lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797064.795716:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2600/0xca7fc0c411f93ebe lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797064.795744:0:5826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2400/0xca7fc0c411f93ec5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797064.795753:0:5826:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2400/0xca7fc0c411f93ec5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797064.795760:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2400/0xca7fc0c411f93ec5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797064.795791:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb042ea2400 already unused, calling callback (ffffffffc1f014f0) 00010000:00010000:0.0:1788797064.795796:0:5826:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2400/0xca7fc0c411f93ec5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797064.795806:0:5826:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2400/0xca7fc0c411f93ec5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797064.795814:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8cb058766100) 00010000:00010000:0.0:1788797064.795817:0:5826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788797064.795820:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2400/0xca7fc0c411f93ec5 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797064.795826:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2400/0xca7fc0c411f93ec5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797064.795878:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2800/0xca7fc0c411f93eb7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee11e7 expref: 16 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797064.795962:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2200/0xca7fc0c411f93ecc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee11e7 expref: 15 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797064.795969:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8cb058766500) 00010000:00010000:0.0:1788797064.795972:0:5826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1788797064.795974:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb042ea2200, rc 0) 00000100:00100000:0.0:1788797064.796564:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb079176680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6d050bb-169e-4784-be5b-7071799bf3b0+15:11371:x1875689351479680:12345-192.168.204.38@tcp:101:bash.0 Request processed in 4828us (5532us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797064.796574:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 141 00000100:00100000:2.0:1788797064.803802:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1788797064.804137:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351479936 00000100:00100000:0.0:1788797064.804164:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351479936 00000100:00100000:0.0:1788797064.804236:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 142 00000100:00100000:0.0:1788797064.804248:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb079177800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6d050bb-169e-4784-be5b-7071799bf3b0+15:11371:x1875689351479936:12345-192.168.204.38@tcp:101:bash.0 00010000:00010000:0.0:1788797064.804270:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788797064.804294:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2800/0xca7fc0c411f93ed3 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c99e04559ee11ee expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797064.804588:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2400/0xca7fc0c411f93eda lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797064.804605:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2400/0xca7fc0c411f93eda lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797064.804616:0:5827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2400/0xca7fc0c411f93eda lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797064.804678:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2600/0xca7fc0c411f93ee1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797064.804685:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2600/0xca7fc0c411f93ee1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797064.804691:0:5827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2600/0xca7fc0c411f93ee1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788797064.805602:0:5827:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4:0x0], index 1: 0 00010000:00010000:0.0:1788797064.805913:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2a00/0xca7fc0c411f93ee8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797064.805928:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2a00/0xca7fc0c411f93ee8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797064.805952:0:5827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2a00/0xca7fc0c411f93ee8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797064.806003:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2400/0xca7fc0c411f93eda lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797064.806010:0:5827:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2400/0xca7fc0c411f93eda lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797064.806017:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2400/0xca7fc0c411f93eda lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797064.806023:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb042ea2400 already unused, calling callback (ffffffffc1f014f0) 00010000:00010000:0.0:1788797064.806056:0:5827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2400/0xca7fc0c411f93eda lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797064.806065:0:5827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2400/0xca7fc0c411f93eda lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797064.806077:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8cb058766500) 00010000:00010000:0.0:1788797064.806080:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788797064.806086:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2400/0xca7fc0c411f93eda lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797064.806092:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2400/0xca7fc0c411f93eda lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788797064.806107:0:5827:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b5059592 reply state 00000000a618e212 transno 4294967417 ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2600/0xca7fc0c411f93ee1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788797064.806117:0:5827:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788797064.806164:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2800/0xca7fc0c411f93ed3 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee11ee expref: 18 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797064.806257:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2a00/0xca7fc0c411f93ee8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee11ee expref: 17 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797064.806266:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cb058766200) 00010000:00010000:0.0:1788797064.806269:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788797064.806271:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb042ea2a00, rc 0) 00000100:00100000:0.0:1788797064.806360:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb079177800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6d050bb-169e-4784-be5b-7071799bf3b0+18:11371:x1875689351479936:12345-192.168.204.38@tcp:101:bash.0 Request processed in 2114us (2572us total) trans 4294967417 rc 0/0 00000100:00100000:0.0:1788797064.806368:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 142 00010000:00010000:1.0:1788797064.808496:0:3286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2600/0xca7fc0c411f93ee1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797064.808517:0:3286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2600/0xca7fc0c411f93ee1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797064.808525:0:3286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2600/0xca7fc0c411f93ee1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797064.808531:0:3286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb042ea2600 already unused, calling callback (ffffffffc1f014f0) 00010000:00010000:1.0:1788797064.808552:0:3286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2600/0xca7fc0c411f93ee1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797064.808570:0:3286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2600/0xca7fc0c411f93ee1 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797064.808588:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8cb058766100) 00010000:00010000:1.0:1788797064.808592:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788797064.808597:0:3286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2600/0xca7fc0c411f93ee1 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797064.808603:0:3286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2600/0xca7fc0c411f93ee1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788797064.811705:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1788797064.812092:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351480064 00000100:00100000:1.0:1788797064.812103:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351480064 00000100:00100000:1.0:1788797064.812175:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 48 00000100:00100000:1.0:1788797064.812187:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb079177480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e6d050bb-169e-4784-be5b-7071799bf3b0+5:2352:x1875689351480064:12345-192.168.204.38@tcp:101:bash.0 00010000:00010000:1.0:1788797064.812219:0:6684:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788797064.812243:0:6684:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e7cc11f5/0xca7fc0c411f93ef6 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7c99e04559ee11f5 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788797064.812275:0:6684:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788797064.812295:0:6684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=353s v=(0 0) 00010000:00010000:1.0:1788797064.812300:0:6684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788797064.812309:0:6684:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e7cc11f5/0xca7fc0c411f93ef6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee11f5 expref: 6 pid: 6684 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797064.812329:0:6684:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e7cc11f5/0xca7fc0c411f93ef6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee11f5 expref: 6 pid: 6684 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797064.812360:0:6684:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb082045e00, rc 0) 00000100:00080000:0.0:1788797064.812409:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788797064.812413:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb079177480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e6d050bb-169e-4784-be5b-7071799bf3b0+6:2352:x1875689351480064:12345-192.168.204.38@tcp:101:bash.0 Request processed in 229us (718us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797064.812420:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 48 00000100:00100000:2.0:1788797064.825376:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1788797064.825464:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351480192 00000100:00100000:1.0:1788797064.825475:0:6683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351480192 00000100:00100000:1.0:1788797064.825577:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 49 00000100:00100000:1.0:1788797064.825588:0:6683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb079175500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e6d050bb-169e-4784-be5b-7071799bf3b0+6:11371:x1875689351480192:12345-192.168.204.38@tcp:101:bash.0 00010000:00010000:1.0:1788797064.825606:0:6683:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788797064.825625:0:6683:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fff90cbe/0xca7fc0c411f93efd lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7c99e04559ee11fc expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797064.825669:0:6683:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e7cc11f5/0xca7fc0c411f93ef6 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee11f5 expref: 7 pid: 6684 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797064.825683:0:6683:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788797064.825690:0:6683:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788797064.825698:0:6683:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fff90cbe/0xca7fc0c411f93efd lrc: 4/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee11fc expref: 7 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797064.825741:0:6683:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e7cc11f5/0xca7fc0c411f93ef6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee11f5 expref: 7 pid: 6684 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797064.825756:0:6683:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e7cc11f5/0xca7fc0c411f93ef6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee11f5 expref: 7 pid: 6684 timeout: 453 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788797064.825786:0:6683:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb077e32d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6683:1875689374555136:192.168.204.38@tcp:104: 00000100:00100000:1.0:1788797064.825896:0:6683:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb04887e600 going to sleep for 11 seconds 00000100:00100000:1.0:1788797064.834706:0:6683:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb077e32d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6683:1875689374555136:192.168.204.38@tcp:104: 00010000:00010000:1.0:1788797064.834759:0:6683:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000fff90cbe/0xca7fc0c411f93efd lrc: 3/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee11fc expref: 7 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797064.834782:0:6683:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb082045200, rc 0) 00000100:00100000:1.0:1788797064.834881:0:6683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb079175500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e6d050bb-169e-4784-be5b-7071799bf3b0+7:11371:x1875689351480192:12345-192.168.204.38@tcp:101:bash.0 Request processed in 9291us (9508us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797064.834910:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 49 00000100:00100000:0.0:1788797064.844712:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1788797064.845619:0:11663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351480320 00000100:00100000:3.0:1788797064.845632:0:11663:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351480320 00010000:00010000:3.0:1788797064.845677:0:11663:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e7cc11f5/0xca7fc0c411f93ef6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee11f5 expref: 7 pid: 6684 timeout: 453 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788797064.845731:0:11663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 59 00000100:00100000:3.0:1788797064.845741:0:11663:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb079b90a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e6d050bb-169e-4784-be5b-7071799bf3b0+7:2355:x1875689351480320:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788797064.845756:0:11663:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788797064.845777:0:11663:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e7cc11f5/0xca7fc0c411f93ef6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee11f5 expref: 7 pid: 6684 timeout: 453 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797064.845792:0:11663:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e7cc11f5/0xca7fc0c411f93ef6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee11f5 expref: 7 pid: 6684 timeout: 453 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797064.845815:0:11663:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e7cc11f5/0xca7fc0c411f93ef6 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee11f5 expref: 7 pid: 6684 timeout: 453 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797064.845832:0:11663:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788797064.845836:0:11663:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788797064.845844:0:11663:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000fff90cbe/0xca7fc0c411f93efd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee11fc expref: 6 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797064.845873:0:11663:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fff90cbe/0xca7fc0c411f93efd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee11fc expref: 6 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797064.845928:0:11663:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000fff90cbe/0xca7fc0c411f93efd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee11fc expref: 6 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788797064.845946:0:11663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb06ec6e300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11663:1875689374555264:192.168.204.38@tcp:105: 00000100:00100000:3.0:1788797064.846078:0:11663:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb043604f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788797064.854282:0:11663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb06ec6e300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11663:1875689374555264:192.168.204.38@tcp:105: 00010000:00010000:3.0:1788797064.854312:0:11663:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788797064.854370:0:11663:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb079b90a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e6d050bb-169e-4784-be5b-7071799bf3b0+6:2355:x1875689351480320:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 8630us (9682us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797064.854382:0:11663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 59 00000100:00100000:2.0:1788797064.860191:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1788797064.860339:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351480576 00000100:00100000:3.0:1788797064.860348:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351480576 00000100:00100000:3.0:1788797064.860406:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 36 00000100:00100000:3.0:1788797064.860417:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb079175180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e6d050bb-169e-4784-be5b-7071799bf3b0+17:11371:x1875689351480576:12345-192.168.204.38@tcp:35:bash.0 00000100:00100000:3.0:1788797064.861911:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb079175180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e6d050bb-169e-4784-be5b-7071799bf3b0+18:11371:x1875689351480576:12345-192.168.204.38@tcp:35:bash.0 Request processed in 1490us (1724us total) trans 4294967418 rc 0/0 00000100:00100000:3.0:1788797064.861924:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 36 00000100:00100000:0.0:1788797064.986372:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1788797064.990763:0:7636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351480832 00000100:00100000:2.0:1788797064.990778:0:7636:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351480832 00000100:00100000:2.0:1788797064.990872:0:7636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 143 00000100:00100000:2.0:1788797064.990892:0:7636:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb079b92a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6d050bb-169e-4784-be5b-7071799bf3b0+18:11381:x1875689351480832:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1788797064.990917:0:7636:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788797064.990940:0:7636:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040030000/0xca7fc0c411f93f04 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c99e04559ee1203 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788797064.991082:0:7636:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:2.0:1788797064.991196:0:7636:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040030000/0xca7fc0c411f93f04 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1203 expref: 20 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797064.991210:0:7636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cb058766400) 00010000:00010000:2.0:1788797064.991213:0:7636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788797064.991219:0:7636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040030000/0xca7fc0c411f93f04 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1203 expref: 20 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797064.991265:0:7636:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb040030000, rc 0) 00000100:00100000:2.0:1788797064.991349:0:7636:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb079b92a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6d050bb-169e-4784-be5b-7071799bf3b0+19:11381:x1875689351480832:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 459us (4987us total) trans 4294967419 rc 301/301 00000100:00100000:2.0:1788797064.991356:0:7636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 143 00000100:00100000:0.0:1788797065.007294:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1788797065.007971:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351481088 00000100:00100000:1.0:1788797065.007983:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351481088 00000100:00100000:1.0:1788797065.008087:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 37 00000100:00100000:1.0:1788797065.008100:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb079b91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e6d050bb-169e-4784-be5b-7071799bf3b0+19:11381:x1875689351481088:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:1.0:1788797065.008387:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb079b91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e6d050bb-169e-4784-be5b-7071799bf3b0+20:11381:x1875689351481088:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 289us (1101us total) trans 4294967420 rc 0/0 00000100:00100000:1.0:1788797065.008396:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 37 00000040:00080000:1.0:1788797065.010241:0:11679:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788797065.010250:0:11679:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00010000:00010000:2.0:1788797065.010971:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788797065.011806:0:11679:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 1 00000040:00080000:2.0:1788797065.011818:0:11679:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788797065.146164:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1788797065.146280:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351481216 00000100:00100000:0.0:1788797065.146293:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351481216 00000100:00100000:0.0:1788797065.146363:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 144 00000100:00100000:0.0:1788797065.146374:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb077e32d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6d050bb-169e-4784-be5b-7071799bf3b0+20:11387:x1875689351481216:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1788797065.146399:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788797065.146421:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3000/0xca7fc0c411f93f12 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c99e04559ee120a expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797065.146681:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3c00/0xca7fc0c411f93f19 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797065.146822:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3c00/0xca7fc0c411f93f19 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797065.146856:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3c00/0xca7fc0c411f93f19 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788797065.146895:0:5825:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:0.0:1788797065.146899:0:5825:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788797065.146915:0:5825:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3c00/0xca7fc0c411f93f19 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797065.146943:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3000/0xca7fc0c411f93f12 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee120a expref: 22 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797065.146963:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3c00/0xca7fc0c411f93f19 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee120a expref: 21 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797065.146972:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8cb058766500) 00010000:00010000:0.0:1788797065.146974:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788797065.146978:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb042ea3c00, rc 0) 00000100:00100000:0.0:1788797065.147855:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb077e32d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6d050bb-169e-4784-be5b-7071799bf3b0+21:11387:x1875689351481216:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 1477us (1697us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797065.147865:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 144 00000100:00100000:0.0:1788797065.155762:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1788797065.156014:0:7636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351481472 00000100:00100000:2.0:1788797065.156024:0:7636:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351481472 00000100:00100000:2.0:1788797065.156760:0:7636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 145 00000100:00100000:2.0:1788797065.156772:0:7636:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0796c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6d050bb-169e-4784-be5b-7071799bf3b0+21:11387:x1875689351481472:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1788797065.156801:0:7636:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788797065.156826:0:7636:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040030000/0xca7fc0c411f93f20 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c99e04559ee1211 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797065.156948:0:7636:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040030800/0xca7fc0c411f93f27 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797065.156963:0:7636:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040030800/0xca7fc0c411f93f27 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797065.156975:0:7636:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040030800/0xca7fc0c411f93f27 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788797065.156987:0:7636:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1788797065.157193:0:7636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040030000/0xca7fc0c411f93f20 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1211 expref: 24 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797065.157242:0:7636:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040030800/0xca7fc0c411f93f27 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1211 expref: 23 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797065.157253:0:7636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cb058766200) 00010000:00010000:2.0:1788797065.157257:0:7636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788797065.157262:0:7636:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb040030800, rc 0) 00000100:00100000:2.0:1788797065.157353:0:7636:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0796c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6d050bb-169e-4784-be5b-7071799bf3b0+23:11387:x1875689351481472:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 581us (1601us total) trans 4294967421 rc 0/0 00000100:00100000:2.0:1788797065.157362:0:7636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 145 00000100:00100000:1.0:1788797065.167964:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1788797065.168191:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351481728 00000100:00100000:2.0:1788797065.168203:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351481728 00000100:00100000:2.0:1788797065.168274:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 146 00000100:00100000:2.0:1788797065.168285:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb077e31f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6d050bb-169e-4784-be5b-7071799bf3b0+23:11387:x1875689351481728:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1788797065.168318:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788797065.168346:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040030000/0xca7fc0c411f93f35 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c99e04559ee1218 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797065.168469:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040031e00/0xca7fc0c411f93f3c lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797065.168499:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040031e00/0xca7fc0c411f93f3c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797065.168514:0:5827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040031e00/0xca7fc0c411f93f3c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788797065.168682:0:5827:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1788797065.170649:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040030000/0xca7fc0c411f93f35 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1218 expref: 26 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797065.170686:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040031e00/0xca7fc0c411f93f3c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1218 expref: 25 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797065.170769:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cb058766200) 00010000:00010000:2.0:1788797065.170772:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1788797065.170776:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb040031e00, rc 0) 00000100:00100000:2.0:1788797065.170865:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb077e31f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6d050bb-169e-4784-be5b-7071799bf3b0+25:11387:x1875689351481728:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 2580us (2909us total) trans 4294967422 rc 0/0 00000100:00100000:2.0:1788797065.170875:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 146 00000100:00100000:1.0:1788797065.174308:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1788797065.174756:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351481856 00000100:00100000:2.0:1788797065.174768:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351481856 00000100:00100000:2.0:1788797065.174837:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 11 00000100:00100000:2.0:1788797065.174846:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb077e31c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e6d050bb-169e-4784-be5b-7071799bf3b0+25:2352:x1875689351481856:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788797065.174862:0:5812:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788797065.174945:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040030800/0xca7fc0c411f93f27 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1211 expref: 25 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797065.174969:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cb058766200) 00010000:00010000:2.0:1788797065.174974:0:5812:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788797065.175125:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb077e31c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e6d050bb-169e-4784-be5b-7071799bf3b0+24:2352:x1875689351481856:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 278us (835us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797065.175133:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 11 00000100:00100000:0.0:1788797065.189193:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1788797065.189277:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351481984 00000100:00100000:1.0:1788797065.189304:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351481984 00000100:00100000:1.0:1788797065.189368:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 50 00000100:00100000:1.0:1788797065.189379:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0796c6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e6d050bb-169e-4784-be5b-7071799bf3b0+6:2354:x1875689351481984:12345-192.168.204.38@tcp:1:lfs.0 00010000:00010000:1.0:1788797065.189432:0:6684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001496f488/0xca7fc0c411f93f4a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797065.189457:0:6684:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000fff90cbe/0xca7fc0c411f93efd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee11fc expref: 6 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797065.189467:0:6684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x4:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1788797065.189472:0:6684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788797065.189478:0:6684:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001496f488/0xca7fc0c411f93f4a lrc: 4/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797065.189533:0:6684:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000fff90cbe/0xca7fc0c411f93efd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee11fc expref: 6 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797065.189556:0:6684:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000fff90cbe/0xca7fc0c411f93efd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee11fc expref: 6 pid: 6683 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788797065.189571:0:6684:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb077e31880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6684:1875689374555392:192.168.204.38@tcp:104: 00000100:00100000:1.0:1788797065.189667:0:6684:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb04887ec00 going to sleep for 11 seconds 00000100:00100000:3.0:1788797065.194873:0:6684:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb077e31880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6684:1875689374555392:192.168.204.38@tcp:104: 00010000:00010000:3.0:1788797065.194911:0:6684:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000001496f488/0xca7fc0c411f93f4a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788797065.196088:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1788797065.196190:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351482112 00000100:00100000:3.0:1788797065.196201:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351482112 00002000:00100000:3.0:1788797065.196267:0:6688:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff8cb0796c4a80 x1875689351482112/t0(0) o4->e6d050bb-169e-4784-be5b-7071799bf3b0@192.168.204.38@tcp:491/0 lens 504/0 e 0 to 0 dl 1788797076 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788797065.196277:0:6688:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8cb0796c4a80 with x1875689351482112 ext(0->12) 00010000:00010000:3.0:1788797065.196287:0:6688:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000fff90cbe/0xca7fc0c411f93efd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee11fc expref: 7 pid: 6683 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797065.196303:0:6688:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000fff90cbe/0xca7fc0c411f93efd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee11fc expref: 7 pid: 6683 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788797065.196310:0:6688:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8cb0796c4a80 00000100:00100000:3.0:1788797065.196336:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2 00000100:00100000:3.0:1788797065.196347:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0796c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:e6d050bb-169e-4784-be5b-7071799bf3b0+7:2355:x1875689351482112:12345-192.168.204.38@tcp:4:lfs.0 00000100:00100000:3.0:1788797065.196950:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0796c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:e6d050bb-169e-4784-be5b-7071799bf3b0+9:2355:x1875689351482112:12345-192.168.204.38@tcp:4:lfs.0 Request processed in 602us (870us total) trans 4294967305 rc 0/0 00000100:00100000:3.0:1788797065.196958:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2 00002000:00100000:3.0:1788797065.196966:0:6688:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff8cb0796c4a80 x1875689351482112/t4294967305(0) o4->e6d050bb-169e-4784-be5b-7071799bf3b0@192.168.204.38@tcp:491/0 lens 504/448 e 0 to 0 dl 1788797076 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788797065.196974:0:6688:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8cb0796c4a80 with x1875689351482112 ext(0->12) 00010000:00010000:3.0:1788797065.196980:0:6688:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000fff90cbe/0xca7fc0c411f93efd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee11fc expref: 9 pid: 6683 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797065.197004:0:6688:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000fff90cbe/0xca7fc0c411f93efd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee11fc expref: 9 pid: 6683 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788797065.197011:0:6688:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8cb0796c4a80 00000100:00100000:1.0:1788797065.201504:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1788797065.202268:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351482240 00000100:00100000:3.0:1788797065.202283:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351482240 00010000:00010000:3.0:1788797065.202345:0:5811:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000fff90cbe/0xca7fc0c411f93efd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee11fc expref: 9 pid: 6683 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788797065.202400:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 60 00000100:00100000:3.0:1788797065.202412:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb077e30a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e6d050bb-169e-4784-be5b-7071799bf3b0+9:2353:x1875689351482240:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788797065.202430:0:5811:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1788797065.202456:0:5811:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1788797065.202459:0:5811:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1788797065 00002000:00010000:3.0:1788797065.202461:0:5811:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 1788797065 00002000:00010000:3.0:1788797065.202463:0:5811:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 0 -> 1788797065 00010000:00010000:3.0:1788797065.202469:0:5811:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000fff90cbe/0xca7fc0c411f93efd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee11fc expref: 9 pid: 6683 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797065.202677:0:5811:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000fff90cbe/0xca7fc0c411f93efd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee11fc expref: 9 pid: 6683 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797065.202773:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fff90cbe/0xca7fc0c411f93efd lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee11fc expref: 9 pid: 6683 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797065.202816:0:5811:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788797065.202820:0:5811:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788797065.202826:0:5811:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001496f488/0xca7fc0c411f93f4a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797065.202836:0:5811:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001496f488/0xca7fc0c411f93f4a lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797065.203116:0:5811:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788797065.203186:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb077e30a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e6d050bb-169e-4784-be5b-7071799bf3b0+8:2353:x1875689351482240:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 774us (1704us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797065.203197:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 60 00010000:00010000:0.0:1788797065.205315:0:6684:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000001496f488/0xca7fc0c411f93f4a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797065.205339:0:6684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001496f488/0xca7fc0c411f93f4a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797065.205415:0:6684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001496f488/0xca7fc0c411f93f4a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797065.205425:0:6684:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001496f488/0xca7fc0c411f93f4a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797065.205437:0:6684:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001496f488/0xca7fc0c411f93f4a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797065.205444:0:6684:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb082045c00 already unused, calling callback (ffffffffc14d98b0) 00010000:00010000:0.0:1788797065.205450:0:6684:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001496f488/0xca7fc0c411f93f4a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797065.205461:0:6684:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001496f488/0xca7fc0c411f93f4a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797065.205677:0:6684:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001496f488/0xca7fc0c411f93f4a lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797065.205686:0:6684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001496f488/0xca7fc0c411f93f4a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788797065.206057:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0796c6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e6d050bb-169e-4784-be5b-7071799bf3b0+7:2354:x1875689351481984:12345-192.168.204.38@tcp:1:lfs.0 Request processed in 16653us (16847us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797065.206070:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 50 00000100:00100000:1.0:1788797065.213610:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1788797065.214282:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351482496 00000100:00100000:3.0:1788797065.214302:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351482496 00000100:00100000:3.0:1788797065.214374:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 38 00000100:00100000:3.0:1788797065.214387:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb050636050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e6d050bb-169e-4784-be5b-7071799bf3b0+24:11387:x1875689351482496:12345-192.168.204.38@tcp:35:lfs.0 00000004:00010000:3.0:1788797065.214480:0:5828:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040031e00/0xca7fc0c411f93f3c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1218 expref: 24 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788797065.215389:0:5828:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967423 00000001:00080000:3.0:1788797065.215442:0:5828:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967424 00000001:00080000:3.0:1788797065.217136:0:5828:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00010000:00010000:3.0:1788797065.217236:0:5828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69800/0xca7fc0c411f93f51 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797065.217260:0:5828:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2a00/0xca7fc0c411f93ee8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee11ee expref: 28 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797065.217278:0:5828:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69800/0xca7fc0c411f93f51 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797065.217323:0:5828:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2a00/0xca7fc0c411f93ee8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee11ee expref: 28 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797065.217341:0:5828:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2a00/0xca7fc0c411f93ee8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee11ee expref: 28 pid: 5827 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788797065.217357:0:5828:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb06ec6e300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5828:1875689374555520:192.168.204.38@tcp:104: 00000100:00100000:3.0:1788797065.217539:0:5828:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb043604f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788797065.222470:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1788797065.223206:0:11663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351482624 00000100:00100000:0.0:1788797065.223217:0:11663:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351482624 00010000:00010000:0.0:1788797065.223263:0:11663:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2a00/0xca7fc0c411f93ee8 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee11ee expref: 29 pid: 5827 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788797065.223305:0:11663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 61 00000100:00100000:0.0:1788797065.223315:0:11663:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0774e6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e6d050bb-169e-4784-be5b-7071799bf3b0+29:2354:x1875689351482624:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788797065.223329:0:11663:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788797065.223336:0:11663:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2a00/0xca7fc0c411f93ee8 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee11ee expref: 29 pid: 5827 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797065.223350:0:11663:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2a00/0xca7fc0c411f93ee8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee11ee expref: 29 pid: 5827 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797065.223372:0:11663:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cb058766200) 00010000:00010000:0.0:1788797065.223377:0:11663:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69800/0xca7fc0c411f93f51 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797065.223386:0:11663:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69800/0xca7fc0c411f93f51 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797065.223394:0:11663:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69800/0xca7fc0c411f93f51 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797065.223413:0:11663:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788797065.223475:0:11663:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0774e6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e6d050bb-169e-4784-be5b-7071799bf3b0+29:2354:x1875689351482624:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 161us (1020us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797065.223482:0:11663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 61 00010000:00010000:2.0:1788797065.225181:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2a00/0xca7fc0c411f93ee8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee11ee expref: 28 pid: 5827 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788797065.225244:0:5828:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb06ec6e300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5828:1875689374555520:192.168.204.38@tcp:104: 00010000:00010000:2.0:1788797065.225276:0:5828:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69800/0xca7fc0c411f93f51 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797065.225288:0:5828:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69800/0xca7fc0c411f93f51 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797065.225294:0:5828:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69800/0xca7fc0c411f93f51 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788797065.225465:0:5828:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:2.0:1788797065.226390:0:5828:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00000100:00100000:2.0:1788797065.226543:0:5828:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb079174000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5828:1875689374555648:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1788797065.226628:0:5828:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788797065.226670:0:5828:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb049151c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788797065.226874:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374555648 00000100:00100000:0.0:1788797065.226901:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374555648 00000100:00100000:0.0:1788797065.226978:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788797065.226989:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb079174e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5828:x1875689374555648:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1788797065.227111:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb079174e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5828:x1875689374555648:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 124us (483us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797065.227119:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788797065.227174:0:5828:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb079174000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5828:1875689374555648:0@lo:1000:mdt_rdpg00_000.0 00000100:00080000:1.0:1788797065.227821:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:0.0:1788797065.228430:0:5828:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000100:00100000:0.0:1788797065.228667:0:5828:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb0796c6d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5828:1875689374555776:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1788797065.228807:0:5828:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788797065.228904:0:5828:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb048fdd780 going to sleep for 11 seconds 00000100:00100000:1.0:1788797065.229352:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374555776 00000100:00100000:1.0:1788797065.229362:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374555776 00000100:00100000:0.0:1788797065.229719:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788797065.229732:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb080661500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5828:x1875689374555776:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1788797065.230251:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb080661500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5828:x1875689374555776:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 520us (1441us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1788797065.230259:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788797065.230372:0:5828:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb0796c6d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5828:1875689374555776:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1788797065.230465:0:5828:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00010000:00010000:1.0:1788797065.230536:0:5828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69800/0xca7fc0c411f93f51 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797065.230556:0:5828:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69800/0xca7fc0c411f93f51 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797065.230564:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69800/0xca7fc0c411f93f51 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797065.230570:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb077c69800 already unused, calling callback (ffffffffc1f014f0) 00010000:00010000:1.0:1788797065.230574:0:5828:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69800/0xca7fc0c411f93f51 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797065.230582:0:5828:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69800/0xca7fc0c411f93f51 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797065.230597:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cb058766200) 00010000:00010000:1.0:1788797065.230599:0:5828:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1788797065.230604:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69800/0xca7fc0c411f93f51 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797065.230610:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69800/0xca7fc0c411f93f51 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788797065.230809:0:5828:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1788797065.230926:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8448 00000004:00080000:1.0:1788797065.230938:0:5828:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 354236908715ns, next at 355236906737ns, rc = 0 00000001:00080000:1.0:1788797065.230944:0:5828:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00010000:00010000:1.0:1788797065.230974:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cb058766200) 00010000:00010000:1.0:1788797065.230988:0:5828:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1788797065.230995:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040031e00/0xca7fc0c411f93f3c lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1218 expref: 32 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788797065.231130:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb050636050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e6d050bb-169e-4784-be5b-7071799bf3b0+31:11387:x1875689351482496:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 16744us (17530us total) trans 4294967431 rc 0/0 00000100:00100000:1.0:1788797065.231138:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 38 00000020:00080000:1.0:1788797065.231143:0:5828:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1788797065.234889:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1788797065.235139:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351482752 00000100:00100000:1.0:1788797065.235152:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351482752 00000100:00100000:1.0:1788797065.235210:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 147 00000100:00100000:1.0:1788797065.235222:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0774e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6d050bb-169e-4784-be5b-7071799bf3b0+31:11387:x1875689351482752:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1788797065.235252:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788797065.235277:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045e00/0xca7fc0c411f93f58 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c99e04559ee121f expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797065.235348:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045e00/0xca7fc0c411f93f58 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee121f expref: 32 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797065.235363:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045e00/0xca7fc0c411f93f58 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee121f expref: 32 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797065.235383:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cb06ce84b00) 00010000:00010000:1.0:1788797065.235386:0:5826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788797065.235389:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb082045e00, rc 0) 00000100:00100000:1.0:1788797065.235452:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0774e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6d050bb-169e-4784-be5b-7071799bf3b0+32:11387:x1875689351482752:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 232us (592us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797065.235459:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 147 00000100:00100000:3.0:1788797065.240341:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1788797065.240426:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351483008 00000100:00100000:1.0:1788797065.240436:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351483008 00000100:00100000:1.0:1788797065.240507:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 39 00000100:00100000:1.0:1788797065.240529:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0774e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e6d050bb-169e-4784-be5b-7071799bf3b0+32:11387:x1875689351483008:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:1.0:1788797065.240800:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0774e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e6d050bb-169e-4784-be5b-7071799bf3b0+33:11387:x1875689351483008:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 282us (468us total) trans 4294967432 rc 0/0 00000100:00100000:1.0:1788797065.240808:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 39 00000100:00100000:3.0:1788797065.400220:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1788797065.400389:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351483264 00000100:00100000:0.0:1788797065.400399:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351483264 00000100:00100000:0.0:1788797065.400462:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 148 00000100:00100000:0.0:1788797065.400473:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0774e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6d050bb-169e-4784-be5b-7071799bf3b0+33:11397:x1875689351483264:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1788797065.400506:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788797065.400535:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3a00/0xca7fc0c411f93f5f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c99e04559ee1226 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788797065.400668:0:5825:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:0.0:1788797065.401252:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3a00/0xca7fc0c411f93f5f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1226 expref: 35 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797065.401293:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cb058766400) 00010000:00010000:0.0:1788797065.401296:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788797065.401301:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3a00/0xca7fc0c411f93f5f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1226 expref: 35 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797065.401320:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb042ea3a00, rc 0) 00000100:00100000:0.0:1788797065.401402:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0774e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6d050bb-169e-4784-be5b-7071799bf3b0+34:11397:x1875689351483264:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 930us (1196us total) trans 4294967433 rc 301/301 00000100:00100000:0.0:1788797065.401410:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 148 00000100:00100000:3.0:1788797065.406133:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1788797065.406290:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351483392 00000100:00100000:1.0:1788797065.406301:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351483392 00000100:00100000:1.0:1788797065.406359:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 149 00000100:00100000:1.0:1788797065.406368:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0774e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6d050bb-169e-4784-be5b-7071799bf3b0+34:11397:x1875689351483392:12345-192.168.204.38@tcp:34:lfs.0 00010000:00010000:1.0:1788797065.406434:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045600/0xca7fc0c411f93f6d lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797065.406450:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045600/0xca7fc0c411f93f6d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797065.406462:0:5826:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045600/0xca7fc0c411f93f6d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797065.406474:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082044600/0xca7fc0c411f93f74 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797065.406492:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082044600/0xca7fc0c411f93f74 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797065.406498:0:5826:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082044600/0xca7fc0c411f93f74 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797065.406623:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045c00/0xca7fc0c411f93f7b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797065.406649:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045c00/0xca7fc0c411f93f7b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797065.406656:0:5826:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045c00/0xca7fc0c411f93f7b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788797065.407176:0:5826:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045c00/0xca7fc0c411f93f7b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797065.407194:0:5826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045600/0xca7fc0c411f93f6d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797065.407202:0:5826:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045600/0xca7fc0c411f93f6d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797065.407209:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045600/0xca7fc0c411f93f6d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797065.407216:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb082045600 already unused, calling callback (ffffffffc1f014f0) 00010000:00010000:1.0:1788797065.407220:0:5826:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045600/0xca7fc0c411f93f6d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797065.407228:0:5826:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045600/0xca7fc0c411f93f6d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797065.407241:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8cb058766500) 00010000:00010000:1.0:1788797065.407244:0:5826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788797065.407249:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045600/0xca7fc0c411f93f6d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797065.407256:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045600/0xca7fc0c411f93f6d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797065.407281:0:5826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082044600/0xca7fc0c411f93f74 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797065.407287:0:5826:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082044600/0xca7fc0c411f93f74 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797065.407293:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082044600/0xca7fc0c411f93f74 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797065.407298:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb082044600 already unused, calling callback (ffffffffc1f014f0) 00010000:00010000:1.0:1788797065.407300:0:5826:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082044600/0xca7fc0c411f93f74 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797065.407306:0:5826:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082044600/0xca7fc0c411f93f74 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797065.407312:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8cb06ce84e00) 00010000:00010000:1.0:1788797065.407314:0:5826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788797065.407317:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082044600/0xca7fc0c411f93f74 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797065.407322:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082044600/0xca7fc0c411f93f74 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797065.407340:0:5826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045c00/0xca7fc0c411f93f7b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797065.407345:0:5826:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045c00/0xca7fc0c411f93f7b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797065.407351:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045c00/0xca7fc0c411f93f7b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797065.407359:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb082045c00 already unused, calling callback (ffffffffc1f014f0) 00010000:00010000:1.0:1788797065.407362:0:5826:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045c00/0xca7fc0c411f93f7b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797065.407368:0:5826:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045c00/0xca7fc0c411f93f7b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797065.407374:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cb06ce84b00) 00010000:00010000:1.0:1788797065.407376:0:5826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788797065.407379:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045c00/0xca7fc0c411f93f7b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797065.407384:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045c00/0xca7fc0c411f93f7b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788797065.407656:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0774e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6d050bb-169e-4784-be5b-7071799bf3b0+34:11397:x1875689351483392:12345-192.168.204.38@tcp:34:lfs.0 Request processed in 1284us (1531us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797065.407668:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 149 00000100:00100000:3.0:1788797065.413405:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1788797065.413790:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351483648 00000100:00100000:1.0:1788797065.413806:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351483648 00000100:00100000:1.0:1788797065.414074:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 40 00000100:00100000:1.0:1788797065.414087:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb04945fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e6d050bb-169e-4784-be5b-7071799bf3b0+34:11397:x1875689351483648:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:1.0:1788797065.414373:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb04945fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e6d050bb-169e-4784-be5b-7071799bf3b0+35:11397:x1875689351483648:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 287us (977us total) trans 4294967434 rc 0/0 00000100:00100000:1.0:1788797065.414381:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 40 00000100:00100000:2.0:1788797065.465110:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1788797065.465199:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351483904 00000100:00100000:0.0:1788797065.465213:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351483904 00000100:00100000:0.0:1788797065.465280:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 150 00000100:00100000:0.0:1788797065.465291:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb079175c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6d050bb-169e-4784-be5b-7071799bf3b0+35:11400:x1875689351483904:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1788797065.465323:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788797065.465347:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3a00/0xca7fc0c411f93f82 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c99e04559ee122d expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797065.465427:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3600/0xca7fc0c411f93f89 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797065.465444:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3600/0xca7fc0c411f93f89 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797065.465458:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3600/0xca7fc0c411f93f89 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797065.465474:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2a00/0xca7fc0c411f93f90 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797065.465498:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2a00/0xca7fc0c411f93f90 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797065.465505:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2a00/0xca7fc0c411f93f90 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797065.465649:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3200/0xca7fc0c411f93f97 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797065.465658:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3200/0xca7fc0c411f93f97 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797065.465665:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3200/0xca7fc0c411f93f97 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788797065.465675:0:5825:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:0.0:1788797065.465778:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3600/0xca7fc0c411f93f89 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797065.465786:0:5825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3600/0xca7fc0c411f93f89 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797065.465793:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3600/0xca7fc0c411f93f89 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797065.465799:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb042ea3600 already unused, calling callback (ffffffffc1f014f0) 00010000:00010000:0.0:1788797065.465803:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3600/0xca7fc0c411f93f89 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797065.465810:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3600/0xca7fc0c411f93f89 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797065.465831:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8cb058766500) 00010000:00010000:0.0:1788797065.465833:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788797065.465838:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3600/0xca7fc0c411f93f89 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797065.465844:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3600/0xca7fc0c411f93f89 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797065.465868:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2a00/0xca7fc0c411f93f90 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797065.465880:0:5825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2a00/0xca7fc0c411f93f90 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797065.465886:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2a00/0xca7fc0c411f93f90 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797065.465892:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb042ea2a00 already unused, calling callback (ffffffffc1f014f0) 00010000:00010000:0.0:1788797065.465894:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2a00/0xca7fc0c411f93f90 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797065.465900:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2a00/0xca7fc0c411f93f90 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797065.465906:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8cb058766000) 00010000:00010000:0.0:1788797065.465908:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788797065.465911:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2a00/0xca7fc0c411f93f90 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797065.465916:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2a00/0xca7fc0c411f93f90 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797065.465971:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3a00/0xca7fc0c411f93f82 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee122d expref: 38 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797065.465987:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3200/0xca7fc0c411f93f97 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee122d expref: 37 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797065.465994:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cb06ce84b00) 00010000:00010000:0.0:1788797065.465996:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788797065.465999:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb042ea3200, rc 0) 00000100:00100000:0.0:1788797065.466143:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb079175c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6d050bb-169e-4784-be5b-7071799bf3b0+37:11400:x1875689351483904:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 854us (1042us total) trans 4294967435 rc 0/0 00000100:00100000:0.0:1788797065.466150:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 150 00000100:00100000:3.0:1788797065.470870:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1788797065.471077:0:7636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351484032 00000100:00100000:2.0:1788797065.471092:0:7636:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351484032 00000100:00100000:2.0:1788797065.471163:0:7636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 151 00000100:00100000:2.0:1788797065.471174:0:7636:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb04945ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6d050bb-169e-4784-be5b-7071799bf3b0+37:11400:x1875689351484032:12345-192.168.204.38@tcp:54:lfs.0 00010000:00010000:2.0:1788797065.471247:0:7636:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040030000/0xca7fc0c411f93fa5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797065.471268:0:7636:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040030000/0xca7fc0c411f93fa5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797065.471282:0:7636:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040030000/0xca7fc0c411f93fa5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797065.471339:0:7636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040030000/0xca7fc0c411f93fa5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797065.471346:0:7636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040030000/0xca7fc0c411f93fa5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797065.471356:0:7636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040030000/0xca7fc0c411f93fa5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797065.471364:0:7636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb040030000 already unused, calling callback (ffffffffc1f014f0) 00010000:00010000:2.0:1788797065.471370:0:7636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040030000/0xca7fc0c411f93fa5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797065.471380:0:7636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040030000/0xca7fc0c411f93fa5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797065.471397:0:7636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cb06ce84b00) 00010000:00010000:2.0:1788797065.471401:0:7636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788797065.471407:0:7636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040030000/0xca7fc0c411f93fa5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797065.471415:0:7636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040030000/0xca7fc0c411f93fa5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788797065.471518:0:7636:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb04945ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6d050bb-169e-4784-be5b-7071799bf3b0+37:11400:x1875689351484032:12345-192.168.204.38@tcp:54:lfs.0 Request processed in 345us (669us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797065.471527:0:7636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 151 00000100:00100000:1.0:1788797065.475536:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1788797065.475683:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351484288 00000100:00100000:2.0:1788797065.475704:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351484288 00000100:00100000:2.0:1788797065.475771:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 41 00000100:00100000:2.0:1788797065.475807:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb077e31880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e6d050bb-169e-4784-be5b-7071799bf3b0+37:11400:x1875689351484288:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:2.0:1788797065.476130:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb077e31880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e6d050bb-169e-4784-be5b-7071799bf3b0+38:11400:x1875689351484288:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 325us (604us total) trans 4294967436 rc 0/0 00000100:00100000:2.0:1788797065.476138:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 41 00000100:00100000:3.0:1788797065.790242:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1788797065.790344:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351484544 00000100:00100000:0.0:1788797065.790354:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351484544 00000100:00100000:0.0:1788797065.790415:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 152 00000100:00100000:0.0:1788797065.790426:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb04945df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6d050bb-169e-4784-be5b-7071799bf3b0+38:11432:x1875689351484544:12345-192.168.204.38@tcp:101:cat.0 00010000:00010000:0.0:1788797065.790451:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788797065.790472:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3a00/0xca7fc0c411f93fac lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c99e04559ee1234 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797065.790615:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2a00/0xca7fc0c411f93fb3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797065.790629:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2a00/0xca7fc0c411f93fb3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797065.790640:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2a00/0xca7fc0c411f93fb3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788797065.790659:0:5825:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:0.0:1788797065.790792:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3a00/0xca7fc0c411f93fac lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1234 expref: 41 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797065.790814:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2a00/0xca7fc0c411f93fb3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1234 expref: 40 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797065.790823:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cb06ce84b00) 00010000:00010000:0.0:1788797065.790826:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788797065.790830:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb042ea2a00, rc 0) 00000100:00100000:0.0:1788797065.790906:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb04945df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6d050bb-169e-4784-be5b-7071799bf3b0+40:11432:x1875689351484544:12345-192.168.204.38@tcp:101:cat.0 Request processed in 482us (680us total) trans 4294967437 rc 0/0 00000100:00100000:0.0:1788797065.790913:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 152 00000100:00100000:3.0:1788797065.797132:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1788797065.797647:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351484800 00000100:00100000:2.0:1788797065.797661:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351484800 00000100:00100000:2.0:1788797065.797726:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 42 00000100:00100000:2.0:1788797065.797737:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb04945c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e6d050bb-169e-4784-be5b-7071799bf3b0+40:11432:x1875689351484800:12345-192.168.204.38@tcp:35:cat.0 00000100:00100000:2.0:1788797065.798022:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb04945c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e6d050bb-169e-4784-be5b-7071799bf3b0+41:11432:x1875689351484800:12345-192.168.204.38@tcp:35:cat.0 Request processed in 286us (900us total) trans 4294967438 rc 0/0 00000100:00100000:2.0:1788797065.798055:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 42 00000100:00100000:1.0:1788797065.800942:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1788797065.801112:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351484928 00000100:00100000:0.0:1788797065.801123:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351484928 00000100:00100000:0.0:1788797065.801214:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 12 00000100:00100000:0.0:1788797065.801225:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb077e32a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e6d050bb-169e-4784-be5b-7071799bf3b0+41:2352:x1875689351484928:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788797065.801241:0:5813:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788797065.801293:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2a00/0xca7fc0c411f93fb3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1234 expref: 41 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797065.801336:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cb06ce84b00) 00010000:00010000:0.0:1788797065.801342:0:5813:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788797065.801436:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb077e32a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e6d050bb-169e-4784-be5b-7071799bf3b0+40:2352:x1875689351484928:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 212us (503us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797065.801443:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 12 00000100:00100000:3.0:1788797065.891115:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1788797065.891207:0:7636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351485184 00000100:00100000:2.0:1788797065.891217:0:7636:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351485184 00000100:00100000:2.0:1788797065.891276:0:7636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 153 00000100:00100000:2.0:1788797065.891288:0:7636:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb04945c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6d050bb-169e-4784-be5b-7071799bf3b0+40:11438:x1875689351485184:12345-192.168.204.38@tcp:101:dd.0 00010000:00010000:2.0:1788797065.891313:0:7636:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788797065.891317:0:7636:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788797065.891344:0:7636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3c00/0xca7fc0c411f93f19 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee120a expref: 40 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797065.891365:0:7636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8cb058766500) 00010000:00010000:2.0:1788797065.891369:0:7636:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788797065.891382:0:7636:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040030800/0xca7fc0c411f93fc1 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c99e04559ee123b expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797065.891484:0:7636:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040030c00/0xca7fc0c411f93fc8 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797065.891520:0:7636:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3200/0xca7fc0c411f93f97 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee122d expref: 40 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797065.891528:0:7636:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040030c00/0xca7fc0c411f93fc8 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797065.891614:0:7636:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3200/0xca7fc0c411f93f97 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee122d expref: 40 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797065.891627:0:7636:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3200/0xca7fc0c411f93f97 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee122d expref: 40 pid: 5825 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788797065.891639:0:7636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb079175180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7636:1875689374555904:192.168.204.38@tcp:104: 00000100:00100000:2.0:1788797065.891754:0:7636:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb048dc0300 going to sleep for 11 seconds 00000100:00100000:1.0:1788797065.899187:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1788797065.899396:0:7636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb079175180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7636:1875689374555904:192.168.204.38@tcp:104: 00010000:00010000:2.0:1788797065.899452:0:7636:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040030c00/0xca7fc0c411f93fc8 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788797065.899799:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351485312 00000100:00100000:3.0:1788797065.899807:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351485312 00010000:00010000:3.0:1788797065.899846:0:6698:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3200/0xca7fc0c411f93f97 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee122d expref: 41 pid: 5825 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788797065.899901:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 62 00000100:00100000:3.0:1788797065.899919:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb077e32300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e6d050bb-169e-4784-be5b-7071799bf3b0+41:2355:x1875689351485312:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788797065.899940:0:6698:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788797065.899948:0:6698:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3200/0xca7fc0c411f93f97 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee122d expref: 41 pid: 5825 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797065.899961:0:6698:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3200/0xca7fc0c411f93f97 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee122d expref: 41 pid: 5825 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797065.899984:0:6698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3200/0xca7fc0c411f93f97 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee122d expref: 41 pid: 5825 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797065.900001:0:6698:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cb06ce84b00) 00010000:00010000:3.0:1788797065.900005:0:6698:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040030c00/0xca7fc0c411f93fc8 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797065.900015:0:6698:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040030c00/0xca7fc0c411f93fc8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797065.900119:0:6698:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040030c00/0xca7fc0c411f93fc8 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797065.900150:0:6698:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788797065.900201:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb077e32300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e6d050bb-169e-4784-be5b-7071799bf3b0+40:2355:x1875689351485312:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 284us (1024us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797065.900227:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 62 00010000:00010000:2.0:1788797065.900450:0:7636:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040030c00/0xca7fc0c411f93fc8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797065.900458:0:7636:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040030c00/0xca7fc0c411f93fc8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788797065.900479:0:7636:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1788797065.900688:0:7636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040030800/0xca7fc0c411f93fc1 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee123b expref: 41 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797065.900720:0:7636:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040030c00/0xca7fc0c411f93fc8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee123b expref: 40 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797065.900727:0:7636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cb06ce84b00) 00010000:00010000:2.0:1788797065.900730:0:7636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788797065.900732:0:7636:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb040030c00, rc 0) 00000100:00100000:2.0:1788797065.900770:0:7636:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb04945c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6d050bb-169e-4784-be5b-7071799bf3b0+40:11438:x1875689351485184:12345-192.168.204.38@tcp:101:dd.0 Request processed in 9485us (9666us total) trans 4294967439 rc 0/0 00000100:00100000:2.0:1788797065.900777:0:7636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 153 00000100:00100000:1.0:1788797065.913747:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1788797065.914147:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351485568 00000100:00100000:0.0:1788797065.914159:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351485568 00000100:00100000:0.0:1788797065.914220:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 154 00000100:00100000:0.0:1788797065.914231:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb077e31180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6d050bb-169e-4784-be5b-7071799bf3b0+40:11438:x1875689351485568:12345-192.168.204.38@tcp:36:dd.0 00010000:00010000:0.0:1788797065.914497:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2a00/0xca7fc0c411f93fd6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797065.914515:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2a00/0xca7fc0c411f93fd6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797065.914528:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2a00/0xca7fc0c411f93fd6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788797065.914595:0:5825:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967440 00000004:00010000:0.0:1788797065.914620:0:5825:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000076b11efe reply state 00000000d7d57509 transno 4294967441 ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2a00/0xca7fc0c411f93fd6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788797065.914629:0:5825:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788797065.914853:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb077e31180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6d050bb-169e-4784-be5b-7071799bf3b0+43:11438:x1875689351485568:12345-192.168.204.38@tcp:36:dd.0 Request processed in 614us (1107us total) trans 4294967441 rc 0/0 00000100:00100000:0.0:1788797065.914862:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 154 00000020:00080000:0.0:1788797065.915020:0:5825:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788797065.923255:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2a00/0xca7fc0c411f93fd6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797065.923274:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2a00/0xca7fc0c411f93fd6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797065.923283:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2a00/0xca7fc0c411f93fd6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797065.923290:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb042ea2a00 already unused, calling callback (ffffffffc1f014f0) 00010000:00010000:1.0:1788797065.923295:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2a00/0xca7fc0c411f93fd6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797065.923302:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2a00/0xca7fc0c411f93fd6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797065.923321:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cb06ce84b00) 00010000:00010000:1.0:1788797065.923324:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788797065.923329:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2a00/0xca7fc0c411f93fd6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797065.923335:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2a00/0xca7fc0c411f93fd6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797066.035070:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788797066.380814:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1788797066.380983:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351485696 00000100:00100000:0.0:1788797066.380995:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351485696 00000100:00100000:0.0:1788797066.381112:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 155 00000100:00100000:0.0:1788797066.381124:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb077e30000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6d050bb-169e-4784-be5b-7071799bf3b0+42:11452:x1875689351485696:12345-192.168.204.38@tcp:101:stat.0 00010000:00010000:0.0:1788797066.381157:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788797066.381183:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3a00/0xca7fc0c411f93fdd lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c99e04559ee1242 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797066.381290:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3600/0xca7fc0c411f93fe4 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797066.381306:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3600/0xca7fc0c411f93fe4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797066.381318:0:5826:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3600/0xca7fc0c411f93fe4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797066.381331:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3000/0xca7fc0c411f93feb lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797066.381338:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3000/0xca7fc0c411f93feb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797066.381345:0:5826:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3000/0xca7fc0c411f93feb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797066.381449:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3400/0xca7fc0c411f93ff2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797066.381461:0:5826:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040030c00/0xca7fc0c411f93fc8 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee123b expref: 43 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797066.381471:0:5826:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3400/0xca7fc0c411f93ff2 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797066.381507:0:5826:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040030c00/0xca7fc0c411f93fc8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee123b expref: 43 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797066.381543:0:5826:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040030c00/0xca7fc0c411f93fc8 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee123b expref: 43 pid: 7636 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788797066.381557:0:5826:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb080661c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5826:1875689374556032:192.168.204.38@tcp:104: 00000100:00100000:0.0:1788797066.381672:0:5826:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb04919a780 going to sleep for 11 seconds 00000100:00080000:2.0:1788797066.383714:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788797066.388517:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1788797066.389911:0:5826:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb080661c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5826:1875689374556032:192.168.204.38@tcp:104: 00010000:00010000:0.0:1788797066.389942:0:5826:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3400/0xca7fc0c411f93ff2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788797066.390132:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351485952 00000100:00100000:2.0:1788797066.390141:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351485952 00000100:00100000:2.0:1788797066.390206:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 43 00000100:00100000:2.0:1788797066.390217:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb04945d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e6d050bb-169e-4784-be5b-7071799bf3b0+44:5609:x1875689351485952:12345-192.168.204.38@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1788797066.390596:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb04945d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e6d050bb-169e-4784-be5b-7071799bf3b0+45:5609:x1875689351485952:12345-192.168.204.38@tcp:35:ldlm_bl.0 Request processed in 380us (2087us total) trans 4294967442 rc 0/0 00000100:00100000:2.0:1788797066.390604:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 43 00000100:00100000:3.0:1788797066.401430:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1788797066.401532:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351486080 00000100:00100000:1.0:1788797066.401544:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351486080 00010000:00010000:1.0:1788797066.401601:0:5812:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040030c00/0xca7fc0c411f93fc8 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee123b expref: 45 pid: 7636 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788797066.401654:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 63 00000100:00100000:1.0:1788797066.401686:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0484c5850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e6d050bb-169e-4784-be5b-7071799bf3b0+45:2355:x1875689351486080:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788797066.401706:0:5812:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788797066.401714:0:5812:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040030c00/0xca7fc0c411f93fc8 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee123b expref: 45 pid: 7636 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797066.401732:0:5812:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040030c00/0xca7fc0c411f93fc8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee123b expref: 45 pid: 7636 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797066.401761:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040030c00/0xca7fc0c411f93fc8 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee123b expref: 45 pid: 7636 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797066.401786:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cb06ce84b00) 00010000:00010000:1.0:1788797066.401792:0:5812:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3400/0xca7fc0c411f93ff2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797066.401803:0:5812:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3400/0xca7fc0c411f93ff2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797066.401814:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3400/0xca7fc0c411f93ff2 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797066.401872:0:5812:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788797066.401939:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0484c5850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e6d050bb-169e-4784-be5b-7071799bf3b0+44:2355:x1875689351486080:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 255us (521us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797066.401947:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 63 00010000:00010000:2.0:1788797066.402766:0:5826:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3400/0xca7fc0c411f93ff2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797066.402780:0:5826:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3400/0xca7fc0c411f93ff2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788797066.402864:0:5826:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:2.0:1788797066.402869:0:5826:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788797066.402898:0:5826:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3400/0xca7fc0c411f93ff2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797066.402929:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3400/0xca7fc0c411f93ff2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797066.402940:0:5826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3600/0xca7fc0c411f93fe4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797066.402946:0:5826:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3600/0xca7fc0c411f93fe4 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797066.402952:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3600/0xca7fc0c411f93fe4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797066.402958:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb042ea3600 already unused, calling callback (ffffffffc1f014f0) 00010000:00010000:2.0:1788797066.402962:0:5826:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3600/0xca7fc0c411f93fe4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797066.402968:0:5826:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3600/0xca7fc0c411f93fe4 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797066.402979:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8cb058766500) 00010000:00010000:2.0:1788797066.402982:0:5826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788797066.402986:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3600/0xca7fc0c411f93fe4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797066.402992:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3600/0xca7fc0c411f93fe4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797066.403007:0:5826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3000/0xca7fc0c411f93feb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797066.403013:0:5826:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3000/0xca7fc0c411f93feb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797066.403060:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3000/0xca7fc0c411f93feb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797066.403066:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb042ea3000 already unused, calling callback (ffffffffc1f014f0) 00010000:00010000:2.0:1788797066.403070:0:5826:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3000/0xca7fc0c411f93feb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797066.403076:0:5826:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3000/0xca7fc0c411f93feb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797066.403085:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8cb058766000) 00010000:00010000:2.0:1788797066.403087:0:5826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788797066.403090:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3000/0xca7fc0c411f93feb lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797066.403096:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3000/0xca7fc0c411f93feb lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797066.403142:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3a00/0xca7fc0c411f93fdd lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1242 expref: 44 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797066.403158:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3400/0xca7fc0c411f93ff2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1242 expref: 43 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797066.403166:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cb06ce84b00) 00010000:00010000:2.0:1788797066.403168:0:5826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788797066.403171:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb042ea3400, rc 0) 00000100:00100000:2.0:1788797066.403379:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb077e30000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6d050bb-169e-4784-be5b-7071799bf3b0+43:11452:x1875689351485696:12345-192.168.204.38@tcp:101:stat.0 Request processed in 22255us (22575us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797066.403396:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 155 00000100:00100000:3.0:1788797066.477460:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1788797066.477607:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351486336 00000100:00100000:2.0:1788797066.477618:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351486336 00000100:00100000:2.0:1788797066.477682:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 156 00000100:00100000:2.0:1788797066.477694:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb04945d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6d050bb-169e-4784-be5b-7071799bf3b0+43:11458:x1875689351486336:12345-192.168.204.38@tcp:36:truncate.0 00010000:00010000:2.0:1788797066.477756:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788797066.477781:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3400/0xca7fc0c411f93ff2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1242 expref: 43 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797066.477802:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cb06ce84b00) 00010000:00010000:2.0:1788797066.477807:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788797066.478371:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040030800/0xca7fc0c411f93ff9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797066.478387:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040030800/0xca7fc0c411f93ff9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797066.478399:0:5827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040030800/0xca7fc0c411f93ff9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788797066.478450:0:5827:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967443 00000004:00010000:2.0:1788797066.478481:0:5827:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006a9403a6 reply state 00000000f36c08ca transno 4294967444 ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040030800/0xca7fc0c411f93ff9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788797066.478490:0:5827:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788797066.478747:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb04945d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6d050bb-169e-4784-be5b-7071799bf3b0+45:11458:x1875689351486336:12345-192.168.204.38@tcp:36:truncate.0 Request processed in 1054us (1298us total) trans 4294967444 rc 0/0 00000100:00100000:2.0:1788797066.478756:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 156 00000020:00080000:2.0:1788797066.478771:0:5827:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788797066.482006:0:3286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040030800/0xca7fc0c411f93ff9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797066.482024:0:3286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040030800/0xca7fc0c411f93ff9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797066.493781:0:3286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040030800/0xca7fc0c411f93ff9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797066.493788:0:3286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb040030800 already unused, calling callback (ffffffffc1f014f0) 00010000:00010000:1.0:1788797066.493793:0:3286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040030800/0xca7fc0c411f93ff9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797066.493802:0:3286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040030800/0xca7fc0c411f93ff9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797066.493820:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cb06ce84b00) 00010000:00010000:1.0:1788797066.493823:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788797066.493839:0:3286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040030800/0xca7fc0c411f93ff9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797066.493847:0:3286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040030800/0xca7fc0c411f93ff9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788797066.714387:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1788797066.714529:0:7636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351486464 00000100:00100000:2.0:1788797066.714542:0:7636:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351486464 00000100:00100000:2.0:1788797066.714629:0:7636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 157 00000100:00100000:2.0:1788797066.714642:0:7636:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb06ef1f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6d050bb-169e-4784-be5b-7071799bf3b0+44:11472:x1875689351486464:12345-192.168.204.38@tcp:101:stat.0 00010000:00010000:2.0:1788797066.714667:0:7636:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788797066.714691:0:7636:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040031a00/0xca7fc0c411f94000 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c99e04559ee1249 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797066.714780:0:7636:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040030800/0xca7fc0c411f94007 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797066.714797:0:7636:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040030800/0xca7fc0c411f94007 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797066.714809:0:7636:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040030800/0xca7fc0c411f94007 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797066.714823:0:7636:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040031400/0xca7fc0c411f9400e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797066.714841:0:7636:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040031400/0xca7fc0c411f9400e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797066.714856:0:7636:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040031400/0xca7fc0c411f9400e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797066.714952:0:7636:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040030c00/0xca7fc0c411f94015 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797066.714975:0:7636:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040030c00/0xca7fc0c411f94015 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797066.715004:0:7636:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040030c00/0xca7fc0c411f94015 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788797066.715074:0:7636:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00000004:00200000:2.0:1788797066.715079:0:7636:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788797066.715097:0:7636:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040030c00/0xca7fc0c411f94015 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797066.715109:0:7636:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040030c00/0xca7fc0c411f94015 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797066.715117:0:7636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040030800/0xca7fc0c411f94007 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797066.715124:0:7636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040030800/0xca7fc0c411f94007 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797066.715130:0:7636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040030800/0xca7fc0c411f94007 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797066.715136:0:7636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb040030800 already unused, calling callback (ffffffffc1f014f0) 00010000:00010000:2.0:1788797066.715141:0:7636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040030800/0xca7fc0c411f94007 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797066.715148:0:7636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040030800/0xca7fc0c411f94007 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797066.715160:0:7636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8cb058766500) 00010000:00010000:2.0:1788797066.715163:0:7636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788797066.715168:0:7636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040030800/0xca7fc0c411f94007 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797066.715184:0:7636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040030800/0xca7fc0c411f94007 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797066.715200:0:7636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040031400/0xca7fc0c411f9400e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797066.715206:0:7636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040031400/0xca7fc0c411f9400e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797066.715212:0:7636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040031400/0xca7fc0c411f9400e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797066.715217:0:7636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb040031400 already unused, calling callback (ffffffffc1f014f0) 00010000:00010000:2.0:1788797066.715220:0:7636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040031400/0xca7fc0c411f9400e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797066.715227:0:7636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040031400/0xca7fc0c411f9400e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797066.715234:0:7636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8cb05088ad00) 00010000:00010000:2.0:1788797066.715236:0:7636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788797066.715239:0:7636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040031400/0xca7fc0c411f9400e lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797066.715245:0:7636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040031400/0xca7fc0c411f9400e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797066.715278:0:7636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040031a00/0xca7fc0c411f94000 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1249 expref: 46 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797066.715291:0:7636:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040030c00/0xca7fc0c411f94015 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1249 expref: 45 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797066.715304:0:7636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cb06ce84b00) 00010000:00010000:2.0:1788797066.715307:0:7636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788797066.715309:0:7636:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb040030c00, rc 0) 00000100:00100000:2.0:1788797066.715374:0:7636:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb06ef1f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6d050bb-169e-4784-be5b-7071799bf3b0+45:11472:x1875689351486464:12345-192.168.204.38@tcp:101:stat.0 Request processed in 734us (1000us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797066.715382:0:7636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 157 00000100:00100000:3.0:1788797066.867130:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1788797066.867288:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351486720 00000100:00100000:0.0:1788797066.867299:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351486720 00000100:00100000:0.0:1788797066.867361:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 158 00000100:00100000:0.0:1788797066.867371:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb06ef1ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6d050bb-169e-4784-be5b-7071799bf3b0+45:11482:x1875689351486720:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1788797066.867399:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788797066.867422:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3800/0xca7fc0c411f9401c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c99e04559ee1250 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788797066.867746:0:5825:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:0.0:1788797066.867881:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3800/0xca7fc0c411f9401c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1250 expref: 47 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797066.867896:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cb058766400) 00010000:00010000:0.0:1788797066.867899:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788797066.867905:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3800/0xca7fc0c411f9401c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1250 expref: 47 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797066.867939:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb042ea3800, rc 0) 00000100:00100000:0.0:1788797066.868003:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb06ef1ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6d050bb-169e-4784-be5b-7071799bf3b0+46:11482:x1875689351486720:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 633us (882us total) trans 4294967445 rc 301/301 00000100:00100000:0.0:1788797066.868011:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 158 00000100:00100000:1.0:1788797066.871097:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1788797066.871254:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351486976 00000100:00100000:3.0:1788797066.871265:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351486976 00000100:00100000:3.0:1788797066.871327:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 44 00000100:00100000:3.0:1788797066.871338:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb050637450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e6d050bb-169e-4784-be5b-7071799bf3b0+46:11482:x1875689351486976:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:3.0:1788797066.871603:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb050637450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e6d050bb-169e-4784-be5b-7071799bf3b0+47:11482:x1875689351486976:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 266us (516us total) trans 4294967446 rc 0/0 00000100:00100000:3.0:1788797066.871610:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 44 00000100:00100000:3.0:1788797066.957182:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1788797066.957330:0:7636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351487232 00000100:00100000:2.0:1788797066.957341:0:7636:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351487232 00000100:00100000:2.0:1788797066.957419:0:7636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 159 00000100:00100000:2.0:1788797066.957429:0:7636:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb06ef1c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6d050bb-169e-4784-be5b-7071799bf3b0+47:11488:x1875689351487232:12345-192.168.204.38@tcp:101:bash.0 00010000:00010000:2.0:1788797066.957465:0:7636:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788797066.957487:0:7636:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040031a00/0xca7fc0c411f9402a lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c99e04559ee1257 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797066.957615:0:7636:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040031400/0xca7fc0c411f94031 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797066.957630:0:7636:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040030c00/0xca7fc0c411f94015 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1249 expref: 48 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797066.957639:0:7636:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040031400/0xca7fc0c411f94031 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797066.957670:0:7636:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040030c00/0xca7fc0c411f94015 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1249 expref: 48 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797066.957684:0:7636:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040030c00/0xca7fc0c411f94015 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1249 expref: 48 pid: 7636 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788797066.957712:0:7636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb079175180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7636:1875689374556160:192.168.204.38@tcp:104: 00000100:00100000:2.0:1788797066.957818:0:7636:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb0484ff780 going to sleep for 11 seconds 00000100:00100000:2.0:1788797066.962925:0:7636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb079175180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7636:1875689374556160:192.168.204.38@tcp:104: 00010000:00010000:2.0:1788797066.962971:0:7636:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040031400/0xca7fc0c411f94031 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788797066.963087:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1788797066.963266:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351487360 00000100:00100000:1.0:1788797066.963277:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351487360 00010000:00010000:1.0:1788797066.963328:0:5811:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040030c00/0xca7fc0c411f94015 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1249 expref: 49 pid: 7636 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788797066.963413:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 64 00000100:00100000:1.0:1788797066.963424:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb06ef1e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e6d050bb-169e-4784-be5b-7071799bf3b0+49:2355:x1875689351487360:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788797066.963440:0:5811:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788797066.963446:0:5811:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040030c00/0xca7fc0c411f94015 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1249 expref: 49 pid: 7636 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797066.963490:0:5811:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040030c00/0xca7fc0c411f94015 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1249 expref: 49 pid: 7636 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797066.963548:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040030c00/0xca7fc0c411f94015 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1249 expref: 49 pid: 7636 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797066.963575:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cb06ce84b00) 00010000:00010000:1.0:1788797066.963590:0:5811:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040031400/0xca7fc0c411f94031 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797066.963600:0:5811:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040031400/0xca7fc0c411f94031 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797066.963609:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040031400/0xca7fc0c411f94031 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797066.963639:0:5811:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788797066.963719:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb06ef1e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e6d050bb-169e-4784-be5b-7071799bf3b0+48:2355:x1875689351487360:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 297us (634us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797066.963735:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 64 00010000:00010000:2.0:1788797066.964710:0:7636:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040031400/0xca7fc0c411f94031 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797066.964724:0:7636:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040031400/0xca7fc0c411f94031 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788797066.964763:0:7636:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00010000:00010000:2.0:1788797066.964997:0:7636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040031a00/0xca7fc0c411f9402a lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1257 expref: 49 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797066.965021:0:7636:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040031400/0xca7fc0c411f94031 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1257 expref: 48 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797066.965095:0:7636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cb06ce84b00) 00010000:00010000:2.0:1788797066.965098:0:7636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788797066.965102:0:7636:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb040031400, rc 0) 00000100:00100000:2.0:1788797066.965198:0:7636:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb06ef1c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6d050bb-169e-4784-be5b-7071799bf3b0+48:11488:x1875689351487232:12345-192.168.204.38@tcp:101:bash.0 Request processed in 7769us (8028us total) trans 4294967447 rc 0/0 00000100:00100000:2.0:1788797066.965210:0:7636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 159 00000100:00100000:3.0:1788797066.969758:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1788797066.969993:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351487616 00000100:00100000:2.0:1788797066.971022:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351487616 00000100:00100000:2.0:1788797066.971187:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 160 00000100:00100000:2.0:1788797066.971198:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb06ef1ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6d050bb-169e-4784-be5b-7071799bf3b0+48:11488:x1875689351487616:12345-192.168.204.38@tcp:36:bash.0 00010000:00010000:2.0:1788797066.971531:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040031a00/0xca7fc0c411f9403f lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797066.971553:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040031a00/0xca7fc0c411f9403f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797066.971566:0:5827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040031a00/0xca7fc0c411f9403f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788797066.971616:0:5827:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967448 00000004:00010000:2.0:1788797066.971643:0:5827:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000a4f8aa3 reply state 00000000f175ad0a transno 4294967449 ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040031a00/0xca7fc0c411f9403f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788797066.971654:0:5827:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788797066.971780:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb06ef1ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6d050bb-169e-4784-be5b-7071799bf3b0+51:11488:x1875689351487616:12345-192.168.204.38@tcp:36:bash.0 Request processed in 583us (2035us total) trans 4294967449 rc 0/0 00000100:00100000:2.0:1788797066.971789:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 160 00000020:00080000:2.0:1788797066.971795:0:5827:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1788797066.977718:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1788797066.977774:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351487744 00000100:00100000:1.0:1788797066.977784:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351487744 00000100:00100000:1.0:1788797066.977835:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 161 00000100:00100000:1.0:1788797066.977845:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb077e31c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6d050bb-169e-4784-be5b-7071799bf3b0+51:11488:x1875689351487744:12345-192.168.204.38@tcp:101:bash.0 00010000:00010000:1.0:1788797066.977885:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788797066.977906:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045c00/0xca7fc0c411f94046 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c99e04559ee125e expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797066.978018:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082044600/0xca7fc0c411f9404d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797066.978061:0:5826:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040031400/0xca7fc0c411f94031 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1257 expref: 52 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797066.978071:0:5826:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040031a00/0xca7fc0c411f9403f lrc: 2/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797066.978079:0:5826:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082044600/0xca7fc0c411f9404d lrc: 5/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797066.978097:0:5826:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040031a00/0xca7fc0c411f9403f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797066.978131:0:5826:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040031400/0xca7fc0c411f94031 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1257 expref: 52 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797066.978147:0:5826:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040031400/0xca7fc0c411f94031 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1257 expref: 52 pid: 7636 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788797066.978171:0:5826:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb077e30a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5826:1875689374556288:192.168.204.38@tcp:104: 00000100:00100000:1.0:1788797066.978258:0:5826:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb04887e600 going to sleep for 11 seconds 00010000:00010000:3.0:1788797066.979086:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040031a00/0xca7fc0c411f9403f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000020 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797066.979098:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040031a00/0xca7fc0c411f9403f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000020 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797066.979106:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040031a00/0xca7fc0c411f9403f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797066.979112:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb040031a00 already unused, calling callback (ffffffffc1f014f0) 00010000:00010000:3.0:1788797066.979124:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040031a00/0xca7fc0c411f9403f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797066.979133:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040031a00/0xca7fc0c411f9403f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000020 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797066.979151:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cb06ce84b00) 00010000:00010000:3.0:1788797066.979154:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788797066.979181:0:3287:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082044600/0xca7fc0c411f9404d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797066.979192:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040031a00/0xca7fc0c411f9403f lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000020 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797066.979198:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040031a00/0xca7fc0c411f9403f lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000020 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788797066.983656:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1788797066.983892:0:11663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351487872 00000100:00100000:0.0:1788797066.983903:0:11663:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351487872 00010000:00010000:0.0:1788797066.983954:0:11663:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040031400/0xca7fc0c411f94031 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1257 expref: 52 pid: 7636 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788797066.984351:0:11663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 65 00000100:00100000:0.0:1788797066.984366:0:11663:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb06ef1ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e6d050bb-169e-4784-be5b-7071799bf3b0+52:2354:x1875689351487872:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788797066.984383:0:11663:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788797066.984391:0:11663:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040031400/0xca7fc0c411f94031 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1257 expref: 52 pid: 7636 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797066.984406:0:11663:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040031400/0xca7fc0c411f94031 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1257 expref: 52 pid: 7636 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797066.986777:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040031400/0xca7fc0c411f94031 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1257 expref: 52 pid: 7636 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788797066.986809:0:5826:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb077e30a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5826:1875689374556288:192.168.204.38@tcp:104: 00010000:00010000:0.0:1788797066.986931:0:11663:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cb06ce84b00) 00010000:00010000:0.0:1788797066.986940:0:11663:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082044600/0xca7fc0c411f9404d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797066.986953:0:11663:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082044600/0xca7fc0c411f9404d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797066.986970:0:11663:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082044600/0xca7fc0c411f9404d lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797066.987754:0:5826:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082044600/0xca7fc0c411f9404d lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797066.988658:0:11663:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788797066.988744:0:11663:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb06ef1ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e6d050bb-169e-4784-be5b-7071799bf3b0+51:2354:x1875689351487872:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 4379us (5097us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797066.988756:0:11663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 65 00010000:00010000:1.0:1788797066.991774:0:5826:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082044600/0xca7fc0c411f9404d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797066.991794:0:5826:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082044600/0xca7fc0c411f9404d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788797066.993365:0:5826:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:1.0:1788797066.993375:0:5826:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788797066.993409:0:5826:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082044600/0xca7fc0c411f9404d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797066.993532:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045c00/0xca7fc0c411f94046 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee125e expref: 51 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797066.993556:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082044600/0xca7fc0c411f9404d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee125e expref: 50 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797066.993565:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cb06ce84b00) 00010000:00010000:1.0:1788797066.993567:0:5826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788797066.993571:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb082044600, rc 0) 00000100:00100000:1.0:1788797066.993770:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb077e31c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6d050bb-169e-4784-be5b-7071799bf3b0+50:11488:x1875689351487744:12345-192.168.204.38@tcp:101:bash.0 Request processed in 15924us (16061us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797066.993780:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 161 00000100:00100000:3.0:1788797067.007652:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1788797067.013656:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351488128 00000100:00100000:2.0:1788797067.014211:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351488128 00000100:00100000:3.0:1788797067.018701:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 45 00000100:00100000:3.0:1788797067.018716:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb04945fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e6d050bb-169e-4784-be5b-7071799bf3b0+50:11488:x1875689351488128:12345-192.168.204.38@tcp:35:bash.0 00000100:00100000:3.0:1788797067.019086:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb04945fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e6d050bb-169e-4784-be5b-7071799bf3b0+51:11488:x1875689351488128:12345-192.168.204.38@tcp:35:bash.0 Request processed in 372us (11443us total) trans 4294967450 rc 0/0 00000100:00100000:3.0:1788797067.019095:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 45 00010000:00010000:1.0:1788797067.058541:0:5815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788797067.161060:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1788797067.161112:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1788797067.161143:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1788797067.161173:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1788797067.161198:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1788797067.161290:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351488768 00000100:00100000:2.0:1788797067.161302:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351488768 00000100:00100000:0.0:1788797067.161361:0:7636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351488384 00000100:00100000:0.0:1788797067.161368:0:7636:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351488384 00000100:00100000:2.0:1788797067.161380:0:10829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351488640 00000100:00100000:2.0:1788797067.161385:0:10829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351488640 00000100:00100000:0.0:1788797067.161412:0:7636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351488896 00000100:00100000:0.0:1788797067.161418:0:7636:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351488896 00000100:00100000:2.0:1788797067.161503:0:10829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 65 00000100:00100000:2.0:1788797067.161526:0:10829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb04945d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e6d050bb-169e-4784-be5b-7071799bf3b0+7:2353:x1875689351488768:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:2.0:1788797067.161598:0:10829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb04945d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e6d050bb-169e-4784-be5b-7071799bf3b0+7:2353:x1875689351488768:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 76us (453us total) trans 0 rc 0/0 00000100:00080000:3.0:1788797067.161615:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788797067.161620:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788797067.161789:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351488512 00000100:00100000:1.0:1788797067.161794:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351488512 00000100:00100000:1.0:1788797067.162153:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 300 00000100:00100000:1.0:1788797067.162171:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb060704850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4d9d1a9-601d-459e-8721-8bfc2fdde84f+13:2353:x1875689351488512:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:1.0:1788797067.162203:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb060704850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4d9d1a9-601d-459e-8721-8bfc2fdde84f+13:2353:x1875689351488512:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 36us (1091us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797067.162210:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 300 00000100:00100000:0.0:1788797067.168568:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 66 00000100:00100000:0.0:1788797067.168611:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb048e28380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e6d050bb-169e-4784-be5b-7071799bf3b0+6:2353:x1875689351488640:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:0.0:1788797067.168740:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb048e28380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e6d050bb-169e-4784-be5b-7071799bf3b0+6:2353:x1875689351488640:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 154us (7565us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797067.168750:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 66 00000100:00080000:0.0:1788797067.168869:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788797067.168939:0:7636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 162 00000100:00100000:0.0:1788797067.168947:0:7636:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb048e2bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed124ec0-b908-4000-b768-8e53d5def0fc+5:2353:x1875689351488896:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:0.0:1788797067.168989:0:7636:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb048e2bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed124ec0-b908-4000-b768-8e53d5def0fc+5:2353:x1875689351488896:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 43us (7791us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797067.168996:0:7636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 162 00000100:00100000:0.0:1788797067.169014:0:7636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 162 00000100:00100000:0.0:1788797067.169022:0:7636:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb04945c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6d050bb-169e-4784-be5b-7071799bf3b0+51:11498:x1875689351488384:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1788797067.169064:0:7636:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788797067.169093:0:7636:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2400/0xca7fc0c411f94054 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c99e04559ee1265 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788797067.169240:0:7636:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:0.0:1788797067.169396:0:7636:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2400/0xca7fc0c411f94054 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1265 expref: 53 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797067.169412:0:7636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cb058766400) 00010000:00010000:0.0:1788797067.169415:0:7636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788797067.169420:0:7636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2400/0xca7fc0c411f94054 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1265 expref: 53 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797067.169437:0:7636:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb042ea2400, rc 0) 00000100:00100000:0.0:1788797067.169464:0:7636:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb04945c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6d050bb-169e-4784-be5b-7071799bf3b0+52:11498:x1875689351488384:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 444us (8440us total) trans 4294967451 rc 301/301 00000100:00100000:0.0:1788797067.169470:0:7636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 162 00000100:00100000:2.0:1788797067.173342:0:10829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 65 00000100:00100000:2.0:1788797067.174394:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1788797067.174442:0:7636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351489024 00000100:00100000:0.0:1788797067.174452:0:7636:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351489024 00000100:00100000:0.0:1788797067.174501:0:7636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 163 00000100:00100000:0.0:1788797067.174531:0:7636:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb079175180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6d050bb-169e-4784-be5b-7071799bf3b0+52:11498:x1875689351489024:12345-192.168.204.38@tcp:34:lfs.0 00010000:00010000:0.0:1788797067.174611:0:7636:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2800/0xca7fc0c411f94062 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797067.174629:0:7636:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2800/0xca7fc0c411f94062 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797067.174653:0:7636:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2800/0xca7fc0c411f94062 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797067.174670:0:7636:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2600/0xca7fc0c411f94069 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797067.174691:0:7636:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2600/0xca7fc0c411f94069 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797067.174699:0:7636:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2600/0xca7fc0c411f94069 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797067.174795:0:7636:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2c00/0xca7fc0c411f94070 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797067.174803:0:7636:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2c00/0xca7fc0c411f94070 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797067.174810:0:7636:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2c00/0xca7fc0c411f94070 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788797067.174869:0:7636:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2c00/0xca7fc0c411f94070 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797067.174883:0:7636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2800/0xca7fc0c411f94062 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797067.174889:0:7636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2800/0xca7fc0c411f94062 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797067.174896:0:7636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2800/0xca7fc0c411f94062 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797067.174902:0:7636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb042ea2800 already unused, calling callback (ffffffffc1f014f0) 00010000:00010000:0.0:1788797067.174907:0:7636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2800/0xca7fc0c411f94062 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797067.174915:0:7636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2800/0xca7fc0c411f94062 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797067.174934:0:7636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8cb058766500) 00010000:00010000:0.0:1788797067.174937:0:7636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788797067.174942:0:7636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2800/0xca7fc0c411f94062 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797067.174949:0:7636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2800/0xca7fc0c411f94062 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797067.174962:0:7636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2600/0xca7fc0c411f94069 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797067.174969:0:7636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2600/0xca7fc0c411f94069 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797067.174974:0:7636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2600/0xca7fc0c411f94069 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797067.174978:0:7636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb042ea2600 already unused, calling callback (ffffffffc1f014f0) 00010000:00010000:0.0:1788797067.174981:0:7636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2600/0xca7fc0c411f94069 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797067.174987:0:7636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2600/0xca7fc0c411f94069 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797067.174994:0:7636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8cb058766b00) 00010000:00010000:0.0:1788797067.174996:0:7636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788797067.174998:0:7636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2600/0xca7fc0c411f94069 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797067.175003:0:7636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2600/0xca7fc0c411f94069 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797067.175052:0:7636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2c00/0xca7fc0c411f94070 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797067.175059:0:7636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2c00/0xca7fc0c411f94070 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797067.175065:0:7636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2c00/0xca7fc0c411f94070 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797067.175070:0:7636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb042ea2c00 already unused, calling callback (ffffffffc1f014f0) 00010000:00010000:0.0:1788797067.175073:0:7636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2c00/0xca7fc0c411f94070 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797067.175079:0:7636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2c00/0xca7fc0c411f94070 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797067.175087:0:7636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cb06ce84b00) 00010000:00010000:0.0:1788797067.175090:0:7636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788797067.175093:0:7636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2c00/0xca7fc0c411f94070 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797067.175099:0:7636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2c00/0xca7fc0c411f94070 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788797067.175177:0:7636:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb079175180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6d050bb-169e-4784-be5b-7071799bf3b0+52:11498:x1875689351489024:12345-192.168.204.38@tcp:34:lfs.0 Request processed in 666us (787us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797067.175184:0:7636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 163 00000100:00100000:3.0:1788797067.182798:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1788797067.183112:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351489280 00000100:00100000:1.0:1788797067.183131:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351489280 00000100:00100000:1.0:1788797067.183183:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 46 00000100:00100000:1.0:1788797067.183193:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb048e2b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e6d050bb-169e-4784-be5b-7071799bf3b0+52:11498:x1875689351489280:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:1.0:1788797067.183439:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb048e2b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e6d050bb-169e-4784-be5b-7071799bf3b0+53:11498:x1875689351489280:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 247us (664us total) trans 4294967452 rc 0/0 00000100:00100000:1.0:1788797067.183448:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 46 00000100:00100000:3.0:1788797067.257172:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1788797067.259208:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351489536 00000100:00100000:0.0:1788797067.259348:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351489536 00000100:00100000:0.0:1788797067.259547:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 164 00000100:00100000:0.0:1788797067.259591:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb048e29f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6d050bb-169e-4784-be5b-7071799bf3b0+53:11501:x1875689351489536:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1788797067.259628:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788797067.259654:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2c00/0xca7fc0c411f94077 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c99e04559ee126c expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797067.259740:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2600/0xca7fc0c411f9407e lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797067.259756:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2600/0xca7fc0c411f9407e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797067.259769:0:5826:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2600/0xca7fc0c411f9407e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797067.259788:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2800/0xca7fc0c411f94085 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797067.259795:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2800/0xca7fc0c411f94085 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797067.259802:0:5826:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2800/0xca7fc0c411f94085 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797067.262016:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2400/0xca7fc0c411f9408c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797067.262065:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2400/0xca7fc0c411f9408c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797067.262077:0:5826:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2400/0xca7fc0c411f9408c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788797067.262112:0:5826:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:0.0:1788797067.262222:0:5826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2600/0xca7fc0c411f9407e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797067.262661:0:5826:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2600/0xca7fc0c411f9407e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797067.262670:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2600/0xca7fc0c411f9407e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797067.262676:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb042ea2600 already unused, calling callback (ffffffffc1f014f0) 00010000:00010000:0.0:1788797067.262681:0:5826:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2600/0xca7fc0c411f9407e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797067.262689:0:5826:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2600/0xca7fc0c411f9407e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797067.262703:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8cb058766500) 00010000:00010000:0.0:1788797067.262707:0:5826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788797067.262714:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2600/0xca7fc0c411f9407e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797067.262722:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2600/0xca7fc0c411f9407e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797067.262741:0:5826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2800/0xca7fc0c411f94085 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797067.262748:0:5826:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2800/0xca7fc0c411f94085 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797067.262768:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2800/0xca7fc0c411f94085 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797067.262773:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb042ea2800 already unused, calling callback (ffffffffc1f014f0) 00010000:00010000:0.0:1788797067.262776:0:5826:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2800/0xca7fc0c411f94085 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797067.262782:0:5826:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2800/0xca7fc0c411f94085 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797067.262790:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8cb058766b00) 00010000:00010000:0.0:1788797067.262792:0:5826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788797067.262795:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2800/0xca7fc0c411f94085 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797067.262800:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2800/0xca7fc0c411f94085 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797067.263088:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2c00/0xca7fc0c411f94077 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee126c expref: 56 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797067.263107:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2400/0xca7fc0c411f9408c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee126c expref: 55 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797067.263127:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cb06ce84b00) 00010000:00010000:0.0:1788797067.263129:0:5826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788797067.263132:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb042ea2400, rc 0) 00000100:00100000:0.0:1788797067.263492:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb048e29f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6d050bb-169e-4784-be5b-7071799bf3b0+55:11501:x1875689351489536:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 3650us (6065us total) trans 4294967453 rc 0/0 00000100:00100000:0.0:1788797067.263525:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 164 00000100:00100000:2.0:1788797067.273568:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1788797067.273684:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1788797067.274106:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351489792 00000100:00100000:3.0:1788797067.274133:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351489792 00000100:00100000:3.0:1788797067.274220:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 13 00000100:00100000:3.0:1788797067.274234:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb06ec6e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e6d050bb-169e-4784-be5b-7071799bf3b0+55:2352:x1875689351489792:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788797067.274275:0:5813:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788797067.274309:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2400/0xca7fc0c411f9408c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee126c expref: 55 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797067.274334:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cb06ce84b00) 00010000:00010000:3.0:1788797067.274340:0:5813:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788797067.274420:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb06ec6e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e6d050bb-169e-4784-be5b-7071799bf3b0+54:2352:x1875689351489792:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 189us (735us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797067.274428:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 13 00000100:00100000:0.0:1788797067.275172:0:7636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351489664 00000100:00100000:0.0:1788797067.275183:0:7636:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351489664 00000100:00100000:0.0:1788797067.275223:0:7636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 165 00000100:00100000:0.0:1788797067.275231:0:7636:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb079174000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6d050bb-169e-4784-be5b-7071799bf3b0+54:11501:x1875689351489664:12345-192.168.204.38@tcp:54:lfs.0 00010000:00010000:0.0:1788797067.275287:0:7636:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2c00/0xca7fc0c411f9409a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797067.275303:0:7636:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2c00/0xca7fc0c411f9409a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797067.275315:0:7636:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2c00/0xca7fc0c411f9409a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797067.275343:0:7636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2c00/0xca7fc0c411f9409a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797067.275351:0:7636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2c00/0xca7fc0c411f9409a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797067.275358:0:7636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2c00/0xca7fc0c411f9409a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797067.275364:0:7636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb042ea2c00 already unused, calling callback (ffffffffc1f014f0) 00010000:00010000:0.0:1788797067.275369:0:7636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2c00/0xca7fc0c411f9409a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797067.275377:0:7636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2c00/0xca7fc0c411f9409a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797067.275386:0:7636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cb06ce84b00) 00010000:00010000:0.0:1788797067.275400:0:7636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788797067.275405:0:7636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2c00/0xca7fc0c411f9409a lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797067.275411:0:7636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2c00/0xca7fc0c411f9409a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788797067.275468:0:7636:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb079174000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6d050bb-169e-4784-be5b-7071799bf3b0+54:11501:x1875689351489664:12345-192.168.204.38@tcp:54:lfs.0 Request processed in 238us (1913us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797067.275475:0:7636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 165 00000100:00100000:2.0:1788797067.283840:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1788797067.284064:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351490048 00000100:00100000:1.0:1788797067.284075:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351490048 00000100:00100000:1.0:1788797067.284144:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 47 00000100:00100000:1.0:1788797067.284158:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb04940a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e6d050bb-169e-4784-be5b-7071799bf3b0+54:11501:x1875689351490048:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:1.0:1788797067.284438:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb04940a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e6d050bb-169e-4784-be5b-7071799bf3b0+55:11501:x1875689351490048:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 283us (626us total) trans 4294967454 rc 0/0 00000100:00100000:1.0:1788797067.284445:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 47 00000100:00100000:3.0:1788797067.464960:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1788797067.465136:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351490304 00000100:00100000:2.0:1788797067.465147:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351490304 00000100:00100000:2.0:1788797067.465266:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 166 00000100:00100000:2.0:1788797067.465277:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb048e29c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6d050bb-169e-4784-be5b-7071799bf3b0+55:11519:x1875689351490304:12345-192.168.204.38@tcp:101:cat.0 00010000:00010000:2.0:1788797067.465303:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788797067.465328:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040030800/0xca7fc0c411f940a1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c99e04559ee1273 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797067.465434:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040031400/0xca7fc0c411f940a8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797067.465452:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040031400/0xca7fc0c411f940a8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797067.465535:0:5827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040031400/0xca7fc0c411f940a8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788797067.465549:0:5827:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:2.0:1788797067.465682:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040030800/0xca7fc0c411f940a1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1273 expref: 58 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797067.465704:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040031400/0xca7fc0c411f940a8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1273 expref: 57 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797067.465732:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cb06ce84b00) 00010000:00010000:2.0:1788797067.465735:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1788797067.465739:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb040031400, rc 0) 00000100:00100000:2.0:1788797067.465802:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb048e29c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6d050bb-169e-4784-be5b-7071799bf3b0+57:11519:x1875689351490304:12345-192.168.204.38@tcp:101:cat.0 Request processed in 526us (854us total) trans 4294967455 rc 0/0 00000100:00100000:2.0:1788797067.465809:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 166 00000100:00100000:2.0:1788797067.550522:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1788797067.550625:0:7636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351490432 00000100:00100000:0.0:1788797067.550653:0:7636:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351490432 00000100:00100000:0.0:1788797067.550724:0:7636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 167 00000100:00100000:0.0:1788797067.550736:0:7636:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb049409880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6d050bb-169e-4784-be5b-7071799bf3b0+57:11520:x1875689351490432:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1788797067.550762:0:7636:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788797067.550787:0:7636:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2c00/0xca7fc0c411f940b6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c99e04559ee127a expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797067.551092:0:7636:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2800/0xca7fc0c411f940bd lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797067.551108:0:7636:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2800/0xca7fc0c411f940bd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797067.551119:0:7636:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2800/0xca7fc0c411f940bd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788797067.551156:0:7636:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:0.0:1788797067.551159:0:7636:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788797067.551177:0:7636:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2800/0xca7fc0c411f940bd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797067.551220:0:7636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2c00/0xca7fc0c411f940b6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee127a expref: 59 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797067.551239:0:7636:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2800/0xca7fc0c411f940bd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee127a expref: 58 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797067.551247:0:7636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8cb058766500) 00010000:00010000:0.0:1788797067.551250:0:7636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788797067.551255:0:7636:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb042ea2800, rc 0) 00000100:00100000:0.0:1788797067.551321:0:7636:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb049409880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6d050bb-169e-4784-be5b-7071799bf3b0+58:11520:x1875689351490432:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 588us (818us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797067.551329:0:7636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 167 00000100:00100000:1.0:1788797067.572575:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1788797067.572713:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351490816 00000100:00100000:0.0:1788797067.572727:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351490816 00000100:00100000:0.0:1788797067.572794:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 48 00000100:00100000:0.0:1788797067.572804:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb077e30a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e6d050bb-169e-4784-be5b-7071799bf3b0+58:11520:x1875689351490816:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:0.0:1788797067.573568:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb077e30a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e6d050bb-169e-4784-be5b-7071799bf3b0+59:11520:x1875689351490816:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 695us (936us total) trans 4294967456 rc 0/0 00000100:00100000:0.0:1788797067.573579:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 48 00000100:00100000:3.0:1788797067.580255:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1788797067.580431:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351490944 00000100:00100000:1.0:1788797067.580446:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351490944 00000100:00100000:1.0:1788797067.580541:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 14 00000100:00100000:1.0:1788797067.580554:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb048e29180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e6d050bb-169e-4784-be5b-7071799bf3b0+59:11520:x1875689351490944:12345-192.168.204.38@tcp:103:lfs.0 00010000:00010000:1.0:1788797067.580576:0:5811:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1788797067.580609:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082044600/0xca7fc0c411f9404d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee125e expref: 59 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797067.580679:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040031400/0xca7fc0c411f940a8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1273 expref: 58 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797067.580694:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045e00/0xca7fc0c411f93f58 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee121f expref: 57 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797067.580708:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cb06ce84b00) 00010000:00010000:1.0:1788797067.580723:0:5811:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788797067.581104:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb048e29180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e6d050bb-169e-4784-be5b-7071799bf3b0+56:11520:x1875689351490944:12345-192.168.204.38@tcp:103:lfs.0 Request processed in 550us (861us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797067.581113:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 14 00000100:00100000:2.0:1788797067.588858:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1788797067.589873:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351491072 00000100:00100000:0.0:1788797067.589885:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351491072 00000100:00100000:0.0:1788797067.589965:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 168 00000100:00100000:0.0:1788797067.589977:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb04940b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6d050bb-169e-4784-be5b-7071799bf3b0+56:11520:x1875689351491072:12345-192.168.204.38@tcp:58:lfs.0 00010000:00010000:0.0:1788797067.590134:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2c00/0xca7fc0c411f940c4 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797067.590172:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2c00/0xca7fc0c411f940c4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797067.590185:0:5826:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2c00/0xca7fc0c411f940c4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788797067.590410:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:0.0:1788797067.590697:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb04940b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6d050bb-169e-4784-be5b-7071799bf3b0+56:11520:x1875689351491072:12345-192.168.204.38@tcp:58:lfs.0 Request processed in 721us (1850us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797067.590707:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 168 00000100:00100000:2.0:1788797067.661318:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1788797067.661402:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351491200 00000100:00100000:1.0:1788797067.661412:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351491200 00000100:00100000:1.0:1788797067.661475:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 169 00000100:00100000:1.0:1788797067.661485:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb049408000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6d050bb-169e-4784-be5b-7071799bf3b0+56:11522:x1875689351491200:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1788797067.661517:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788797067.661541:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045e00/0xca7fc0c411f940cb lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c99e04559ee1281 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797067.661645:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082044600/0xca7fc0c411f940d2 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797067.661663:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082044600/0xca7fc0c411f940d2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797067.661674:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082044600/0xca7fc0c411f940d2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797067.661710:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045c00/0xca7fc0c411f940d9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797067.661717:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045c00/0xca7fc0c411f940d9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797067.661724:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045c00/0xca7fc0c411f940d9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797067.661826:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045600/0xca7fc0c411f940e0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797067.661835:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045600/0xca7fc0c411f940e0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797067.661843:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045600/0xca7fc0c411f940e0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788797067.661888:0:5825:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:1.0:1788797067.661893:0:5825:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788797067.661913:0:5825:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045600/0xca7fc0c411f940e0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797067.661926:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045600/0xca7fc0c411f940e0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797067.661934:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082044600/0xca7fc0c411f940d2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797067.661941:0:5825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082044600/0xca7fc0c411f940d2 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797067.661958:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082044600/0xca7fc0c411f940d2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797067.661965:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb082044600 already unused, calling callback (ffffffffc1f014f0) 00010000:00010000:1.0:1788797067.661970:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082044600/0xca7fc0c411f940d2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797067.661978:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082044600/0xca7fc0c411f940d2 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797067.661992:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8cb058766500) 00010000:00010000:1.0:1788797067.661995:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788797067.662000:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082044600/0xca7fc0c411f940d2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797067.662007:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082044600/0xca7fc0c411f940d2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797067.662021:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045c00/0xca7fc0c411f940d9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797067.662085:0:5825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045c00/0xca7fc0c411f940d9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797067.662092:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045c00/0xca7fc0c411f940d9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797067.662098:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb082045c00 already unused, calling callback (ffffffffc1f014f0) 00010000:00010000:1.0:1788797067.662101:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045c00/0xca7fc0c411f940d9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797067.662118:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045c00/0xca7fc0c411f940d9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797067.662127:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8cb06ce84b00) 00010000:00010000:1.0:1788797067.662129:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788797067.662133:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045c00/0xca7fc0c411f940d9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797067.662139:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045c00/0xca7fc0c411f940d9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797067.662176:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045e00/0xca7fc0c411f940cb lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1281 expref: 58 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797067.662191:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045600/0xca7fc0c411f940e0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1281 expref: 57 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797067.662198:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cb058766b00) 00010000:00010000:1.0:1788797067.662200:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788797067.662203:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb082045600, rc 0) 00000100:00100000:1.0:1788797067.662290:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb049408000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6d050bb-169e-4784-be5b-7071799bf3b0+57:11522:x1875689351491200:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 806us (982us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797067.662299:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 169 00000040:00080000:1.0:1788797068.088862:0:11679:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788797068.088878:0:11679:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788797068.088938:0:11679:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:1.0:1788797068.088949:0:11679:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788797068.089167:0:11679:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb077e32a00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11679:1875689374556416:192.168.204.38@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788797068.089298:0:11679:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb04887ee40 going to sleep for 11 seconds 00010000:00010000:2.0:1788797068.090617:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788797068.091864:0:11679:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb077e32a00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11679:1875689374556416:192.168.204.38@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788797068.097264:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1788797068.097353:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351491328 00000100:00100000:2.0:1788797068.097364:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351491328 00000100:00100000:2.0:1788797068.097440:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 170 00000100:00100000:2.0:1788797068.097451:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb077e32a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6d050bb-169e-4784-be5b-7071799bf3b0+57:11533:x1875689351491328:12345-192.168.204.38@tcp:53:lhsmtool_posix.0 00000100:00080000:1.0:1788797068.097483:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00000080:2.0:1788797068.097485:0:5826:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788797068.097616:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb077e32a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6d050bb-169e-4784-be5b-7071799bf3b0+57:11533:x1875689351491328:12345-192.168.204.38@tcp:53:lhsmtool_posix.0 Request processed in 165us (366us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797068.097623:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 170 00000100:00100000:2.0:1788797068.110320:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1788797068.110742:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351491456 00000100:00100000:3.0:1788797068.110752:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351491456 00000100:00100000:3.0:1788797068.110814:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 171 00000100:00100000:3.0:1788797068.110823:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb04940b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6d050bb-169e-4784-be5b-7071799bf3b0+57:11533:x1875689351491456:12345-192.168.204.38@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1788797068.110895:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69400/0xca7fc0c411f940e7 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797068.110912:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69400/0xca7fc0c411f940e7 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797068.110932:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69400/0xca7fc0c411f940e7 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797068.110948:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69800/0xca7fc0c411f940ee lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797068.110955:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69800/0xca7fc0c411f940ee lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797068.110973:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69800/0xca7fc0c411f940ee lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797068.111002:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c68800/0xca7fc0c411f940f5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797068.111010:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c68800/0xca7fc0c411f940f5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797068.111017:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c68800/0xca7fc0c411f940f5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788797068.111078:0:5825:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:3.0:1788797068.111084:0:5825:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788797068.111101:0:5825:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c68800/0xca7fc0c411f940f5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797068.111114:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69400/0xca7fc0c411f940e7 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797068.111120:0:5825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69400/0xca7fc0c411f940e7 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797068.111127:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69400/0xca7fc0c411f940e7 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797068.111132:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb077c69400 already unused, calling callback (ffffffffc1f014f0) 00010000:00010000:3.0:1788797068.111137:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69400/0xca7fc0c411f940e7 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797068.111145:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69400/0xca7fc0c411f940e7 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797068.111165:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8cb05088a400) 00010000:00010000:3.0:1788797068.111168:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788797068.111174:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69400/0xca7fc0c411f940e7 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797068.111181:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69400/0xca7fc0c411f940e7 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797068.111192:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69800/0xca7fc0c411f940ee lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797068.111199:0:5825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69800/0xca7fc0c411f940ee lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797068.111205:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69800/0xca7fc0c411f940ee lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797068.111210:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb077c69800 already unused, calling callback (ffffffffc1f014f0) 00010000:00010000:3.0:1788797068.111212:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69800/0xca7fc0c411f940ee lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797068.111218:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69800/0xca7fc0c411f940ee lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797068.111224:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x19697575 (ffff8cb065cc2400) 00010000:00010000:3.0:1788797068.111226:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788797068.111229:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69800/0xca7fc0c411f940ee lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797068.111233:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69800/0xca7fc0c411f940ee lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797068.111261:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c68800/0xca7fc0c411f940f5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797068.111268:0:5825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c68800/0xca7fc0c411f940f5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797068.111274:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c68800/0xca7fc0c411f940f5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797068.111278:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb077c68800 already unused, calling callback (ffffffffc1f014f0) 00010000:00010000:3.0:1788797068.111281:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c68800/0xca7fc0c411f940f5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797068.111287:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c68800/0xca7fc0c411f940f5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797068.111294:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cb058766b00) 00010000:00010000:3.0:1788797068.111297:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788797068.111300:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c68800/0xca7fc0c411f940f5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797068.111305:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c68800/0xca7fc0c411f940f5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788797068.111388:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb04940b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6d050bb-169e-4784-be5b-7071799bf3b0+57:11533:x1875689351491456:12345-192.168.204.38@tcp:34:lhsmtool_posix.0 Request processed in 565us (1078us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797068.111397:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 171 00000100:00100000:2.0:1788797068.129694:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1788797068.129734:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351491712 00000100:00100000:2.0:1788797068.129745:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351491712 00000100:00100000:2.0:1788797068.129804:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 172 00000100:00100000:2.0:1788797068.129816:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb049408a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6d050bb-169e-4784-be5b-7071799bf3b0+57:11533:x1875689351491712:12345-192.168.204.38@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788797068.129839:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788797068.129873:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040031a00/0xca7fc0c411f940fc lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c99e04559ee1288 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797068.129995:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040031400/0xca7fc0c411f94103 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797068.130014:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040031400/0xca7fc0c411f94103 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797068.130044:0:5826:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040031400/0xca7fc0c411f94103 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788797068.130058:0:5826:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:2.0:1788797068.130173:0:5826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040031400/0xca7fc0c411f94103 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797068.130181:0:5826:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040031400/0xca7fc0c411f94103 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797068.130188:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040031400/0xca7fc0c411f94103 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797068.130195:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb040031400 already unused, calling callback (ffffffffc1f014f0) 00010000:00010000:2.0:1788797068.130199:0:5826:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040031400/0xca7fc0c411f94103 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797068.130207:0:5826:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040031400/0xca7fc0c411f94103 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797068.130219:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cb058766b00) 00010000:00010000:2.0:1788797068.130221:0:5826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788797068.130226:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040031400/0xca7fc0c411f94103 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797068.130243:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040031400/0xca7fc0c411f94103 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797068.130287:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040031a00/0xca7fc0c411f940fc lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1288 expref: 59 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797068.130296:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8cb05088a400) 00010000:00010000:2.0:1788797068.130298:0:5826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788797068.130301:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040031a00/0xca7fc0c411f940fc lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1288 expref: 59 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797068.130311:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb040031a00, rc 0) 00000100:00100000:2.0:1788797068.130376:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb049408a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6d050bb-169e-4784-be5b-7071799bf3b0+58:11533:x1875689351491712:12345-192.168.204.38@tcp:101:lhsmtool_posix.0 Request processed in 562us (693us total) trans 4294967457 rc 301/301 00000100:00100000:2.0:1788797068.130383:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 172 00000100:00100000:2.0:1788797068.136155:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1788797068.136247:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351491840 00000100:00100000:3.0:1788797068.136259:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351491840 00000100:00100000:3.0:1788797068.136321:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 173 00000100:00100000:3.0:1788797068.136349:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0498ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6d050bb-169e-4784-be5b-7071799bf3b0+58:11533:x1875689351491840:12345-192.168.204.38@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788797068.136411:0:5825:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788797068.136554:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0498ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6d050bb-169e-4784-be5b-7071799bf3b0+58:11533:x1875689351491840:12345-192.168.204.38@tcp:53:lhsmtool_posix.0 Request processed in 207us (411us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797068.136562:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 173 00000100:00100000:2.0:1788797068.151895:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1788797068.152123:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351492096 00000100:00100000:0.0:1788797068.152135:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351492096 00000100:00100000:0.0:1788797068.152195:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 174 00000100:00100000:0.0:1788797068.152207:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0498ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6d050bb-169e-4784-be5b-7071799bf3b0+58:11533:x1875689351492096:12345-192.168.204.38@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788797068.152231:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788797068.152234:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1788797068.152268:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2800/0xca7fc0c411f940bd lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee127a expref: 58 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797068.152289:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8cb058766500) 00010000:00010000:0.0:1788797068.152294:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788797068.152308:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3400/0xca7fc0c411f94111 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c99e04559ee128f expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788797068.152794:0:5826:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5:0x0], index 0: 0 00010000:00010000:0.0:1788797068.155409:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3a00/0xca7fc0c411f94118 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797068.155461:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3a00/0xca7fc0c411f94118 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797068.155478:0:5826:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3a00/0xca7fc0c411f94118 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797068.155585:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3400/0xca7fc0c411f94111 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee128f expref: 60 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797068.155618:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3a00/0xca7fc0c411f94118 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee128f expref: 59 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797068.155631:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8cb058766000) 00010000:00010000:0.0:1788797068.155635:0:5826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788797068.155639:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb042ea3a00, rc 0) 00000100:00100000:0.0:1788797068.155751:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0498ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6d050bb-169e-4784-be5b-7071799bf3b0+59:11533:x1875689351492096:12345-192.168.204.38@tcp:101:lhsmtool_posix.0 Request processed in 3544us (3864us total) trans 4294967458 rc 0/0 00000100:00100000:0.0:1788797068.155762:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 174 00000100:00100000:2.0:1788797068.182857:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1788797068.189956:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351492352 00000100:00100000:1.0:1788797068.189973:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351492352 00000100:00100000:1.0:1788797068.190067:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 175 00000100:00100000:1.0:1788797068.190078:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0498ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6d050bb-169e-4784-be5b-7071799bf3b0+59:11533:x1875689351492352:12345-192.168.204.38@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788797068.190136:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788797068.190162:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3a00/0xca7fc0c411f94118 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee128f expref: 59 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797068.190183:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8cb058766000) 00010000:00010000:1.0:1788797068.190195:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788797068.190219:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045e00/0xca7fc0c411f94126 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797068.190234:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045e00/0xca7fc0c411f94126 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797068.190245:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045e00/0xca7fc0c411f94126 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797068.190263:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045c00/0xca7fc0c411f9412d lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0xa47fb193 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797068.190270:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045c00/0xca7fc0c411f9412d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xa47fb193 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797068.190276:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045c00/0xca7fc0c411f9412d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xa47fb193 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797068.190364:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045e00/0xca7fc0c411f94126 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797068.190372:0:5825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045e00/0xca7fc0c411f94126 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797068.190378:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045e00/0xca7fc0c411f94126 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797068.190384:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb082045e00 already unused, calling callback (ffffffffc1f014f0) 00010000:00010000:1.0:1788797068.190388:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045e00/0xca7fc0c411f94126 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797068.190396:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045e00/0xca7fc0c411f94126 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797068.190404:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8cb058766500) 00010000:00010000:1.0:1788797068.190407:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788797068.190412:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045e00/0xca7fc0c411f94126 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797068.190417:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045e00/0xca7fc0c411f94126 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797068.190427:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045c00/0xca7fc0c411f9412d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xa47fb193 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797068.190433:0:5825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045c00/0xca7fc0c411f9412d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xa47fb193 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797068.190438:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045c00/0xca7fc0c411f9412d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xa47fb193 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797068.190450:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb082045c00 already unused, calling callback (ffffffffc1f014f0) 00010000:00010000:1.0:1788797068.190453:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045c00/0xca7fc0c411f9412d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xa47fb193 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797068.190459:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045c00/0xca7fc0c411f9412d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xa47fb193 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797068.190468:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0xa47fb193 (ffff8cb06ce84b00) 00010000:00010000:1.0:1788797068.190470:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788797068.190473:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045c00/0xca7fc0c411f9412d lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xa47fb193 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797068.190477:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045c00/0xca7fc0c411f9412d lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xa47fb193 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788797068.190582:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0498ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6d050bb-169e-4784-be5b-7071799bf3b0+58:11533:x1875689351492352:12345-192.168.204.38@tcp:36:lhsmtool_posix.0 Request processed in 505us (7734us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788797068.190589:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 175 00000100:00100000:1.0:1788797068.197668:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1788797068.197761:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351492480 00000100:00100000:2.0:1788797068.197775:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351492480 00000100:00100000:3.0:1788797068.197940:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 176 00000100:00100000:3.0:1788797068.197954:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb077e32300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6d050bb-169e-4784-be5b-7071799bf3b0+58:11533:x1875689351492480:12345-192.168.204.38@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788797068.197981:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788797068.198006:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69800/0xca7fc0c411f94134 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c99e04559ee1296 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797068.198077:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69400/0xca7fc0c411f9413b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797068.198092:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69400/0xca7fc0c411f9413b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797068.198114:0:5826:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69400/0xca7fc0c411f9413b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797068.198230:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69800/0xca7fc0c411f94134 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1296 expref: 60 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797068.198253:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69400/0xca7fc0c411f9413b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1296 expref: 59 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797068.198262:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8cb065cc2400) 00010000:00010000:3.0:1788797068.198272:0:5826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788797068.198277:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb077c69400, rc 0) 00000100:00100000:3.0:1788797068.198345:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb077e32300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6d050bb-169e-4784-be5b-7071799bf3b0+59:11533:x1875689351492480:12345-192.168.204.38@tcp:101:lhsmtool_posix.0 Request processed in 394us (690us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797068.198352:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 176 00000100:00100000:3.0:1788797068.203605:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1788797068.203859:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351492736 00000100:00100000:1.0:1788797068.203870:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351492736 00000100:00100000:3.0:1788797068.204068:0:7636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 177 00000100:00100000:3.0:1788797068.204081:0:7636:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb079bc3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6d050bb-169e-4784-be5b-7071799bf3b0+59:11533:x1875689351492736:12345-192.168.204.38@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788797068.204181:0:7636:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69200/0xca7fc0c411f94142 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797068.204199:0:7636:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69200/0xca7fc0c411f94142 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797068.204212:0:7636:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69200/0xca7fc0c411f94142 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788797068.204550:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].6, 88 off8648 00000004:00080000:3.0:1788797068.204562:0:7636:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 357210533404ns, next at 358210529885ns, rc = 0 00000004:00010000:3.0:1788797068.204658:0:7636:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003051ee01 reply state 00000000617de45c transno 4294967459 ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69200/0xca7fc0c411f94142 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788797068.204669:0:7636:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788797068.204794:0:7636:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb079bc3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6d050bb-169e-4784-be5b-7071799bf3b0+61:11533:x1875689351492736:12345-192.168.204.38@tcp:36:lhsmtool_posix.0 Request processed in 715us (1200us total) trans 4294967459 rc 0/0 00000100:00100000:3.0:1788797068.204802:0:7636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 177 00000100:00100000:1.0:1788797068.210592:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00010000:00010000:3.0:1788797068.212069:0:3286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69200/0xca7fc0c411f94142 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797068.212185:0:3286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69200/0xca7fc0c411f94142 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797068.212194:0:3286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69200/0xca7fc0c411f94142 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797068.212200:0:3286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb077c69200 already unused, calling callback (ffffffffc1f014f0) 00010000:00010000:3.0:1788797068.212206:0:3286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69200/0xca7fc0c411f94142 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797068.212217:0:3286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69200/0xca7fc0c411f94142 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797068.212238:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8cb065cc2400) 00010000:00010000:3.0:1788797068.212241:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788797068.212246:0:3286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69200/0xca7fc0c411f94142 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797068.212252:0:3286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69200/0xca7fc0c411f94142 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788797068.212296:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351492864 00000100:00100000:3.0:1788797068.212308:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351492864 00000100:00100000:3.0:1788797068.212369:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 178 00000100:00100000:3.0:1788797068.212380:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb077e31880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6d050bb-169e-4784-be5b-7071799bf3b0+60:11533:x1875689351492864:12345-192.168.204.38@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788797068.212404:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788797068.212421:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c68200/0xca7fc0c411f94149 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c99e04559ee129d expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797068.212484:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c68200/0xca7fc0c411f94149 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee129d expref: 61 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797068.212517:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c68200/0xca7fc0c411f94149 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee129d expref: 61 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797068.212537:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8cb065cc2400) 00010000:00010000:3.0:1788797068.212541:0:5826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788797068.212543:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb077c68200, rc 0) 00000100:00100000:3.0:1788797068.212618:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb077e31880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6d050bb-169e-4784-be5b-7071799bf3b0+61:11533:x1875689351492864:12345-192.168.204.38@tcp:101:lhsmtool_posix.0 Request processed in 240us (2044us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797068.212627:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 178 00000100:00100000:3.0:1788797068.220397:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1788797068.220537:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351492992 00000100:00100000:1.0:1788797068.220549:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351492992 00000100:00100000:1.0:1788797068.220614:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 51 00000100:00100000:1.0:1788797068.220625:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb079bc0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e6d050bb-169e-4784-be5b-7071799bf3b0+6:2355:x1875689351492992:12345-192.168.204.38@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1788797068.221082:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb079bc0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e6d050bb-169e-4784-be5b-7071799bf3b0+7:2355:x1875689351492992:12345-192.168.204.38@tcp:2:lhsmtool_posix.0 Request processed in 457us (694us total) trans 4294967313 rc 0/0 00000100:00100000:1.0:1788797068.221122:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 51 00000100:00100000:1.0:1788797068.227559:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1788797068.227656:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351493248 00000100:00100000:0.0:1788797068.227667:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351493248 00000100:00100000:0.0:1788797068.227723:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 49 00000100:00100000:0.0:1788797068.227734:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0774e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e6d050bb-169e-4784-be5b-7071799bf3b0+61:11533:x1875689351493248:12345-192.168.204.38@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788797068.227999:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0774e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e6d050bb-169e-4784-be5b-7071799bf3b0+62:11533:x1875689351493248:12345-192.168.204.38@tcp:35:lhsmtool_posix.0 Request processed in 266us (449us total) trans 4294967460 rc 0/0 00000100:00100000:0.0:1788797068.228006:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 49 00000100:00100000:1.0:1788797068.230297:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1788797068.230972:0:7636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351493504 00000100:00100000:3.0:1788797068.230988:0:7636:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351493504 00000100:00100000:3.0:1788797068.231091:0:7636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 179 00000100:00100000:3.0:1788797068.231381:0:7636:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0774e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6d050bb-169e-4784-be5b-7071799bf3b0+62:11533:x1875689351493504:12345-192.168.204.38@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788797068.232516:0:7636:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0774e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6d050bb-169e-4784-be5b-7071799bf3b0+62:11533:x1875689351493504:12345-192.168.204.38@tcp:57:lhsmtool_posix.0 Request processed in 1134us (2222us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797068.232530:0:7636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 179 00000100:00100000:2.0:1788797068.245642:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1788797068.245732:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351493632 00000100:00100000:0.0:1788797068.245759:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351493632 00000100:00100000:0.0:1788797068.245838:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 180 00000100:00100000:0.0:1788797068.245849:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb077978380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6d050bb-169e-4784-be5b-7071799bf3b0+62:11533:x1875689351493632:12345-192.168.204.38@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788797068.245876:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788797068.245896:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3600/0xca7fc0c411f94150 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c99e04559ee12a4 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797068.254185:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045c00/0xca7fc0c411f94157 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797068.254210:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045c00/0xca7fc0c411f94157 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797068.254223:0:5826:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045c00/0xca7fc0c411f94157 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788797068.254271:0:5826:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788797068.254298:0:5826:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045c00/0xca7fc0c411f94157 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797068.254341:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3600/0xca7fc0c411f94150 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee12a4 expref: 64 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797068.254367:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045c00/0xca7fc0c411f94157 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee12a4 expref: 63 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797068.254377:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8cb065cc2400) 00010000:00010000:1.0:1788797068.254380:0:5826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1788797068.254384:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb082045c00, rc 0) 00000100:00100000:1.0:1788797068.254453:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb077978380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6d050bb-169e-4784-be5b-7071799bf3b0+63:11533:x1875689351493632:12345-192.168.204.38@tcp:101:lhsmtool_posix.0 Request processed in 8605us (8820us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797068.254463:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 180 00000100:00100000:3.0:1788797068.259848:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1788797068.259931:0:10829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351493760 00000100:00100000:1.0:1788797068.259956:0:10829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351493760 00000100:00100000:1.0:1788797068.260018:0:10829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 52 00000100:00100000:1.0:1788797068.260051:0:10829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb079bc1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e6d050bb-169e-4784-be5b-7071799bf3b0+7:2354:x1875689351493760:12345-192.168.204.38@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788797068.260073:0:10829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788797068.260107:0:10829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e7cc11f5/0xca7fc0c411f9415e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7c99e04559ee12ab expref: -99 pid: 10829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788797068.260140:0:10829:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9ee08c, blocks: 0x1 00010000:00010000:1.0:1788797068.260164:0:10829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=357s v=(0 0) 00010000:00010000:1.0:1788797068.260169:0:10829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788797068.260179:0:10829:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e7cc11f5/0xca7fc0c411f9415e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee12ab expref: 8 pid: 10829 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797068.260201:0:10829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e7cc11f5/0xca7fc0c411f9415e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee12ab expref: 8 pid: 10829 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797068.260215:0:10829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb082045e00, rc 0) 00000100:00100000:1.0:1788797068.260287:0:10829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb079bc1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e6d050bb-169e-4784-be5b-7071799bf3b0+8:2354:x1875689351493760:12345-192.168.204.38@tcp:101:lhsmtool_posix.0 Request processed in 260us (447us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797068.260295:0:10829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 52 00000100:00100000:1.0:1788797068.267658:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1788797068.271605:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351494016 00000100:00100000:0.0:1788797068.271621:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351494016 00000100:00100000:2.0:1788797068.273272:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 181 00000100:00100000:2.0:1788797068.273299:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb06f57ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6d050bb-169e-4784-be5b-7071799bf3b0+63:11533:x1875689351494016:12345-192.168.204.38@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788797068.273470:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb06f57ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6d050bb-169e-4784-be5b-7071799bf3b0+63:11533:x1875689351494016:12345-192.168.204.38@tcp:57:lhsmtool_posix.0 Request processed in 184us (5823us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797068.273478:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 181 00000100:00100000:1.0:1788797068.277732:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1788797068.277815:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351494144 00000100:00100000:0.0:1788797068.277825:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351494144 00000100:00100000:0.0:1788797068.277917:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 53 00000100:00100000:0.0:1788797068.277937:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb079b90a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e6d050bb-169e-4784-be5b-7071799bf3b0+8:11533:x1875689351494144:12345-192.168.204.38@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788797068.277956:0:6684:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788797068.277974:0:6684:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000d37cb33/0xca7fc0c411f94165 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7c99e04559ee12b2 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797068.278006:0:6684:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e7cc11f5/0xca7fc0c411f9415e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee12ab expref: 9 pid: 10829 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797068.278015:0:6684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788797068.278019:0:6684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788797068.278023:0:6684:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000d37cb33/0xca7fc0c411f94165 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee12b2 expref: 9 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797068.278092:0:6684:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000e7cc11f5/0xca7fc0c411f9415e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee12ab expref: 9 pid: 10829 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797068.278137:0:6684:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000e7cc11f5/0xca7fc0c411f9415e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee12ab expref: 9 pid: 10829 timeout: 457 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788797068.278152:0:6684:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb080661c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6684:1875689374556544:192.168.204.38@tcp:104: 00000100:00100000:0.0:1788797068.278245:0:6684:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb04919a780 going to sleep for 11 seconds 00000100:00100000:0.0:1788797068.288926:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1788797068.289123:0:6684:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb080661c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6684:1875689374556544:192.168.204.38@tcp:104: 00010000:00010000:1.0:1788797068.289173:0:6684:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000000d37cb33/0xca7fc0c411f94165 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee12b2 expref: 9 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797068.289229:0:6684:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb042ea3200, rc 0) 00000100:00100000:1.0:1788797068.289309:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb079b90a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e6d050bb-169e-4784-be5b-7071799bf3b0+9:11533:x1875689351494144:12345-192.168.204.38@tcp:101:lhsmtool_posix.0 Request processed in 11374us (11588us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797068.289318:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 53 00000100:00100000:3.0:1788797068.289811:0:11663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351494272 00000100:00100000:3.0:1788797068.289827:0:11663:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351494272 00010000:00010000:3.0:1788797068.289876:0:11663:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000e7cc11f5/0xca7fc0c411f9415e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee12ab expref: 9 pid: 10829 timeout: 457 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788797068.289916:0:11663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 66 00000100:00100000:3.0:1788797068.289938:0:11663:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb080661f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e6d050bb-169e-4784-be5b-7071799bf3b0+9:2355:x1875689351494272:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788797068.289966:0:11663:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788797068.289997:0:11663:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000e7cc11f5/0xca7fc0c411f9415e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee12ab expref: 9 pid: 10829 timeout: 457 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797068.290013:0:11663:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000e7cc11f5/0xca7fc0c411f9415e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee12ab expref: 9 pid: 10829 timeout: 457 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797068.290356:0:11663:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e7cc11f5/0xca7fc0c411f9415e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee12ab expref: 9 pid: 10829 timeout: 457 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797068.290379:0:11663:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788797068.290384:0:11663:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788797068.290396:0:11663:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000d37cb33/0xca7fc0c411f94165 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee12b2 expref: 8 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797068.290408:0:11663:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000d37cb33/0xca7fc0c411f94165 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee12b2 expref: 8 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797068.290461:0:11663:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000000d37cb33/0xca7fc0c411f94165 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee12b2 expref: 8 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788797068.290479:0:11663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb079bc3480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11663:1875689374556672:192.168.204.38@tcp:105: 00000100:00100000:3.0:1788797068.290563:0:11663:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb0436049c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788797068.300945:0:11663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb079bc3480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11663:1875689374556672:192.168.204.38@tcp:105: 00010000:00010000:1.0:1788797068.300984:0:11663:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788797068.301259:0:11663:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb080661f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e6d050bb-169e-4784-be5b-7071799bf3b0+8:2355:x1875689351494272:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 11322us (12352us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797068.301276:0:11663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 66 00000100:00100000:1.0:1788797068.306809:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1788797068.306937:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351494400 00000100:00100000:2.0:1788797068.306947:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351494400 00002000:00100000:2.0:1788797068.306997:0:6689:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff8cb079b91500 x1875689351494400/t0(0) o4->e6d050bb-169e-4784-be5b-7071799bf3b0@192.168.204.38@tcp:494/0 lens 504/0 e 0 to 0 dl 1788797079 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788797068.307009:0:6689:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8cb079b91500 with x1875689351494400 ext(0->8) 00002000:00010000:2.0:1788797068.307014:0:6689:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8cb079b91500 00000100:00100000:2.0:1788797068.307084:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 4 00000100:00100000:2.0:1788797068.307171:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb079b91500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e6d050bb-169e-4784-be5b-7071799bf3b0+8:2355:x1875689351494400:12345-192.168.204.38@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1788797068.307640:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb079b91500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e6d050bb-169e-4784-be5b-7071799bf3b0+10:2355:x1875689351494400:12345-192.168.204.38@tcp:4:lhsmtool_posix.0 Request processed in 546us (848us total) trans 4294967314 rc 0/0 00000100:00100000:2.0:1788797068.307649:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 4 00002000:00100000:2.0:1788797068.307656:0:6689:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff8cb079b91500 x1875689351494400/t4294967314(0) o4->e6d050bb-169e-4784-be5b-7071799bf3b0@192.168.204.38@tcp:494/0 lens 504/448 e 0 to 0 dl 1788797079 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788797068.307664:0:6689:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8cb079b91500 with x1875689351494400 ext(0->8) 00002000:00010000:2.0:1788797068.307667:0:6689:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8cb079b91500 00000100:00100000:1.0:1788797068.322191:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1788797068.322365:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351494528 00000100:00100000:2.0:1788797068.322375:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351494528 00000100:00100000:2.0:1788797068.322433:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 182 00000100:00100000:2.0:1788797068.322444:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb047c19180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6d050bb-169e-4784-be5b-7071799bf3b0+63:11533:x1875689351494528:12345-192.168.204.38@tcp:44:lhsmtool_posix.0 00000100:00100000:0.0:1788797068.339977:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb079bc2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875689374556800:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788797068.340088:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788797068.342621:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374556800 00000100:00100000:1.0:1788797068.342637:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374556800 00000100:00100000:1.0:1788797068.342712:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788797068.342723:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb080662300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875689374556800:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788797068.342750:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788797068.342840:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb080662300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875689374556800:12345-0@lo:13:osp-pre-0-0.0 Request processed in 120us (2752us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797068.342848:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788797068.342907:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb079bc2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875689374556800:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788797068.354594:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:3.0:1788797068.474497:0:5848:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967460 is committed 00000020:00080000:3.0:1788797068.474534:0:5848:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8cb05005e180 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:3.0:1788797068.474557:0:5848:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8cb0796d2600 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8cb045480480 00000020:00080000:3.0:1788797068.474560:0:5848:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8cb0796d2f00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8cb077be7c00 00000004:00080000:3.0:1788797068.474596:0:5848:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000004:00080000:3.0:1788797068.474651:0:5848:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 6 committed 00000100:00100000:3.0:1788797068.474813:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb079bc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875689374556928:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788797068.474889:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788797068.475232:0:10829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374556928 00000100:00100000:3.0:1788797068.475244:0:10829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374556928 00000100:00100000:3.0:1788797068.475309:0:10829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788797068.475318:0:10829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb079bc0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3300:x1875689374556928:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1788797068.475351:0:10829:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:4 count 1 00002000:00010000:3.0:1788797068.475387:0:10829:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a9ee089, atime: 0x6a9ee089, ctime: 0x6a9ee089, blocks: 0x1 00010000:00010000:3.0:1788797068.475395:0:10829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001e760c97/0xca7fc0c411f9416c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797068.475413:0:10829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=357s v=(0 0) 00010000:00010000:3.0:1788797068.475417:0:10829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788797068.475424:0:10829:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001e760c97/0xca7fc0c411f9416c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797068.475441:0:10829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001e760c97/0xca7fc0c411f9416c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797068.475451:0:10829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001e760c97/0xca7fc0c411f9416c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788797068.475745:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb047c19180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6d050bb-169e-4784-be5b-7071799bf3b0+18:11533:x1875689351494528:12345-192.168.204.38@tcp:44:lhsmtool_posix.0 Request processed in 153297us (153565us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797068.475754:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 182 00000100:00100000:2.0:1788797068.475997:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb077979500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875689374557056:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1788797068.476052:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788797068.476110:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374557056 00000100:00100000:2.0:1788797068.476115:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374557056 00000100:00100000:2.0:1788797068.476146:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788797068.476154:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb077979c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3301:x1875689374557056:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1788797068.476315:0:6681:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1788797068.476319:0:6681:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1788797068 00002000:00010000:2.0:1788797068.476322:0:6681:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1788797068.476324:0:6681:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1788797068 -> 1788797068 00002000:00010000:2.0:1788797068.476327:0:6681:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1788797068.476359:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb077979c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3301:x1875689374557056:12345-0@lo:2:osp-syn-0-0.0 Request processed in 205us (307us total) trans 4294967315 rc 0/0 00000100:00100000:2.0:1788797068.476365:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000004:00080000:2.0:1788797068.476406:0:3301:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8cb077979500/2, rc 0, transno 4294967315 00000100:00100000:2.0:1788797068.476412:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb077979500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875689374557056:0@lo:2:osp-syn-0-0.0 00010000:00010000:3.0:1788797068.478994:0:10829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001e760c97/0xca7fc0c411f9416c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 10829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797068.479040:0:10829:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788797068.479867:0:10829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb079bc0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3300:x1875689374556928:12345-0@lo:6:osp-syn-1-0.0 Request processed in 4543us (4971us total) trans 4294967307 rc 0/0 00000100:00100000:3.0:1788797068.479880:0:10829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000020:00080000:0.0:1788797068.482337:0:5859:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000020:00080000:0.0:1788797068.482628:0:5859:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00080000:3.0:1788797068.487233:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1788797068.487259:0:8446:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788797068.487269:0:8446:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001e760c97/0xca7fc0c411f9416c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797068.487285:0:8446:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb077c69200 already unused, calling callback (ffffffffc14d98b0) 00010000:00010000:3.0:1788797068.487291:0:8446:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001e760c97/0xca7fc0c411f9416c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797068.487303:0:8446:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001e760c97/0xca7fc0c411f9416c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 10829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797068.487325:0:8446:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001e760c97/0xca7fc0c411f9416c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797068.487332:0:8446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001e760c97/0xca7fc0c411f9416c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797068.487373:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788797068.487375:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788797068.487377:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788797068.488668:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000004:00080000:2.0:1788797068.490729:0:3300:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8cb079bc0a80/2, rc 0, transno 4294967307 00000100:00100000:2.0:1788797068.490743:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb079bc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875689374556928:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788797068.491101:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351494656 00000100:00100000:3.0:1788797068.491111:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351494656 00000100:00100000:3.0:1788797068.491177:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 56 00000100:00100000:3.0:1788797068.491188:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb047c1b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e6d050bb-169e-4784-be5b-7071799bf3b0+10:2354:x1875689351494656:12345-192.168.204.38@tcp:16:lhsmtool_posix.0 00000100:00100000:3.0:1788797068.645839:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb047c1b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e6d050bb-169e-4784-be5b-7071799bf3b0+10:2354:x1875689351494656:12345-192.168.204.38@tcp:16:lhsmtool_posix.0 Request processed in 154641us (157169us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797068.645854:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 56 00000001:00080000:2.0:1788797068.647128:0:6713:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967313 is committed 00000001:00080000:2.0:1788797068.647145:0:6713:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967315 is committed 00000001:00080000:2.0:1788797068.647151:0:6713:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967314 is committed 00000100:00100000:2.0:1788797068.657525:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1788797068.657582:0:7636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351494912 00000100:00100000:3.0:1788797068.657593:0:7636:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351494912 00000100:00100000:3.0:1788797068.657655:0:7636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 183 00000100:00100000:3.0:1788797068.657665:0:7636:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb077978000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6d050bb-169e-4784-be5b-7071799bf3b0+18:11533:x1875689351494912:12345-192.168.204.38@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788797068.657718:0:7636:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788797068.657747:0:7636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045c00/0xca7fc0c411f94157 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee12a4 expref: 18 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797068.657767:0:7636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8cb065cc2400) 00010000:00010000:3.0:1788797068.657774:0:7636:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788797068.657815:0:7636:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69200/0xca7fc0c411f94173 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797068.657831:0:7636:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69200/0xca7fc0c411f94173 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797068.657853:0:7636:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69200/0xca7fc0c411f94173 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788797068.658143:0:7636:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009eeda079 reply state 000000002c660ca7 transno 4294967461 ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69200/0xca7fc0c411f94173 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788797068.658154:0:7636:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788797068.658249:0:7636:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb077978000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6d050bb-169e-4784-be5b-7071799bf3b0+19:11533:x1875689351494912:12345-192.168.204.38@tcp:36:lhsmtool_posix.0 Request processed in 584us (732us total) trans 4294967461 rc 0/0 00000100:00100000:3.0:1788797068.658256:0:7636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 183 00010000:00010000:2.0:1788797068.660822:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69200/0xca7fc0c411f94173 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797068.660843:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69200/0xca7fc0c411f94173 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797068.660853:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69200/0xca7fc0c411f94173 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788797068.660884:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00010000:00010000:2.0:1788797068.660885:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb077c69200 already unused, calling callback (ffffffffc1f014f0) 00010000:00010000:2.0:1788797068.660893:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69200/0xca7fc0c411f94173 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797068.660900:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69200/0xca7fc0c411f94173 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797068.660919:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8cb065cc2400) 00010000:00010000:2.0:1788797068.660932:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788797068.660938:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69200/0xca7fc0c411f94173 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797068.660944:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69200/0xca7fc0c411f94173 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788797068.661004:0:10829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351495040 00000100:00100000:0.0:1788797068.661014:0:10829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351495040 00000100:00100000:0.0:1788797068.661105:0:10829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 57 00000100:00100000:0.0:1788797068.661117:0:10829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb047c18e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e6d050bb-169e-4784-be5b-7071799bf3b0+7:2354:x1875689351495040:12345-192.168.204.38@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1788797068.661360:0:10829:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:0.0:1788797068.661364:0:10829:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 1788797068 -> 1788797067 00002000:00010000:0.0:1788797068.661366:0:10829:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 1788797065 00002000:00010000:0.0:1788797068.661368:0:10829:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1788797068 -> 1788797067 00002000:00010000:0.0:1788797068.661370:0:10829:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:0.0:1788797068.661430:0:10829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb047c18e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e6d050bb-169e-4784-be5b-7071799bf3b0+8:2354:x1875689351495040:12345-192.168.204.38@tcp:2:lhsmtool_posix.0 Request processed in 315us (552us total) trans 4294967316 rc 0/0 00000100:00100000:0.0:1788797068.661438:0:10829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 57 00000100:00100000:0.0:1788797068.663615:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1788797068.663691:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351495296 00000100:00100000:1.0:1788797068.663700:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351495296 00000100:00100000:1.0:1788797068.663764:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 184 00000100:00100000:1.0:1788797068.663775:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb080660380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6d050bb-169e-4784-be5b-7071799bf3b0+18:11533:x1875689351495296:12345-192.168.204.38@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1788797068.663866:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082044600/0xca7fc0c411f9417a lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797068.663885:0:5826:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69400/0xca7fc0c411f9413b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1296 expref: 18 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797068.664016:0:5826:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082044600/0xca7fc0c411f9417a lrc: 4/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797068.664208:0:5826:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69400/0xca7fc0c411f9413b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1296 expref: 18 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797068.664226:0:5826:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69400/0xca7fc0c411f9413b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1296 expref: 18 pid: 5826 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788797068.664244:0:5826:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb047c18700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5826:1875689374557184:192.168.204.38@tcp:104: 00000100:00100000:1.0:1788797068.664364:0:5826:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb043604f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788797068.669015:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1788797068.669142:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351495424 00000100:00100000:3.0:1788797068.669159:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351495424 00010000:00010000:3.0:1788797068.669211:0:6698:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69400/0xca7fc0c411f9413b lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1296 expref: 19 pid: 5826 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788797068.669253:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 67 00000100:00100000:3.0:1788797068.669263:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb07797bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e6d050bb-169e-4784-be5b-7071799bf3b0+19:2354:x1875689351495424:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788797068.669279:0:6698:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788797068.669286:0:6698:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69400/0xca7fc0c411f9413b lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1296 expref: 19 pid: 5826 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797068.669300:0:6698:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69400/0xca7fc0c411f9413b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1296 expref: 19 pid: 5826 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797068.669332:0:6698:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8cb065cc2400) 00010000:00010000:3.0:1788797068.669338:0:6698:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082044600/0xca7fc0c411f9417a lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797068.669381:0:6698:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082044600/0xca7fc0c411f9417a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797068.669390:0:6698:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082044600/0xca7fc0c411f9417a lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797068.669420:0:6698:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788797068.669497:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb07797bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e6d050bb-169e-4784-be5b-7071799bf3b0+19:2354:x1875689351495424:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 218us (473us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797068.669505:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 67 00010000:00010000:1.0:1788797068.669844:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69400/0xca7fc0c411f9413b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1296 expref: 18 pid: 5826 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788797068.669868:0:5826:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb047c18700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5826:1875689374557184:192.168.204.38@tcp:104: 00010000:00010000:1.0:1788797068.669887:0:5826:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082044600/0xca7fc0c411f9417a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797068.669896:0:5826:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082044600/0xca7fc0c411f9417a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797068.669913:0:5826:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082044600/0xca7fc0c411f9417a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797068.669940:0:5826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082044600/0xca7fc0c411f9417a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797068.669947:0:5826:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082044600/0xca7fc0c411f9417a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797068.669954:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082044600/0xca7fc0c411f9417a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797068.669960:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb082044600 already unused, calling callback (ffffffffc1f014f0) 00010000:00010000:1.0:1788797068.669964:0:5826:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082044600/0xca7fc0c411f9417a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797068.669988:0:5826:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082044600/0xca7fc0c411f9417a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797068.669999:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8cb065cc2400) 00010000:00010000:1.0:1788797068.670002:0:5826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1788797068.670006:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082044600/0xca7fc0c411f9417a lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797068.670012:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082044600/0xca7fc0c411f9417a lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788797068.670214:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb080660380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6d050bb-169e-4784-be5b-7071799bf3b0+17:11533:x1875689351495296:12345-192.168.204.38@tcp:55:lhsmtool_posix.0 Request processed in 6440us (6609us total) trans 0 rc -22/-22 00000100:00100000:1.0:1788797068.670223:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 184 00000100:00100000:2.0:1788797068.678509:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1788797068.678600:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351495552 00000100:00100000:1.0:1788797068.678612:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351495552 00000100:00100000:1.0:1788797068.678745:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 58 00000100:00100000:1.0:1788797068.678757:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb077978e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e6d050bb-169e-4784-be5b-7071799bf3b0+8:2354:x1875689351495552:12345-192.168.204.38@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1788797068.678842:0:6684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000fff90cbe/0xca7fc0c411f94181 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797068.678871:0:6684:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000000d37cb33/0xca7fc0c411f94165 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee12b2 expref: 8 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797068.678880:0:6684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788797068.678884:0:6684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788797068.678889:0:6684:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fff90cbe/0xca7fc0c411f94181 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797068.678931:0:6684:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000000d37cb33/0xca7fc0c411f94165 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee12b2 expref: 8 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797068.678946:0:6684:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000000d37cb33/0xca7fc0c411f94165 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee12b2 expref: 8 pid: 6684 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788797068.678961:0:6684:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb047c18700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6684:1875689374557312:192.168.204.38@tcp:104: 00000100:00100000:1.0:1788797068.679101:0:6684:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb043604f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788797068.702150:0:6684:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb047c18700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6684:1875689374557312:192.168.204.38@tcp:104: 00010000:00010000:1.0:1788797068.702178:0:6684:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000fff90cbe/0xca7fc0c411f94181 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788797068.702223:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1788797068.702410:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351495680 00000100:00100000:3.0:1788797068.702418:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351495680 00010000:00010000:3.0:1788797068.702451:0:5811:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000000d37cb33/0xca7fc0c411f94165 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee12b2 expref: 9 pid: 6684 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788797068.702500:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 68 00000100:00100000:3.0:1788797068.702509:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0484c5050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e6d050bb-169e-4784-be5b-7071799bf3b0+9:2354:x1875689351495680:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788797068.702523:0:5811:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788797068.702546:0:5811:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000000d37cb33/0xca7fc0c411f94165 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee12b2 expref: 9 pid: 6684 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797068.702558:0:5811:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000000d37cb33/0xca7fc0c411f94165 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee12b2 expref: 9 pid: 6684 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797068.702581:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000d37cb33/0xca7fc0c411f94165 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee12b2 expref: 9 pid: 6684 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797068.702612:0:5811:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788797068.702617:0:5811:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788797068.702623:0:5811:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fff90cbe/0xca7fc0c411f94181 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797068.702633:0:5811:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fff90cbe/0xca7fc0c411f94181 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797068.702817:0:5811:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788797068.702871:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0484c5050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e6d050bb-169e-4784-be5b-7071799bf3b0+8:2354:x1875689351495680:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 362us (649us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797068.702879:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 68 00010000:00010000:1.0:1788797068.705182:0:6684:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000fff90cbe/0xca7fc0c411f94181 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797068.705207:0:6684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fff90cbe/0xca7fc0c411f94181 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797068.705410:0:6684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000fff90cbe/0xca7fc0c411f94181 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797068.705421:0:6684:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fff90cbe/0xca7fc0c411f94181 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797068.705429:0:6684:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fff90cbe/0xca7fc0c411f94181 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797068.705437:0:6684:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb082045200 already unused, calling callback (ffffffffc14d98b0) 00010000:00010000:0.0:1788797068.705442:0:6684:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fff90cbe/0xca7fc0c411f94181 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797068.705452:0:6684:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fff90cbe/0xca7fc0c411f94181 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797068.705471:0:6684:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fff90cbe/0xca7fc0c411f94181 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797068.705491:0:6684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fff90cbe/0xca7fc0c411f94181 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788797068.705653:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb077978e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e6d050bb-169e-4784-be5b-7071799bf3b0+7:2354:x1875689351495552:12345-192.168.204.38@tcp:1:lhsmtool_posix.0 Request processed in 26895us (27150us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797068.705664:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 58 00000100:00100000:1.0:1788797068.708884:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1788797068.708964:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351495936 00000100:00100000:2.0:1788797068.708973:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351495936 00000100:00100000:2.0:1788797068.709092:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 185 00000100:00100000:2.0:1788797068.709104:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb047c18700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6d050bb-169e-4784-be5b-7071799bf3b0+17:11533:x1875689351495936:12345-192.168.204.38@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1788797068.709178:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040030c00/0xca7fc0c411f94188 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797068.709196:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040030c00/0xca7fc0c411f94188 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797068.709208:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040030c00/0xca7fc0c411f94188 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797068.709423:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040030800/0xca7fc0c411f9418f lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797068.709435:0:5825:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c68200/0xca7fc0c411f94149 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee129d expref: 18 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797068.709443:0:5825:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040030800/0xca7fc0c411f9418f lrc: 4/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797068.709476:0:5825:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c68200/0xca7fc0c411f94149 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee129d expref: 18 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797068.709499:0:5825:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c68200/0xca7fc0c411f94149 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee129d expref: 18 pid: 5826 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788797068.709513:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb077978a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5825:1875689374557440:192.168.204.38@tcp:104: 00000100:00100000:2.0:1788797068.709597:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb048dc06c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788797068.718245:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb077978a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5825:1875689374557440:192.168.204.38@tcp:104: 00010000:00010000:3.0:1788797068.718278:0:5825:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040030800/0xca7fc0c411f9418f lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788797068.719365:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1788797068.719526:0:11663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351496064 00000100:00100000:0.0:1788797068.719542:0:11663:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351496064 00010000:00010000:0.0:1788797068.719581:0:11663:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c68200/0xca7fc0c411f94149 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee129d expref: 19 pid: 5826 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788797068.719642:0:11663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 69 00000100:00100000:0.0:1788797068.719654:0:11663:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb047c18000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e6d050bb-169e-4784-be5b-7071799bf3b0+19:2354:x1875689351496064:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788797068.719681:0:11663:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788797068.719695:0:11663:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c68200/0xca7fc0c411f94149 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee129d expref: 19 pid: 5826 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797068.719710:0:11663:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c68200/0xca7fc0c411f94149 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee129d expref: 19 pid: 5826 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797068.719747:0:11663:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c68200/0xca7fc0c411f94149 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee129d expref: 19 pid: 5826 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797068.719771:0:11663:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8cb065cc2400) 00010000:00010000:0.0:1788797068.719778:0:11663:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040030800/0xca7fc0c411f9418f lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797068.719789:0:11663:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040030800/0xca7fc0c411f9418f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797068.719802:0:11663:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040030800/0xca7fc0c411f9418f lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797068.719844:0:11663:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788797068.719910:0:11663:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb047c18000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e6d050bb-169e-4784-be5b-7071799bf3b0+18:2354:x1875689351496064:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 258us (555us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797068.719927:0:11663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 69 00010000:00010000:0.0:1788797068.720066:0:5825:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040030800/0xca7fc0c411f9418f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797068.720075:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040030800/0xca7fc0c411f9418f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788797068.720267:0:5825:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967462 00000001:00080000:0.0:1788797068.720404:0:5825:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967463 00000001:00080000:0.0:1788797068.720444:0:5825:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000100:00100000:0.0:1788797068.720538:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb080661180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5825:1875689374557568:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1788797068.720599:0:5825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788797068.720635:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb0484fad80 going to sleep for 11 seconds 00000100:00100000:0.0:1788797068.720666:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374557568 00000100:00100000:0.0:1788797068.720671:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374557568 00000100:00100000:0.0:1788797068.720721:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788797068.720729:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb080661f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5825:x1875689374557568:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1788797068.720825:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb080661f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5825:x1875689374557568:12345-0@lo:1000:mdt00_000.0 Request processed in 96us (228us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797068.720838:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788797068.720876:0:5825:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967315 gen 2 00000004:00080000:0.0:1788797068.720881:0:5825:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8cb077979500, transno 4294967315 00000100:00100000:0.0:1788797068.720896:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb080661180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5825:1875689374557568:0@lo:1000:mdt00_000.0 00000001:00080000:0.0:1788797068.721333:0:5825:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000100:00100000:0.0:1788797068.721381:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb080661180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5825:1875689374557696:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1788797068.721409:0:5825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788797068.721427:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb0484fa6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788797068.721444:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374557696 00000100:00100000:1.0:1788797068.721451:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374557696 00000100:00100000:1.0:1788797068.721495:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788797068.721512:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb080661c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5825:x1875689374557696:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1788797068.721713:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb080661c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5825:x1875689374557696:12345-0@lo:1000:mdt00_000.0 Request processed in 210us (302us total) trans 4294967317 rc 0/0 00000100:00100000:1.0:1788797068.721721:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788797068.728690:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb080661180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5825:1875689374557696:0@lo:1000:mdt00_000.0 00010000:00010000:0.0:1788797068.728742:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040030800/0xca7fc0c411f9418f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797068.728753:0:5825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040030800/0xca7fc0c411f9418f lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797068.728761:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040030800/0xca7fc0c411f9418f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797068.728768:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb040030800 already unused, calling callback (ffffffffc1f014f0) 00010000:00010000:0.0:1788797068.728774:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040030800/0xca7fc0c411f9418f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797068.728783:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040030800/0xca7fc0c411f9418f lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797068.728802:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8cb065cc2400) 00010000:00010000:0.0:1788797068.728805:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788797068.728812:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040030800/0xca7fc0c411f9418f lrc: 2/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797068.728819:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040030800/0xca7fc0c411f9418f lrc: 0/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797068.728863:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2c00/0xca7fc0c411f940c4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797068.728870:0:5825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2c00/0xca7fc0c411f940c4 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797068.728875:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2c00/0xca7fc0c411f940c4 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797068.728965:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb042ea2c00 already unused, calling callback (ffffffffc1f014f0) 00010000:00010000:0.0:1788797068.728969:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2c00/0xca7fc0c411f940c4 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797068.728976:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2c00/0xca7fc0c411f940c4 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797068.728985:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cb058766b00) 00010000:00010000:0.0:1788797068.728987:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788797068.728991:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2c00/0xca7fc0c411f940c4 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797068.728997:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2c00/0xca7fc0c411f940c4 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797068.729019:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3400/0xca7fc0c411f94196 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797068.729054:0:5825:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045600/0xca7fc0c411f940e0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1281 expref: 21 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797068.729066:0:5825:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3400/0xca7fc0c411f94196 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797068.729122:0:5825:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045600/0xca7fc0c411f940e0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1281 expref: 21 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797068.729139:0:5825:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045600/0xca7fc0c411f940e0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1281 expref: 21 pid: 5825 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788797068.729169:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb0794f5180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5825:1875689374557824:192.168.204.38@tcp:104: 00000100:00100000:0.0:1788797068.729281:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb0484fa6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788797068.737331:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1788797068.737562:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb0794f5180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5825:1875689374557824:192.168.204.38@tcp:104: 00010000:00010000:2.0:1788797068.737593:0:5825:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3400/0xca7fc0c411f94196 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788797068.738155:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351496192 00000100:00100000:1.0:1788797068.738164:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351496192 00010000:00010000:1.0:1788797068.738209:0:5812:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045600/0xca7fc0c411f940e0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1281 expref: 22 pid: 5825 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788797068.738261:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 70 00000100:00100000:1.0:1788797068.738273:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb047c19f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e6d050bb-169e-4784-be5b-7071799bf3b0+22:2354:x1875689351496192:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788797068.738291:0:5812:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788797068.738299:0:5812:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045600/0xca7fc0c411f940e0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1281 expref: 22 pid: 5825 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797068.738319:0:5812:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045600/0xca7fc0c411f940e0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1281 expref: 22 pid: 5825 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797068.738343:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045600/0xca7fc0c411f940e0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1281 expref: 22 pid: 5825 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797068.738359:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cb058766b00) 00010000:00010000:1.0:1788797068.738364:0:5812:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3400/0xca7fc0c411f94196 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797068.738375:0:5812:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3400/0xca7fc0c411f94196 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797068.738385:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3400/0xca7fc0c411f94196 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797068.740021:0:5812:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788797068.740117:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb047c19f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e6d050bb-169e-4784-be5b-7071799bf3b0+21:2354:x1875689351496192:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 1842us (2794us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797068.740128:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 70 00010000:00010000:2.0:1788797068.749751:0:5825:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3400/0xca7fc0c411f94196 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797068.749775:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3400/0xca7fc0c411f94196 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797068.749802:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3400/0xca7fc0c411f94196 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797068.749820:0:5825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3400/0xca7fc0c411f94196 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797068.749829:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3400/0xca7fc0c411f94196 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797068.749835:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb042ea3400 already unused, calling callback (ffffffffc1f014f0) 00010000:00010000:2.0:1788797068.749840:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3400/0xca7fc0c411f94196 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797068.749848:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3400/0xca7fc0c411f94196 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797068.749868:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cb058766b00) 00010000:00010000:2.0:1788797068.749871:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788797068.749876:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3400/0xca7fc0c411f94196 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797068.749882:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3400/0xca7fc0c411f94196 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797068.749908:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040030c00/0xca7fc0c411f94188 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797068.749915:0:5825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040030c00/0xca7fc0c411f94188 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797068.749920:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040030c00/0xca7fc0c411f94188 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797068.749925:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb040030c00 already unused, calling callback (ffffffffc1f014f0) 00010000:00010000:2.0:1788797068.749934:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040030c00/0xca7fc0c411f94188 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797068.749940:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040030c00/0xca7fc0c411f94188 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797068.749949:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cb058766b00) 00010000:00010000:2.0:1788797068.749952:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788797068.749955:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040030c00/0xca7fc0c411f94188 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797068.749960:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040030c00/0xca7fc0c411f94188 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788797068.750293:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb047c18700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6d050bb-169e-4784-be5b-7071799bf3b0+20:11533:x1875689351495936:12345-192.168.204.38@tcp:57:lhsmtool_posix.0 Request processed in 41185us (41411us total) trans 4294967466 rc 0/0 00000100:00100000:2.0:1788797068.750304:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 185 00000020:00080000:2.0:1788797068.750310:0:5825:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1788797068.750578:0:11679:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788797068.750584:0:11679:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788797068.751151:0:11679:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 2 00000040:00080000:0.0:1788797068.751159:0:11679:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788797068.755548:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1788797068.755641:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351496448 00000100:00100000:0.0:1788797068.755654:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351496448 00000100:00100000:0.0:1788797068.758426:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 50 00000100:00100000:0.0:1788797068.758444:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb050635850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e6d050bb-169e-4784-be5b-7071799bf3b0+20:11533:x1875689351496448:12345-192.168.204.38@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1788797068.759086:0:5828:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1788797068.759194:0:5828:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967467 00010000:00010000:0.0:1788797068.759242:0:5828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2600/0xca7fc0c411f9419d lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797068.759257:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2600/0xca7fc0c411f9419d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797068.759268:0:5828:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2600/0xca7fc0c411f9419d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797068.759277:0:5828:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2600/0xca7fc0c411f9419d lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797068.759284:0:5828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2600/0xca7fc0c411f9419d lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797068.759290:0:5828:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2600/0xca7fc0c411f9419d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797068.759327:0:5828:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788797068.759421:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb050635850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e6d050bb-169e-4784-be5b-7071799bf3b0+22:11533:x1875689351496448:12345-192.168.204.38@tcp:35:lhsmtool_posix.0 Request processed in 982us (3883us total) trans 4294967468 rc 0/0 00000100:00100000:0.0:1788797068.759429:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 50 00000020:00080000:0.0:1788797068.759435:0:5828:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1788797068.762552:0:5815:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788797068.762567:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2600/0xca7fc0c411f9419d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797068.762579:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb042ea2600 already unused, calling callback (ffffffffc14d98b0) 00010000:00010000:0.0:1788797068.762584:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2600/0xca7fc0c411f9419d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797068.762594:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2600/0xca7fc0c411f9419d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797068.762611:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8cb058766100) 00010000:00010000:0.0:1788797068.762614:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788797068.762619:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2600/0xca7fc0c411f9419d lrc: 1/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797068.762625:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2600/0xca7fc0c411f9419d lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797068.762644:0:5815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788797068.762646:0:5815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788797068.762648:0:5815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788797068.851234:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb080475880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875689374558080:0@lo:400:kworker.0 00000100:00100000:0.0:1788797068.851258:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb080477b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:3302:1875689374557952:0@lo:400:kworker.0 00000100:00100000:0.0:1788797068.851729:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788797068.851800:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb077979500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875689374558464:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788797068.851838:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788797068.853495:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788797068.853566:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb080476d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3300:1875689374558208:0@lo:400:kworker.0 00000100:00100000:1.0:1788797068.853617:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788797068.853638:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788797068.853645:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb080475500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3300:1875689374558336:0@lo:400:kworker.0 00000100:00100000:1.0:1788797068.853667:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788797068.853715:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374558080 00000100:00100000:1.0:1788797068.853724:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374558080 00000100:00100000:1.0:1788797068.853781:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374558208 00000100:00100000:1.0:1788797068.853796:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374558208 00000100:00100000:1.0:1788797068.853823:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374558336 00000100:00100000:1.0:1788797068.853825:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374558336 00000100:00100000:1.0:1788797068.854023:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1788797068.854056:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb080474a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875689374558080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788797068.854122:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb080474a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875689374558080:12345-0@lo:400:kworker.0 Request processed in 68us (644us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797068.854130:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1788797068.854148:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1788797068.854154:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb050380700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1875689374558208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788797068.854200:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb050380700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1875689374558208:12345-0@lo:400:kworker.0 Request processed in 46us (582us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797068.854206:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1788797068.854217:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1788797068.854223:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb050380000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1875689374558336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788797068.854250:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb050380000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1875689374558336:12345-0@lo:400:kworker.0 Request processed in 28us (582us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797068.854256:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1788797068.854313:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb080475500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3300:1875689374558336:0@lo:400:kworker.0 00000100:00100000:1.0:1788797068.854325:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb080476d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3300:1875689374558208:0@lo:400:kworker.0 00000100:00100000:1.0:1788797068.854358:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb080475880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875689374558080:0@lo:400:kworker.0 00000100:00100000:3.0:1788797068.855024:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374558464 00000100:00100000:3.0:1788797068.855056:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374558464 00000100:00100000:3.0:1788797068.855106:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788797068.855115:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0794f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3302:x1875689374558464:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788797068.855154:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788797068.855218:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0794f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3302:x1875689374558464:12345-0@lo:13:osp-pre-1-0.0 Request processed in 105us (3380us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797068.855226:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00080000:3.0:1788797068.855253:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788797068.855352:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374557952 00000100:00100000:2.0:1788797068.855359:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374557952 00000100:00100000:2.0:1788797068.855394:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 301 00000100:00100000:2.0:1788797068.855401:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb060706050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+19:3302:x1875689374557952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788797068.855440:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb060706050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+19:3302:x1875689374557952:12345-0@lo:400:kworker.0 Request processed in 40us (3712us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797068.855446:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 301 00000100:00100000:1.0:1788797068.856227:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb077979500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875689374558464:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788797068.856256:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb080477b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:3302:1875689374557952:0@lo:400:kworker.0 00000040:00080000:2.0:1788797068.928500:0:12453:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788797068.928512:0:12453:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788797068.928565:0:12453:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:2.0:1788797068.928573:0:12453:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788797069.093251:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1788797069.093343:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351496704 00000100:00100000:2.0:1788797069.093354:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351496704 00000100:00100000:2.0:1788797069.093410:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 186 00000100:00100000:2.0:1788797069.093421:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0794f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6d050bb-169e-4784-be5b-7071799bf3b0+22:11543:x1875689351496704:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1788797069.093447:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788797069.093468:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040030c00/0xca7fc0c411f941a4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c99e04559ee12b9 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797069.093573:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040031a00/0xca7fc0c411f941ab lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797069.093589:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040031a00/0xca7fc0c411f941ab lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797069.093605:0:5827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040031a00/0xca7fc0c411f941ab lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788797069.093617:0:5827:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:2.0:1788797069.093759:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040030c00/0xca7fc0c411f941a4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee12b9 expref: 25 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797069.093781:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040031a00/0xca7fc0c411f941ab lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee12b9 expref: 24 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797069.093789:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8cb058766500) 00010000:00010000:2.0:1788797069.093803:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788797069.093808:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb040031a00, rc 0) 00000100:00100000:2.0:1788797069.093870:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0794f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6d050bb-169e-4784-be5b-7071799bf3b0+24:11543:x1875689351496704:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 451us (645us total) trans 4294967469 rc 0/0 00000100:00100000:2.0:1788797069.093893:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 186 00000100:00100000:3.0:1788797069.103830:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1788797069.103934:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351496832 00000100:00100000:1.0:1788797069.103949:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351496832 00000100:00100000:1.0:1788797069.104018:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 187 00000100:00100000:1.0:1788797069.104045:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb079bc2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6d050bb-169e-4784-be5b-7071799bf3b0+24:11543:x1875689351496832:12345-192.168.204.38@tcp:34:lfs.0 00010000:00010000:1.0:1788797069.104137:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045600/0xca7fc0c411f941b9 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797069.104160:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045600/0xca7fc0c411f941b9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797069.104175:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045600/0xca7fc0c411f941b9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797069.104191:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082044600/0xca7fc0c411f941c0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797069.104198:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082044600/0xca7fc0c411f941c0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797069.104205:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082044600/0xca7fc0c411f941c0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797069.107421:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045200/0xca7fc0c411f941c7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797069.107451:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045200/0xca7fc0c411f941c7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797069.107468:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045200/0xca7fc0c411f941c7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788797069.107566:0:5825:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045200/0xca7fc0c411f941c7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797069.107583:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045600/0xca7fc0c411f941b9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797069.107590:0:5825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045600/0xca7fc0c411f941b9 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797069.107598:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045600/0xca7fc0c411f941b9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797069.107604:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb082045600 already unused, calling callback (ffffffffc1f014f0) 00010000:00010000:1.0:1788797069.107609:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045600/0xca7fc0c411f941b9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797069.107617:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045600/0xca7fc0c411f941b9 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797069.107635:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8cb058766500) 00010000:00010000:1.0:1788797069.107638:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788797069.107645:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045600/0xca7fc0c411f941b9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797069.107651:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045600/0xca7fc0c411f941b9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797069.107666:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082044600/0xca7fc0c411f941c0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797069.107672:0:5825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082044600/0xca7fc0c411f941c0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797069.107686:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082044600/0xca7fc0c411f941c0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797069.107691:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb082044600 already unused, calling callback (ffffffffc1f014f0) 00010000:00010000:1.0:1788797069.107695:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082044600/0xca7fc0c411f941c0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797069.107700:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082044600/0xca7fc0c411f941c0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797069.107708:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8cb06ce84c00) 00010000:00010000:1.0:1788797069.107711:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788797069.107714:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082044600/0xca7fc0c411f941c0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797069.107720:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082044600/0xca7fc0c411f941c0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797069.107741:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045200/0xca7fc0c411f941c7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797069.107747:0:5825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045200/0xca7fc0c411f941c7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797069.107752:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045200/0xca7fc0c411f941c7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797069.107757:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb082045200 already unused, calling callback (ffffffffc1f014f0) 00010000:00010000:1.0:1788797069.107760:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045200/0xca7fc0c411f941c7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797069.107774:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045200/0xca7fc0c411f941c7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797069.107806:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cb06ce84e00) 00010000:00010000:1.0:1788797069.107809:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788797069.107812:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045200/0xca7fc0c411f941c7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797069.107818:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045200/0xca7fc0c411f941c7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788797069.107976:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb079bc2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6d050bb-169e-4784-be5b-7071799bf3b0+24:11543:x1875689351496832:12345-192.168.204.38@tcp:34:lfs.0 Request processed in 3940us (4159us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797069.107990:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 187 00010000:00010000:1.0:1788797069.109569:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788797069.178320:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1788797069.178506:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351497088 00000100:00100000:1.0:1788797069.178519:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351497088 00000100:00100000:1.0:1788797069.178602:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 188 00000100:00100000:1.0:1788797069.178627:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb077979500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6d050bb-169e-4784-be5b-7071799bf3b0+24:11546:x1875689351497088:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1788797069.178655:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788797069.178684:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045200/0xca7fc0c411f941ce lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c99e04559ee12c0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797069.178776:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082044600/0xca7fc0c411f941d5 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797069.178796:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082044600/0xca7fc0c411f941d5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797069.178833:0:5827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082044600/0xca7fc0c411f941d5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797069.178850:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045600/0xca7fc0c411f941dc lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797069.178858:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045600/0xca7fc0c411f941dc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797069.178865:0:5827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045600/0xca7fc0c411f941dc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797069.179344:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3400/0xca7fc0c411f941e3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797069.179355:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3400/0xca7fc0c411f941e3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797069.179364:0:5827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3400/0xca7fc0c411f941e3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788797069.179376:0:5827:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:0.0:1788797069.179510:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082044600/0xca7fc0c411f941d5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797069.179518:0:5827:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082044600/0xca7fc0c411f941d5 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797069.179525:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082044600/0xca7fc0c411f941d5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797069.179532:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb082044600 already unused, calling callback (ffffffffc1f014f0) 00010000:00010000:0.0:1788797069.179537:0:5827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082044600/0xca7fc0c411f941d5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797069.179545:0:5827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082044600/0xca7fc0c411f941d5 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797069.179560:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8cb058766500) 00010000:00010000:0.0:1788797069.179564:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788797069.179570:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082044600/0xca7fc0c411f941d5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797069.179585:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082044600/0xca7fc0c411f941d5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797069.179604:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045600/0xca7fc0c411f941dc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797069.179610:0:5827:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045600/0xca7fc0c411f941dc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797069.179617:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045600/0xca7fc0c411f941dc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797069.179621:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb082045600 already unused, calling callback (ffffffffc1f014f0) 00010000:00010000:0.0:1788797069.179624:0:5827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045600/0xca7fc0c411f941dc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797069.179630:0:5827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045600/0xca7fc0c411f941dc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797069.179638:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8cb06ce84e00) 00010000:00010000:0.0:1788797069.179642:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788797069.179644:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045600/0xca7fc0c411f941dc lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797069.179650:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045600/0xca7fc0c411f941dc lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797069.179706:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045200/0xca7fc0c411f941ce lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee12c0 expref: 27 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797069.179723:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3400/0xca7fc0c411f941e3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee12c0 expref: 26 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797069.179737:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cb058766100) 00010000:00010000:0.0:1788797069.179740:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788797069.179744:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb042ea3400, rc 0) 00000100:00100000:0.0:1788797069.179977:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb077979500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6d050bb-169e-4784-be5b-7071799bf3b0+26:11546:x1875689351497088:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 1362us (1672us total) trans 4294967470 rc 0/0 00000100:00100000:0.0:1788797069.179988:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 188 00000100:00100000:3.0:1788797069.188457:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1788797069.188533:0:7636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351497216 00000100:00100000:0.0:1788797069.188543:0:7636:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351497216 00000100:00100000:0.0:1788797069.188606:0:7636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 189 00000100:00100000:0.0:1788797069.188617:0:7636:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb079bc2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6d050bb-169e-4784-be5b-7071799bf3b0+26:11546:x1875689351497216:12345-192.168.204.38@tcp:54:lfs.0 00010000:00010000:0.0:1788797069.188687:0:7636:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2c00/0xca7fc0c411f941f1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797069.188718:0:7636:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2c00/0xca7fc0c411f941f1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797069.188730:0:7636:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2c00/0xca7fc0c411f941f1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797069.188758:0:7636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2c00/0xca7fc0c411f941f1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797069.188764:0:7636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2c00/0xca7fc0c411f941f1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797069.188771:0:7636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2c00/0xca7fc0c411f941f1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797069.188777:0:7636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb042ea2c00 already unused, calling callback (ffffffffc1f014f0) 00010000:00010000:0.0:1788797069.188800:0:7636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2c00/0xca7fc0c411f941f1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797069.188809:0:7636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2c00/0xca7fc0c411f941f1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797069.188823:0:7636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cb058766100) 00010000:00010000:0.0:1788797069.188826:0:7636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788797069.188832:0:7636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2c00/0xca7fc0c411f941f1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797069.188840:0:7636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2c00/0xca7fc0c411f941f1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788797069.188933:0:7636:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb079bc2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6d050bb-169e-4784-be5b-7071799bf3b0+26:11546:x1875689351497216:12345-192.168.204.38@tcp:54:lfs.0 Request processed in 318us (484us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797069.188941:0:7636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 189 00000100:00100000:3.0:1788797069.195572:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1788797069.195656:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351497472 00000100:00100000:2.0:1788797069.195667:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351497472 00000100:00100000:2.0:1788797069.195729:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 51 00000100:00100000:2.0:1788797069.195740:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb079bc3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e6d050bb-169e-4784-be5b-7071799bf3b0+26:11546:x1875689351497472:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:2.0:1788797069.195982:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb079bc3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e6d050bb-169e-4784-be5b-7071799bf3b0+27:11546:x1875689351497472:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 243us (420us total) trans 4294967471 rc 0/0 00000100:00100000:2.0:1788797069.195989:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 51 00000100:00100000:2.0:1788797069.232264:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1788797069.232398:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351497728 00000100:00100000:0.0:1788797069.232411:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351497728 00000100:00100000:0.0:1788797069.232514:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 190 00000100:00100000:0.0:1788797069.232528:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb077978a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6d050bb-169e-4784-be5b-7071799bf3b0+27:11080:x1875689351497728:12345-192.168.204.38@tcp:101:bash.0 00010000:00010000:0.0:1788797069.232561:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788797069.232591:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2c00/0xca7fc0c411f941f8 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c99e04559ee12c7 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797069.232742:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3800/0xca7fc0c411f941ff lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797069.232764:0:5826:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3400/0xca7fc0c411f941e3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee12c0 expref: 28 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797069.232814:0:5826:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3800/0xca7fc0c411f941ff lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797069.232856:0:5826:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3400/0xca7fc0c411f941e3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee12c0 expref: 28 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797069.232872:0:5826:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3400/0xca7fc0c411f941e3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee12c0 expref: 28 pid: 5827 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788797069.232889:0:5826:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb0794f7480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5826:1875689374558592:192.168.204.38@tcp:104: 00000100:00100000:0.0:1788797069.233017:0:5826:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb06f1cfc00 going to sleep for 11 seconds 00000100:00100000:3.0:1788797069.250261:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1788797069.250655:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351497856 00000100:00100000:1.0:1788797069.250666:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351497856 00010000:00010000:1.0:1788797069.250715:0:5813:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3400/0xca7fc0c411f941e3 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee12c0 expref: 29 pid: 5827 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788797069.250769:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 71 00000100:00100000:1.0:1788797069.250791:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb06ef1e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e6d050bb-169e-4784-be5b-7071799bf3b0+29:2355:x1875689351497856:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788797069.250934:0:5813:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788797069.250944:0:5813:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3400/0xca7fc0c411f941e3 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee12c0 expref: 29 pid: 5827 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797069.250958:0:5813:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3400/0xca7fc0c411f941e3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee12c0 expref: 29 pid: 5827 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797069.250982:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cb058766100) 00010000:00010000:1.0:1788797069.250988:0:5813:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3800/0xca7fc0c411f941ff lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797069.251014:0:5813:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3800/0xca7fc0c411f941ff lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797069.251020:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3800/0xca7fc0c411f941ff lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797069.251074:0:5813:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788797069.251128:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb06ef1e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e6d050bb-169e-4784-be5b-7071799bf3b0+29:2355:x1875689351497856:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 350us (877us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797069.251136:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 71 00010000:00010000:0.0:1788797069.251626:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3400/0xca7fc0c411f941e3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee12c0 expref: 28 pid: 5827 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788797069.251648:0:5826:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb0794f7480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5826:1875689374558592:192.168.204.38@tcp:104: 00010000:00010000:0.0:1788797069.251671:0:5826:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3800/0xca7fc0c411f941ff lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797069.251680:0:5826:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3800/0xca7fc0c411f941ff lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797069.251686:0:5826:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3800/0xca7fc0c411f941ff lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788797069.251707:0:5826:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:0.0:1788797069.251941:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2c00/0xca7fc0c411f941f8 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee12c7 expref: 29 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797069.251971:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3800/0xca7fc0c411f941ff lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee12c7 expref: 28 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797069.251980:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cb058766100) 00010000:00010000:0.0:1788797069.251984:0:5826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788797069.251986:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb042ea3800, rc 0) 00000100:00100000:0.0:1788797069.252083:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb077978a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6d050bb-169e-4784-be5b-7071799bf3b0+28:11080:x1875689351497728:12345-192.168.204.38@tcp:101:bash.0 Request processed in 19560us (19830us total) trans 4294967472 rc 0/0 00000100:00100000:0.0:1788797069.252091:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 190 00000100:00100000:3.0:1788797069.258978:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1788797069.259176:0:7636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351498112 00000100:00100000:0.0:1788797069.259187:0:7636:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351498112 00000100:00100000:0.0:1788797069.259238:0:7636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 191 00000100:00100000:0.0:1788797069.259247:0:7636:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb06ef1ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6d050bb-169e-4784-be5b-7071799bf3b0+28:11080:x1875689351498112:12345-192.168.204.38@tcp:36:bash.0 00010000:00010000:0.0:1788797069.259707:0:7636:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2c00/0xca7fc0c411f9420d lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797069.259726:0:7636:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2c00/0xca7fc0c411f9420d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797069.259739:0:7636:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2c00/0xca7fc0c411f9420d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788797069.259922:0:7636:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967473 00000004:00010000:0.0:1788797069.259949:0:7636:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000071e8f8fc reply state 000000003f748b01 transno 4294967474 ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2c00/0xca7fc0c411f9420d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788797069.259959:0:7636:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:0.0:1788797069.260117:0:7636:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967474 00000100:00100000:0.0:1788797069.260371:0:7636:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb06ef1ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6d050bb-169e-4784-be5b-7071799bf3b0+32:11080:x1875689351498112:12345-192.168.204.38@tcp:36:bash.0 Request processed in 1123us (1402us total) trans 4294967475 rc 0/0 00000100:00100000:0.0:1788797069.260380:0:7636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 191 00000020:00080000:0.0:1788797069.260386:0:7636:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:3.0:1788797069.262632:0:3286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2c00/0xca7fc0c411f9420d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797069.262649:0:3286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2c00/0xca7fc0c411f9420d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797069.262658:0:3286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2c00/0xca7fc0c411f9420d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797069.262665:0:3286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb042ea2c00 already unused, calling callback (ffffffffc1f014f0) 00010000:00010000:3.0:1788797069.262670:0:3286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2c00/0xca7fc0c411f9420d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797069.262678:0:3286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2c00/0xca7fc0c411f9420d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797069.262694:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cb058766100) 00010000:00010000:3.0:1788797069.262697:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788797069.262702:0:3286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2c00/0xca7fc0c411f9420d lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797069.262708:0:3286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2c00/0xca7fc0c411f9420d lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788797069.263384:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1788797069.263489:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351498240 00000100:00100000:0.0:1788797069.263500:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351498240 00000100:00100000:0.0:1788797069.263568:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 192 00000100:00100000:0.0:1788797069.263579:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb06ec6e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6d050bb-169e-4784-be5b-7071799bf3b0+31:11080:x1875689351498240:12345-192.168.204.38@tcp:101:bash.0 00010000:00010000:0.0:1788797069.263607:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788797069.263630:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3400/0xca7fc0c411f94214 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c99e04559ee12ce expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797069.263705:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3400/0xca7fc0c411f94214 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee12ce expref: 32 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797069.263721:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3400/0xca7fc0c411f94214 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee12ce expref: 32 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797069.263742:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cb058766100) 00010000:00010000:0.0:1788797069.263745:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788797069.263749:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb042ea3400, rc 0) 00000100:00100000:0.0:1788797069.263840:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb06ec6e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6d050bb-169e-4784-be5b-7071799bf3b0+32:11080:x1875689351498240:12345-192.168.204.38@tcp:101:bash.0 Request processed in 263us (461us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797069.263847:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 192 00000100:00100000:2.0:1788797069.271732:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1788797069.271954:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351498368 00000100:00100000:3.0:1788797069.271968:0:6683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351498368 00000100:00100000:3.0:1788797069.272111:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 59 00000100:00100000:3.0:1788797069.272126:0:6683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb07797bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e6d050bb-169e-4784-be5b-7071799bf3b0+7:11080:x1875689351498368:12345-192.168.204.38@tcp:101:bash.0 00010000:00010000:3.0:1788797069.272153:0:6683:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788797069.272180:0:6683:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c016a1a1/0xca7fc0c411f9421b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7c99e04559ee12d5 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788797069.272212:0:6683:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a9ee08b, atime: 0x6a9ee089, ctime: 0x6a9ee08b, blocks: 0xb 00010000:00010000:3.0:1788797069.272233:0:6683:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=358s v=(0 0) 00010000:00010000:3.0:1788797069.272238:0:6683:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788797069.272248:0:6683:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c016a1a1/0xca7fc0c411f9421b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee12d5 expref: 8 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797069.272266:0:6683:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000c016a1a1/0xca7fc0c411f9421b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee12d5 expref: 8 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797069.272280:0:6683:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb077c69e00, rc 0) 00000100:00100000:3.0:1788797069.272348:0:6683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb07797bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e6d050bb-169e-4784-be5b-7071799bf3b0+8:11080:x1875689351498368:12345-192.168.204.38@tcp:101:bash.0 Request processed in 226us (631us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797069.272356:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 59 00000100:00080000:0.0:1788797069.272493:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788797069.282078:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1788797069.282330:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351498496 00000100:00100000:1.0:1788797069.282342:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351498496 00002000:00010000:1.0:1788797069.282395:0:6687:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/5 (0->18446744073709551615) 00002000:00100000:1.0:1788797069.282401:0:6687:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8cb048e2b100 with x1875689351498496 ext(0->18446744073709551615) 00002000:00010000:1.0:1788797069.282417:0:6687:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8cb048e2b100. 00000100:00100000:1.0:1788797069.282461:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 5 00000100:00100000:1.0:1788797069.282484:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb048e2b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e6d050bb-169e-4784-be5b-7071799bf3b0+8:2355:x1875689351498496:12345-192.168.204.38@tcp:10:bash.0 00002000:00010000:1.0:1788797069.283148:0:6687:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:1.0:1788797069.283155:0:6687:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 1788797067 -> 1788797069 00002000:00010000:1.0:1788797069.283158:0:6687:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 1788797065 -> 1788797065 00002000:00010000:1.0:1788797069.283161:0:6687:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1788797067 -> 1788797069 00002000:00010000:1.0:1788797069.283164:0:6687:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:1.0:1788797069.283238:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb048e2b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e6d050bb-169e-4784-be5b-7071799bf3b0+9:2355:x1875689351498496:12345-192.168.204.38@tcp:10:bash.0 Request processed in 755us (1207us total) trans 4294967318 rc 0/0 00000100:00100000:1.0:1788797069.283247:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 5 00002000:00010000:1.0:1788797069.283251:0:6687:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/5 (0->18446744073709551615) 00002000:00100000:1.0:1788797069.283268:0:6687:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8cb048e2b100 with x1875689351498496 ext(0->18446744073709551615) 00002000:00010000:1.0:1788797069.283275:0:6687:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8cb048e2b100. 00000100:00100000:2.0:1788797069.402229:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1788797069.402325:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351498624 00000100:00100000:1.0:1788797069.402337:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351498624 00000100:00100000:1.0:1788797069.402416:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 193 00000100:00100000:1.0:1788797069.402429:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb050386300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6d050bb-169e-4784-be5b-7071799bf3b0+32:11560:x1875689351498624:12345-192.168.204.38@tcp:34:lfs.0 00010000:00010000:1.0:1788797069.402521:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045c00/0xca7fc0c411f94222 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797069.402543:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045c00/0xca7fc0c411f94222 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797069.402555:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045c00/0xca7fc0c411f94222 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797069.402570:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045e00/0xca7fc0c411f94229 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797069.402578:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045e00/0xca7fc0c411f94229 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797069.402584:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045e00/0xca7fc0c411f94229 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797069.402900:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045200/0xca7fc0c411f94230 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797069.402911:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045200/0xca7fc0c411f94230 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797069.402919:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045200/0xca7fc0c411f94230 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788797069.402969:0:5825:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045200/0xca7fc0c411f94230 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797069.402980:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045c00/0xca7fc0c411f94222 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797069.402986:0:5825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045c00/0xca7fc0c411f94222 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797069.402992:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045c00/0xca7fc0c411f94222 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797069.402997:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb082045c00 already unused, calling callback (ffffffffc1f014f0) 00010000:00010000:1.0:1788797069.403002:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045c00/0xca7fc0c411f94222 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797069.403009:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045c00/0xca7fc0c411f94222 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797069.403021:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8cb058766500) 00010000:00010000:1.0:1788797069.403024:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788797069.403057:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045c00/0xca7fc0c411f94222 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797069.403063:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045c00/0xca7fc0c411f94222 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797069.403076:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045e00/0xca7fc0c411f94229 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797069.403082:0:5825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045e00/0xca7fc0c411f94229 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797069.403094:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045e00/0xca7fc0c411f94229 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797069.403100:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb082045e00 already unused, calling callback (ffffffffc1f014f0) 00010000:00010000:1.0:1788797069.403103:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045e00/0xca7fc0c411f94229 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797069.403108:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045e00/0xca7fc0c411f94229 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797069.403116:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8cb06ce84c00) 00010000:00010000:1.0:1788797069.403118:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788797069.403121:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045e00/0xca7fc0c411f94229 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797069.403125:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045e00/0xca7fc0c411f94229 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797069.403140:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045200/0xca7fc0c411f94230 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797069.403146:0:5825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045200/0xca7fc0c411f94230 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797069.403151:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045200/0xca7fc0c411f94230 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797069.403155:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb082045200 already unused, calling callback (ffffffffc1f014f0) 00010000:00010000:1.0:1788797069.403158:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045200/0xca7fc0c411f94230 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797069.403173:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045200/0xca7fc0c411f94230 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797069.403180:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cb058766100) 00010000:00010000:1.0:1788797069.403182:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788797069.403186:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045200/0xca7fc0c411f94230 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797069.403190:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045200/0xca7fc0c411f94230 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788797069.403279:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb050386300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6d050bb-169e-4784-be5b-7071799bf3b0+32:11560:x1875689351498624:12345-192.168.204.38@tcp:34:lfs.0 Request processed in 851us (1059us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797069.403288:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 193 00000100:00100000:2.0:1788797069.472522:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1788797069.473235:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351498880 00000100:00100000:0.0:1788797069.473246:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351498880 00000100:00100000:0.0:1788797069.473309:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 194 00000100:00100000:0.0:1788797069.473340:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb050385c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6d050bb-169e-4784-be5b-7071799bf3b0+32:11563:x1875689351498880:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1788797069.473367:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788797069.473393:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3a00/0xca7fc0c411f94237 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c99e04559ee12dc expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797069.473500:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3200/0xca7fc0c411f9423e lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797069.473519:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3200/0xca7fc0c411f9423e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797069.473532:0:5827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3200/0xca7fc0c411f9423e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797069.473548:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3000/0xca7fc0c411f94245 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797069.473555:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3000/0xca7fc0c411f94245 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797069.473562:0:5827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3000/0xca7fc0c411f94245 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797069.474150:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3600/0xca7fc0c411f9424c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797069.474161:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3600/0xca7fc0c411f9424c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797069.474170:0:5827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3600/0xca7fc0c411f9424c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788797069.474193:0:5827:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:0.0:1788797069.474291:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3200/0xca7fc0c411f9423e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797069.474299:0:5827:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3200/0xca7fc0c411f9423e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797069.474305:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3200/0xca7fc0c411f9423e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797069.474311:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb042ea3200 already unused, calling callback (ffffffffc1f014f0) 00010000:00010000:0.0:1788797069.474316:0:5827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3200/0xca7fc0c411f9423e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797069.474324:0:5827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3200/0xca7fc0c411f9423e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797069.474339:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8cb058766500) 00010000:00010000:0.0:1788797069.474342:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788797069.474347:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3200/0xca7fc0c411f9423e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797069.474352:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3200/0xca7fc0c411f9423e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797069.474367:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3000/0xca7fc0c411f94245 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797069.474373:0:5827:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3000/0xca7fc0c411f94245 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797069.474388:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3000/0xca7fc0c411f94245 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797069.474393:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb042ea3000 already unused, calling callback (ffffffffc1f014f0) 00010000:00010000:0.0:1788797069.474396:0:5827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3000/0xca7fc0c411f94245 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797069.474402:0:5827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3000/0xca7fc0c411f94245 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797069.474410:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8cb058766200) 00010000:00010000:0.0:1788797069.474412:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788797069.474415:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3000/0xca7fc0c411f94245 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797069.474420:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3000/0xca7fc0c411f94245 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797069.474479:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3a00/0xca7fc0c411f94237 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee12dc expref: 35 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797069.474496:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3600/0xca7fc0c411f9424c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee12dc expref: 34 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797069.474504:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cb058766100) 00010000:00010000:0.0:1788797069.474506:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1788797069.474508:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb042ea3600, rc 0) 00000100:00100000:0.0:1788797069.474913:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb050385c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6d050bb-169e-4784-be5b-7071799bf3b0+34:11563:x1875689351498880:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 1575us (2404us total) trans 4294967476 rc 0/0 00000100:00100000:0.0:1788797069.474934:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 194 00000100:00100000:3.0:1788797069.478208:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1788797069.478283:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351499008 00000100:00100000:0.0:1788797069.478296:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351499008 00000100:00100000:0.0:1788797069.478353:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 195 00000100:00100000:0.0:1788797069.478364:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb048e29180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6d050bb-169e-4784-be5b-7071799bf3b0+34:11563:x1875689351499008:12345-192.168.204.38@tcp:54:lfs.0 00010000:00010000:0.0:1788797069.478433:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2800/0xca7fc0c411f9425a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797069.478452:0:5825:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3800/0xca7fc0c411f941ff lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee12c7 expref: 34 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797069.478472:0:5825:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2800/0xca7fc0c411f9425a lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797069.478510:0:5825:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3800/0xca7fc0c411f941ff lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee12c7 expref: 34 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797069.478526:0:5825:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3800/0xca7fc0c411f941ff lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee12c7 expref: 34 pid: 5826 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788797069.478541:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb0794f7480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5825:1875689374558720:192.168.204.38@tcp:104: 00000100:00100000:0.0:1788797069.478628:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb06f1cf9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788797069.483829:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1788797069.483910:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb0794f7480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5825:1875689374558720:192.168.204.38@tcp:104: 00010000:00010000:0.0:1788797069.483938:0:5825:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2800/0xca7fc0c411f9425a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788797069.484060:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351499264 00000100:00100000:1.0:1788797069.484069:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351499264 00000100:00100000:1.0:1788797069.484125:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 52 00000100:00100000:1.0:1788797069.484137:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb077f0ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e6d050bb-169e-4784-be5b-7071799bf3b0+35:5608:x1875689351499264:12345-192.168.204.38@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1788797069.485292:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb077f0ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e6d050bb-169e-4784-be5b-7071799bf3b0+36:5608:x1875689351499264:12345-192.168.204.38@tcp:35:ldlm_bl.0 Request processed in 1150us (1463us total) trans 4294967477 rc 0/0 00000100:00100000:1.0:1788797069.485305:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 52 00000001:00080000:1.0:1788797069.485579:0:7640:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967306 is committed 00000001:00080000:1.0:1788797069.485592:0:7640:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967307 is committed 00000001:00080000:1.0:1788797069.485599:0:7640:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967305 is committed 00000100:00100000:3.0:1788797069.488735:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1788797069.489144:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351499392 00000100:00100000:1.0:1788797069.489157:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351499392 00010000:00010000:1.0:1788797069.489202:0:6698:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3800/0xca7fc0c411f941ff lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee12c7 expref: 36 pid: 5826 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788797069.489310:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 72 00000100:00100000:1.0:1788797069.489323:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb077f09880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e6d050bb-169e-4784-be5b-7071799bf3b0+36:2354:x1875689351499392:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788797069.489344:0:6698:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788797069.489351:0:6698:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3800/0xca7fc0c411f941ff lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee12c7 expref: 36 pid: 5826 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797069.489371:0:6698:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3800/0xca7fc0c411f941ff lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee12c7 expref: 36 pid: 5826 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797069.489407:0:6698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3800/0xca7fc0c411f941ff lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee12c7 expref: 36 pid: 5826 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797069.489423:0:6698:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cb058766100) 00010000:00010000:1.0:1788797069.489429:0:6698:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2800/0xca7fc0c411f9425a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797069.489441:0:6698:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2800/0xca7fc0c411f9425a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797069.489451:0:6698:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2800/0xca7fc0c411f9425a lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797069.489503:0:6698:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788797069.489614:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb077f09880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e6d050bb-169e-4784-be5b-7071799bf3b0+35:2354:x1875689351499392:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 293us (889us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797069.489624:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 72 00010000:00010000:0.0:1788797069.489688:0:5825:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2800/0xca7fc0c411f9425a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797069.489704:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2800/0xca7fc0c411f9425a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797069.489746:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2800/0xca7fc0c411f9425a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797069.489754:0:5825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2800/0xca7fc0c411f9425a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797069.489763:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2800/0xca7fc0c411f9425a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797069.489770:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb042ea2800 already unused, calling callback (ffffffffc1f014f0) 00010000:00010000:0.0:1788797069.489790:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2800/0xca7fc0c411f9425a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797069.489807:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2800/0xca7fc0c411f9425a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797069.489818:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cb058766100) 00010000:00010000:0.0:1788797069.489820:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788797069.489824:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2800/0xca7fc0c411f9425a lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797069.489830:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2800/0xca7fc0c411f9425a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788797069.489873:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb048e29180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6d050bb-169e-4784-be5b-7071799bf3b0+34:11563:x1875689351499008:12345-192.168.204.38@tcp:54:lfs.0 Request processed in 11511us (11676us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797069.489881:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 195 00000100:00100000:3.0:1788797069.493339:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1788797069.493933:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351499648 00000100:00100000:0.0:1788797069.493943:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351499648 00000100:00100000:0.0:1788797069.494062:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 53 00000100:00100000:0.0:1788797069.494073:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb077f0a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e6d050bb-169e-4784-be5b-7071799bf3b0+34:11563:x1875689351499648:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:0.0:1788797069.494372:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb077f0a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e6d050bb-169e-4784-be5b-7071799bf3b0+35:11563:x1875689351499648:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 299us (1047us total) trans 4294967478 rc 0/0 00000100:00100000:0.0:1788797069.494379:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 53 00000100:00100000:2.0:1788797069.680887:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1788797069.681088:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351499904 00000100:00100000:0.0:1788797069.681105:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351499904 00000100:00100000:0.0:1788797069.681193:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 196 00000100:00100000:0.0:1788797069.681207:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb050384a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6d050bb-169e-4784-be5b-7071799bf3b0+35:11574:x1875689351499904:12345-192.168.204.38@tcp:101:cat.0 00010000:00010000:0.0:1788797069.681244:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788797069.681275:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2800/0xca7fc0c411f94261 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c99e04559ee12e3 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797069.681383:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3a00/0xca7fc0c411f94268 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797069.681402:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3a00/0xca7fc0c411f94268 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797069.681416:0:5826:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3a00/0xca7fc0c411f94268 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797069.681432:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3000/0xca7fc0c411f9426f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797069.681438:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3000/0xca7fc0c411f9426f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797069.681478:0:5826:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3000/0xca7fc0c411f9426f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797069.682196:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3200/0xca7fc0c411f94276 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797069.682209:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3200/0xca7fc0c411f94276 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797069.682218:0:5826:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3200/0xca7fc0c411f94276 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788797069.682229:0:5826:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 8 00010000:00010000:0.0:1788797069.682321:0:5826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3a00/0xca7fc0c411f94268 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797069.682328:0:5826:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3a00/0xca7fc0c411f94268 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797069.682335:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3a00/0xca7fc0c411f94268 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797069.682348:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb042ea3a00 already unused, calling callback (ffffffffc1f014f0) 00010000:00010000:0.0:1788797069.682354:0:5826:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3a00/0xca7fc0c411f94268 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797069.682363:0:5826:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3a00/0xca7fc0c411f94268 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797069.682375:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8cb058766500) 00010000:00010000:0.0:1788797069.682378:0:5826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788797069.682391:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3a00/0xca7fc0c411f94268 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797069.682397:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3a00/0xca7fc0c411f94268 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797069.682412:0:5826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3000/0xca7fc0c411f9426f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797069.682418:0:5826:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3000/0xca7fc0c411f9426f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797069.682424:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3000/0xca7fc0c411f9426f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797069.682429:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb042ea3000 already unused, calling callback (ffffffffc1f014f0) 00010000:00010000:0.0:1788797069.682432:0:5826:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3000/0xca7fc0c411f9426f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797069.682438:0:5826:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3000/0xca7fc0c411f9426f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797069.682446:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8cb0821d4500) 00010000:00010000:0.0:1788797069.682448:0:5826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788797069.682452:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3000/0xca7fc0c411f9426f lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797069.682470:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3000/0xca7fc0c411f9426f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797069.682517:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2800/0xca7fc0c411f94261 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee12e3 expref: 38 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797069.682544:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3200/0xca7fc0c411f94276 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee12e3 expref: 37 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797069.682551:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cb058766100) 00010000:00010000:0.0:1788797069.682553:0:5826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788797069.682556:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb042ea3200, rc 0) 00000100:00100000:0.0:1788797069.683202:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb050384a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6d050bb-169e-4784-be5b-7071799bf3b0+37:11574:x1875689351499904:12345-192.168.204.38@tcp:101:cat.0 Request processed in 1995us (2321us total) trans 4294967479 rc 0/0 00000100:00100000:0.0:1788797069.683213:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 196 00000100:00100000:3.0:1788797069.697605:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1788797069.697779:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351500160 00000100:00100000:1.0:1788797069.697812:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351500160 00000100:00100000:1.0:1788797069.697888:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 54 00000100:00100000:1.0:1788797069.697899:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb077f08a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e6d050bb-169e-4784-be5b-7071799bf3b0+37:11574:x1875689351500160:12345-192.168.204.38@tcp:35:cat.0 00000100:00100000:1.0:1788797069.698278:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb077f08a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e6d050bb-169e-4784-be5b-7071799bf3b0+38:11574:x1875689351500160:12345-192.168.204.38@tcp:35:cat.0 Request processed in 379us (688us total) trans 4294967480 rc 0/0 00000100:00100000:1.0:1788797069.698287:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 54 00000100:00100000:1.0:1788797069.725196:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1788797069.725299:0:7636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351500416 00000100:00100000:3.0:1788797069.725327:0:7636:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351500416 00000100:00100000:3.0:1788797069.725395:0:7636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 197 00000100:00100000:3.0:1788797069.725407:0:7636:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb050380a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6d050bb-169e-4784-be5b-7071799bf3b0+38:11575:x1875689351500416:12345-192.168.204.38@tcp:36:rm.0 00010000:00010000:3.0:1788797069.725491:0:7636:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1788797069.725520:0:7636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3200/0xca7fc0c411f94276 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee12e3 expref: 38 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797069.725546:0:7636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3600/0xca7fc0c411f9424c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee12dc expref: 37 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797069.725558:0:7636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3400/0xca7fc0c411f94214 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee12ce expref: 36 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797069.725568:0:7636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cb058766100) 00010000:00010000:3.0:1788797069.725579:0:7636:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788797069.725601:0:7636:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c68a00/0xca7fc0c411f94284 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797069.725615:0:7636:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c68a00/0xca7fc0c411f94284 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797069.725626:0:7636:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c68a00/0xca7fc0c411f94284 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797069.725640:0:7636:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c68600/0xca7fc0c411f9428b lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797069.725647:0:7636:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c68600/0xca7fc0c411f9428b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797069.725666:0:7636:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c68600/0xca7fc0c411f9428b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797069.725937:0:7636:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c68000/0xca7fc0c411f94292 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797069.725946:0:7636:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c68000/0xca7fc0c411f94292 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797069.725952:0:7636:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c68000/0xca7fc0c411f94292 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788797069.726573:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].7, 64 off8712 00000004:00080000:3.0:1788797069.726584:0:7636:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 358732554109ns, next at 359732551769ns, rc = 0 00010000:00010000:3.0:1788797069.726640:0:7636:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69600/0xca7fc0c411f94299 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797069.726649:0:7636:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69600/0xca7fc0c411f94299 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797069.726657:0:7636:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69600/0xca7fc0c411f94299 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797069.726665:0:7636:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69600/0xca7fc0c411f94299 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797069.726671:0:7636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69600/0xca7fc0c411f94299 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797069.726677:0:7636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69600/0xca7fc0c411f94299 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797069.726706:0:7636:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788797069.726728:0:7636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c68000/0xca7fc0c411f94292 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797069.726735:0:7636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c68000/0xca7fc0c411f94292 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797069.726742:0:7636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c68000/0xca7fc0c411f94292 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797069.726747:0:7636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb077c68000 already unused, calling callback (ffffffffc1f014f0) 00010000:00010000:3.0:1788797069.726752:0:7636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c68000/0xca7fc0c411f94292 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797069.726760:0:7636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c68000/0xca7fc0c411f94292 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797069.726770:0:7636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cb065cc2300) 00010000:00010000:3.0:1788797069.726774:0:7636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1788797069.726778:0:7636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c68000/0xca7fc0c411f94292 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797069.726784:0:7636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c68000/0xca7fc0c411f94292 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797069.726799:0:7636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c68a00/0xca7fc0c411f94284 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797069.726805:0:7636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c68a00/0xca7fc0c411f94284 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797069.726811:0:7636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c68a00/0xca7fc0c411f94284 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797069.726822:0:7636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb077c68a00 already unused, calling callback (ffffffffc1f014f0) 00010000:00010000:3.0:1788797069.726825:0:7636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c68a00/0xca7fc0c411f94284 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797069.726831:0:7636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c68a00/0xca7fc0c411f94284 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797069.726839:0:7636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8cb058766500) 00010000:00010000:3.0:1788797069.726841:0:7636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788797069.726844:0:7636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c68a00/0xca7fc0c411f94284 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797069.726850:0:7636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c68a00/0xca7fc0c411f94284 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788797069.726860:0:7636:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004fdfb0c8 reply state 0000000081070491 transno 4294967481 ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c68600/0xca7fc0c411f9428b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788797069.726868:0:7636:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788797069.726963:0:7636:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb050380a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6d050bb-169e-4784-be5b-7071799bf3b0+37:11575:x1875689351500416:12345-192.168.204.38@tcp:36:rm.0 Request processed in 1556us (1779us total) trans 4294967481 rc 0/0 00000100:00100000:3.0:1788797069.726972:0:7636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 197 00010000:00010000:1.0:1788797069.727633:0:8446:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788797069.727640:0:8446:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69600/0xca7fc0c411f94299 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797069.727649:0:8446:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb077c69600 already unused, calling callback (ffffffffc14d98b0) 00010000:00010000:1.0:1788797069.727652:0:8446:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69600/0xca7fc0c411f94299 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797069.727659:0:8446:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69600/0xca7fc0c411f94299 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797069.727672:0:8446:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cb065cc2300) 00010000:00010000:1.0:1788797069.727675:0:8446:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788797069.727678:0:8446:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69600/0xca7fc0c411f94299 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797069.727684:0:8446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69600/0xca7fc0c411f94299 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797069.727700:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788797069.727702:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788797069.727704:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788797069.729981:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c68600/0xca7fc0c411f9428b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797069.729997:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c68600/0xca7fc0c411f9428b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797069.730012:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c68600/0xca7fc0c411f9428b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797069.730060:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb077c68600 already unused, calling callback (ffffffffc1f014f0) 00010000:00010000:3.0:1788797069.730065:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c68600/0xca7fc0c411f9428b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797069.730072:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c68600/0xca7fc0c411f9428b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797069.730091:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8cb065cc2c00) 00010000:00010000:3.0:1788797069.730094:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788797069.730098:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c68600/0xca7fc0c411f9428b lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797069.730105:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c68600/0xca7fc0c411f9428b lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788797069.799685:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1788797069.799820:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351500672 00000100:00100000:0.0:1788797069.799831:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351500672 00000100:00100000:0.0:1788797069.799892:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 198 00000100:00100000:0.0:1788797069.799902:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb050382300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6d050bb-169e-4784-be5b-7071799bf3b0+36:11581:x1875689351500672:12345-192.168.204.38@tcp:101:bash.0 00010000:00010000:0.0:1788797069.799937:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788797069.799960:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2800/0xca7fc0c411f942a0 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c99e04559ee12ea expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797069.800133:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3000/0xca7fc0c411f942a7 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797069.800149:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3000/0xca7fc0c411f942a7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797069.800161:0:5826:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3000/0xca7fc0c411f942a7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797069.800174:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3a00/0xca7fc0c411f942ae lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797069.800187:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3a00/0xca7fc0c411f942ae lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797069.800193:0:5826:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3a00/0xca7fc0c411f942ae lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788797069.800882:0:5826:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5:0x0], index 1: 0 00010000:00010000:0.0:1788797069.801259:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2a00/0xca7fc0c411f942b5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797069.801271:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2a00/0xca7fc0c411f942b5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797069.801280:0:5826:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2a00/0xca7fc0c411f942b5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797069.801312:0:5826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3000/0xca7fc0c411f942a7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797069.801319:0:5826:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3000/0xca7fc0c411f942a7 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797069.801326:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3000/0xca7fc0c411f942a7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797069.801332:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb042ea3000 already unused, calling callback (ffffffffc1f014f0) 00010000:00010000:0.0:1788797069.801336:0:5826:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3000/0xca7fc0c411f942a7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797069.801345:0:5826:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3000/0xca7fc0c411f942a7 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797069.801370:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8cb058766500) 00010000:00010000:0.0:1788797069.801372:0:5826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788797069.801378:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3000/0xca7fc0c411f942a7 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797069.801384:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3000/0xca7fc0c411f942a7 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788797069.801403:0:5826:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ffc823c6 reply state 000000007b480465 transno 4294967482 ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3a00/0xca7fc0c411f942ae lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788797069.801413:0:5826:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788797069.801447:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2800/0xca7fc0c411f942a0 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee12ea expref: 39 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797069.801472:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2a00/0xca7fc0c411f942b5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee12ea expref: 38 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797069.801482:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8cb0821d4000) 00010000:00010000:0.0:1788797069.801484:0:5826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788797069.801487:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb042ea2a00, rc 0) 00000100:00100000:0.0:1788797069.801576:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb050382300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6d050bb-169e-4784-be5b-7071799bf3b0+39:11581:x1875689351500672:12345-192.168.204.38@tcp:101:bash.0 Request processed in 1676us (1902us total) trans 4294967482 rc 0/0 00000100:00100000:0.0:1788797069.801585:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 198 00000100:00100000:2.0:1788797069.810300:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00010000:00010000:3.0:1788797069.810679:0:3286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3a00/0xca7fc0c411f942ae lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797069.810695:0:3286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3a00/0xca7fc0c411f942ae lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797069.810704:0:3286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3a00/0xca7fc0c411f942ae lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797069.810711:0:3286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb042ea3a00 already unused, calling callback (ffffffffc1f014f0) 00010000:00010000:3.0:1788797069.810717:0:3286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3a00/0xca7fc0c411f942ae lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797069.810725:0:3286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3a00/0xca7fc0c411f942ae lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797069.810757:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8cb0821d4500) 00010000:00010000:3.0:1788797069.810760:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788797069.810777:0:3286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3a00/0xca7fc0c411f942ae lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797069.810784:0:3286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3a00/0xca7fc0c411f942ae lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788797069.810959:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351500800 00000100:00100000:0.0:1788797069.810971:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351500800 00000100:00100000:0.0:1788797069.811069:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 60 00000100:00100000:0.0:1788797069.811081:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb050384700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e6d050bb-169e-4784-be5b-7071799bf3b0+5:2353:x1875689351500800:12345-192.168.204.38@tcp:101:bash.0 00010000:00010000:0.0:1788797069.811108:0:6681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788797069.811128:0:6681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f98c5653/0xca7fc0c411f942c3 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7c99e04559ee12f1 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788797069.811160:0:6681:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788797069.811183:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=358s v=(0 0) 00010000:00010000:0.0:1788797069.811188:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788797069.811199:0:6681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f98c5653/0xca7fc0c411f942c3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee12f1 expref: 6 pid: 6681 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797069.811219:0:6681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f98c5653/0xca7fc0c411f942c3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee12f1 expref: 6 pid: 6681 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797069.811232:0:6681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb042ea2800, rc 0) 00000100:00100000:0.0:1788797069.811299:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb050384700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e6d050bb-169e-4784-be5b-7071799bf3b0+6:2353:x1875689351500800:12345-192.168.204.38@tcp:101:bash.0 Request processed in 221us (1013us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797069.811307:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 60 00000100:00080000:3.0:1788797069.811473:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788797069.815656:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1788797069.815826:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351500928 00000100:00100000:3.0:1788797069.815844:0:6683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351500928 00000100:00100000:3.0:1788797069.815948:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 61 00000100:00100000:3.0:1788797069.815960:0:6683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb050385180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e6d050bb-169e-4784-be5b-7071799bf3b0+6:11581:x1875689351500928:12345-192.168.204.38@tcp:101:bash.0 00010000:00010000:3.0:1788797069.815988:0:6683:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788797069.816020:0:6683:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000aa01bdc0/0xca7fc0c411f942ca lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7c99e04559ee12f8 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797069.816094:0:6683:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f98c5653/0xca7fc0c411f942c3 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee12f1 expref: 7 pid: 6681 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797069.816105:0:6683:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788797069.816110:0:6683:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788797069.816116:0:6683:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000aa01bdc0/0xca7fc0c411f942ca lrc: 4/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee12f8 expref: 7 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797069.816165:0:6683:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f98c5653/0xca7fc0c411f942c3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee12f1 expref: 7 pid: 6681 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797069.816207:0:6683:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f98c5653/0xca7fc0c411f942c3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee12f1 expref: 7 pid: 6681 timeout: 458 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788797069.816223:0:6683:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb077f0a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6683:1875689374558848:192.168.204.38@tcp:104: 00000100:00100000:3.0:1788797069.816348:0:6683:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb079a91b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788797069.819833:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1788797069.819958:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351501056 00000100:00100000:1.0:1788797069.819970:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351501056 00010000:00010000:1.0:1788797069.820021:0:5812:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f98c5653/0xca7fc0c411f942c3 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee12f1 expref: 8 pid: 6681 timeout: 458 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788797069.820097:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 73 00000100:00100000:1.0:1788797069.820111:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb050387480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e6d050bb-169e-4784-be5b-7071799bf3b0+8:2354:x1875689351501056:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788797069.820129:0:5812:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788797069.820161:0:5812:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f98c5653/0xca7fc0c411f942c3 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee12f1 expref: 8 pid: 6681 timeout: 458 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797069.820176:0:5812:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f98c5653/0xca7fc0c411f942c3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee12f1 expref: 8 pid: 6681 timeout: 458 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797069.820203:0:5812:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788797069.820208:0:5812:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788797069.820217:0:5812:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000aa01bdc0/0xca7fc0c411f942ca lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee12f8 expref: 8 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797069.820227:0:5812:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000aa01bdc0/0xca7fc0c411f942ca lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee12f8 expref: 8 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797069.820289:0:5812:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000aa01bdc0/0xca7fc0c411f942ca lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee12f8 expref: 8 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788797069.820304:0:5812:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb050383100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5812:1875689374558976:192.168.204.38@tcp:105: 00000100:00100000:1.0:1788797069.820416:0:5812:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb0436049c0 going to sleep for 11 seconds 00010000:00010000:3.0:1788797069.821257:0:6683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f98c5653/0xca7fc0c411f942c3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee12f1 expref: 8 pid: 6681 timeout: 458 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788797069.821279:0:6683:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb077f0a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6683:1875689374558848:192.168.204.38@tcp:104: 00010000:00010000:3.0:1788797069.821310:0:6683:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000aa01bdc0/0xca7fc0c411f942ca lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee12f8 expref: 7 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797069.821323:0:6683:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb077c68600, rc 0) 00000100:00100000:3.0:1788797069.821377:0:6683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb050385180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e6d050bb-169e-4784-be5b-7071799bf3b0+7:11581:x1875689351500928:12345-192.168.204.38@tcp:101:bash.0 Request processed in 5419us (5733us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797069.821386:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 61 00000100:00100000:1.0:1788797069.823141:0:5812:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb050383100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5812:1875689374558976:192.168.204.38@tcp:105: 00010000:00010000:1.0:1788797069.823242:0:5812:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788797069.823313:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb050387480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e6d050bb-169e-4784-be5b-7071799bf3b0+6:2354:x1875689351501056:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 3203us (3494us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797069.823327:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 73 00000100:00100000:0.0:1788797069.842450:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1788797069.843610:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351501312 00000100:00100000:1.0:1788797069.843624:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351501312 00000100:00100000:1.0:1788797069.843958:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 55 00000100:00100000:1.0:1788797069.843973:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0794f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e6d050bb-169e-4784-be5b-7071799bf3b0+38:11581:x1875689351501312:12345-192.168.204.38@tcp:35:bash.0 00000100:00100000:1.0:1788797069.844537:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0794f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e6d050bb-169e-4784-be5b-7071799bf3b0+39:11581:x1875689351501312:12345-192.168.204.38@tcp:35:bash.0 Request processed in 567us (2096us total) trans 4294967483 rc 0/0 00000100:00100000:1.0:1788797069.844546:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 55 00000100:00100000:2.0:1788797070.096997:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1788797070.097123:0:7636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351501440 00000100:00100000:3.0:1788797070.097135:0:7636:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351501440 00000100:00100000:3.0:1788797070.097216:0:7636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 199 00000100:00100000:3.0:1788797070.097228:0:7636:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb080685880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6d050bb-169e-4784-be5b-7071799bf3b0+39:11597:x1875689351501440:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1788797070.097254:0:7636:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788797070.097277:0:7636:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c68000/0xca7fc0c411f942d1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c99e04559ee12ff expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797070.097365:0:7636:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c68e00/0xca7fc0c411f942d8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797070.097379:0:7636:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c68e00/0xca7fc0c411f942d8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797070.097392:0:7636:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c68e00/0xca7fc0c411f942d8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788797070.097428:0:7636:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:3.0:1788797070.097431:0:7636:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788797070.097449:0:7636:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c68e00/0xca7fc0c411f942d8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797070.097486:0:7636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c68000/0xca7fc0c411f942d1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee12ff expref: 41 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797070.097505:0:7636:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c68e00/0xca7fc0c411f942d8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee12ff expref: 40 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797070.097514:0:7636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8cb058766500) 00010000:00010000:3.0:1788797070.097517:0:7636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788797070.097521:0:7636:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb077c68e00, rc 0) 00000100:00100000:3.0:1788797070.097589:0:7636:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb080685880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6d050bb-169e-4784-be5b-7071799bf3b0+40:11597:x1875689351501440:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 363us (601us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797070.097596:0:7636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 199 00000100:00080000:0.0:1788797070.098293:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788797070.105119:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1788797070.105214:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351501696 00000100:00100000:0.0:1788797070.105224:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351501696 00000100:00100000:0.0:1788797070.105294:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 200 00000100:00100000:0.0:1788797070.105304:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb077f0a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6d050bb-169e-4784-be5b-7071799bf3b0+40:11597:x1875689351501696:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1788797070.105325:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788797070.105347:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3c00/0xca7fc0c411f942df lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c99e04559ee1306 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797070.105481:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2800/0xca7fc0c411f942e6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797070.105495:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2800/0xca7fc0c411f942e6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797070.105508:0:5826:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2800/0xca7fc0c411f942e6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788797070.105756:0:5826:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:0.0:1788797070.106092:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3c00/0xca7fc0c411f942df lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1306 expref: 43 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797070.106118:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2800/0xca7fc0c411f942e6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1306 expref: 42 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797070.106129:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8cb0821d4000) 00010000:00010000:0.0:1788797070.106132:0:5826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788797070.106136:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb042ea2800, rc 0) 00000100:00100000:0.0:1788797070.106222:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb077f0a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6d050bb-169e-4784-be5b-7071799bf3b0+42:11597:x1875689351501696:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 920us (1114us total) trans 4294967484 rc 0/0 00000100:00100000:0.0:1788797070.106231:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 200 00000100:00100000:2.0:1788797070.110839:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1788797070.111638:0:7636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351501952 00000100:00100000:3.0:1788797070.111672:0:7636:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351501952 00000100:00100000:3.0:1788797070.111749:0:7636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 201 00000100:00100000:3.0:1788797070.111774:0:7636:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb080686300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6d050bb-169e-4784-be5b-7071799bf3b0+42:11597:x1875689351501952:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1788797070.111805:0:7636:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788797070.111831:0:7636:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c68000/0xca7fc0c411f942f4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c99e04559ee130d expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797070.111954:0:7636:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69a00/0xca7fc0c411f942fb lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797070.111971:0:7636:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69a00/0xca7fc0c411f942fb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797070.111982:0:7636:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69a00/0xca7fc0c411f942fb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788797070.111994:0:7636:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:3.0:1788797070.112399:0:7636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c68000/0xca7fc0c411f942f4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee130d expref: 45 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797070.112419:0:7636:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69a00/0xca7fc0c411f942fb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee130d expref: 44 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797070.112428:0:7636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8cb0821d4000) 00010000:00010000:3.0:1788797070.112431:0:7636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1788797070.112435:0:7636:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb077c69a00, rc 0) 00000100:00100000:3.0:1788797070.112776:0:7636:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb080686300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6d050bb-169e-4784-be5b-7071799bf3b0+44:11597:x1875689351501952:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 1015us (1946us total) trans 4294967485 rc 0/0 00000100:00100000:3.0:1788797070.112786:0:7636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 201 00000100:00100000:3.0:1788797070.122273:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1788797070.123435:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351502080 00000100:00100000:1.0:1788797070.123461:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351502080 00000100:00100000:1.0:1788797070.123545:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 15 00000100:00100000:1.0:1788797070.123558:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb077f0b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e6d050bb-169e-4784-be5b-7071799bf3b0+44:2354:x1875689351502080:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788797070.123577:0:5813:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788797070.123607:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2800/0xca7fc0c411f942e6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1306 expref: 44 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797070.123631:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8cb0821d4000) 00010000:00010000:1.0:1788797070.123638:0:5813:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788797070.123719:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb077f0b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e6d050bb-169e-4784-be5b-7071799bf3b0+43:2354:x1875689351502080:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 163us (1464us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797070.123727:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 15 00010000:00010000:0.0:1788797070.130176:0:5815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788797070.132402:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1788797070.138892:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351502208 00000100:00100000:0.0:1788797070.138907:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351502208 00000100:00100000:0.0:1788797070.138990:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 62 00000100:00100000:0.0:1788797070.139002:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb080684e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e6d050bb-169e-4784-be5b-7071799bf3b0+6:2352:x1875689351502208:12345-192.168.204.38@tcp:1:lfs.0 00010000:00010000:0.0:1788797070.139109:0:6681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fad4e8de/0xca7fc0c411f94309 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797070.139140:0:6681:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000aa01bdc0/0xca7fc0c411f942ca lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee12f8 expref: 6 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797070.139151:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1788797070.139155:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788797070.139160:0:6681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fad4e8de/0xca7fc0c411f94309 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797070.139198:0:6681:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000aa01bdc0/0xca7fc0c411f942ca lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee12f8 expref: 6 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797070.139213:0:6681:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000aa01bdc0/0xca7fc0c411f942ca lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee12f8 expref: 6 pid: 6683 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788797070.139229:0:6681:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb0794f6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6681:1875689374559104:192.168.204.38@tcp:104: 00000100:00100000:0.0:1788797070.139878:0:6681:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb06f1cf840 going to sleep for 11 seconds 00000100:00100000:3.0:1788797070.152558:0:6681:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb0794f6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6681:1875689374559104:192.168.204.38@tcp:104: 00010000:00010000:3.0:1788797070.152594:0:6681:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000fad4e8de/0xca7fc0c411f94309 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788797070.157584:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1788797070.157706:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351502336 00000100:00100000:1.0:1788797070.157718:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351502336 00002000:00100000:1.0:1788797070.157904:0:6688:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff8cb080685500 x1875689351502336/t0(0) o4->e6d050bb-169e-4784-be5b-7071799bf3b0@192.168.204.38@tcp:496/0 lens 504/0 e 0 to 0 dl 1788797081 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788797070.157917:0:6688:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8cb080685500 with x1875689351502336 ext(0->8) 00010000:00010000:1.0:1788797070.157929:0:6688:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000aa01bdc0/0xca7fc0c411f942ca lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee12f8 expref: 7 pid: 6683 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797070.157948:0:6688:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000aa01bdc0/0xca7fc0c411f942ca lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee12f8 expref: 7 pid: 6683 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788797070.157957:0:6688:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8cb080685500 00000100:00100000:1.0:1788797070.157995:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3 00000100:00100000:1.0:1788797070.158005:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb080685500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:e6d050bb-169e-4784-be5b-7071799bf3b0+7:2355:x1875689351502336:12345-192.168.204.38@tcp:4:lfs.0 00000100:00100000:1.0:1788797070.159020:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb080685500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:e6d050bb-169e-4784-be5b-7071799bf3b0+9:2355:x1875689351502336:12345-192.168.204.38@tcp:4:lfs.0 Request processed in 1012us (1443us total) trans 4294967308 rc 0/0 00000100:00100000:1.0:1788797070.159061:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3 00002000:00100000:1.0:1788797070.159071:0:6688:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff8cb080685500 x1875689351502336/t4294967308(0) o4->e6d050bb-169e-4784-be5b-7071799bf3b0@192.168.204.38@tcp:496/0 lens 504/448 e 0 to 0 dl 1788797081 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788797070.159081:0:6688:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8cb080685500 with x1875689351502336 ext(0->8) 00010000:00010000:1.0:1788797070.159090:0:6688:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000aa01bdc0/0xca7fc0c411f942ca lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee12f8 expref: 9 pid: 6683 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797070.159108:0:6688:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000aa01bdc0/0xca7fc0c411f942ca lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee12f8 expref: 9 pid: 6683 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788797070.159133:0:6688:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8cb080685500 00000100:00100000:0.0:1788797070.172100:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1788797070.172917:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351502464 00000100:00100000:1.0:1788797070.172929:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351502464 00010000:00010000:1.0:1788797070.172974:0:6698:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000aa01bdc0/0xca7fc0c411f942ca lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee12f8 expref: 9 pid: 6683 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788797070.173022:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 74 00000100:00100000:1.0:1788797070.173063:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0484c7850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e6d050bb-169e-4784-be5b-7071799bf3b0+9:2353:x1875689351502464:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788797070.173081:0:6698:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1788797070.173105:0:6698:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1788797070.173108:0:6698:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1788797070 00002000:00010000:1.0:1788797070.173111:0:6698:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 1788797070 00002000:00010000:1.0:1788797070.173113:0:6698:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 0 -> 1788797070 00010000:00010000:1.0:1788797070.173120:0:6698:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000aa01bdc0/0xca7fc0c411f942ca lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee12f8 expref: 9 pid: 6683 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797070.173135:0:6698:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000aa01bdc0/0xca7fc0c411f942ca lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee12f8 expref: 9 pid: 6683 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797070.173163:0:6698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000aa01bdc0/0xca7fc0c411f942ca lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee12f8 expref: 9 pid: 6683 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797070.173182:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788797070.173187:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788797070.173194:0:6698:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000fad4e8de/0xca7fc0c411f94309 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797070.173219:0:6698:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fad4e8de/0xca7fc0c411f94309 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797070.173362:0:6698:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788797070.173428:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0484c7850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e6d050bb-169e-4784-be5b-7071799bf3b0+8:2353:x1875689351502464:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 368us (1340us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797070.173437:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 74 00010000:00010000:3.0:1788797070.180205:0:6681:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000fad4e8de/0xca7fc0c411f94309 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797070.180227:0:6681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fad4e8de/0xca7fc0c411f94309 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797070.180271:0:6681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fad4e8de/0xca7fc0c411f94309 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797070.180281:0:6681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fad4e8de/0xca7fc0c411f94309 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797070.180291:0:6681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fad4e8de/0xca7fc0c411f94309 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797070.180298:0:6681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb042ea3000 already unused, calling callback (ffffffffc14d98b0) 00010000:00010000:3.0:1788797070.180310:0:6681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fad4e8de/0xca7fc0c411f94309 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797070.180319:0:6681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fad4e8de/0xca7fc0c411f94309 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797070.180400:0:6681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fad4e8de/0xca7fc0c411f94309 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797070.180407:0:6681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fad4e8de/0xca7fc0c411f94309 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788797070.180580:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb080684e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e6d050bb-169e-4784-be5b-7071799bf3b0+7:2352:x1875689351502208:12345-192.168.204.38@tcp:1:lfs.0 Request processed in 41574us (48183us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797070.180590:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 62 00000100:00100000:0.0:1788797070.184639:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1788797070.184722:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351502720 00000100:00100000:3.0:1788797070.184732:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351502720 00000100:00100000:3.0:1788797070.184800:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 56 00000100:00100000:3.0:1788797070.184810:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb050635050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e6d050bb-169e-4784-be5b-7071799bf3b0+43:11597:x1875689351502720:12345-192.168.204.38@tcp:35:lfs.0 00000004:00010000:3.0:1788797070.184882:0:5828:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69a00/0xca7fc0c411f942fb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee130d expref: 43 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788797070.185206:0:5828:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967486 00000001:00080000:3.0:1788797070.185247:0:5828:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967487 00000001:00080000:3.0:1788797070.185603:0:5828:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967488 00010000:00010000:3.0:1788797070.185657:0:5828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c68000/0xca7fc0c411f94310 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797070.185675:0:5828:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2a00/0xca7fc0c411f942b5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee12ea expref: 47 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797070.185684:0:5828:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c68000/0xca7fc0c411f94310 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797070.185737:0:5828:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2a00/0xca7fc0c411f942b5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee12ea expref: 47 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797070.185753:0:5828:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2a00/0xca7fc0c411f942b5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee12ea expref: 47 pid: 5826 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788797070.185770:0:5828:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb077f09880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5828:1875689374559232:192.168.204.38@tcp:104: 00000100:00100000:3.0:1788797070.185862:0:5828:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb0411ca240 going to sleep for 11 seconds 00000100:00100000:3.0:1788797070.193197:0:5828:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb077f09880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5828:1875689374559232:192.168.204.38@tcp:104: 00010000:00010000:3.0:1788797070.193234:0:5828:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c68000/0xca7fc0c411f94310 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788797070.199397:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1788797070.199625:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351502848 00000100:00100000:1.0:1788797070.199639:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351502848 00010000:00010000:1.0:1788797070.199691:0:5812:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2a00/0xca7fc0c411f942b5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee12ea expref: 48 pid: 5826 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788797070.199741:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 75 00000100:00100000:1.0:1788797070.199753:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0794f6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e6d050bb-169e-4784-be5b-7071799bf3b0+48:2355:x1875689351502848:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788797070.199776:0:5812:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788797070.199793:0:5812:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2a00/0xca7fc0c411f942b5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee12ea expref: 48 pid: 5826 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797070.199808:0:5812:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2a00/0xca7fc0c411f942b5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee12ea expref: 48 pid: 5826 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797070.199835:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2a00/0xca7fc0c411f942b5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee12ea expref: 48 pid: 5826 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797070.199853:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8cb0821d4000) 00010000:00010000:1.0:1788797070.199875:0:5812:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c68000/0xca7fc0c411f94310 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797070.199887:0:5812:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c68000/0xca7fc0c411f94310 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797070.199895:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c68000/0xca7fc0c411f94310 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797070.199932:0:5812:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788797070.199998:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0794f6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e6d050bb-169e-4784-be5b-7071799bf3b0+47:2355:x1875689351502848:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 247us (614us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797070.200007:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 75 00010000:00010000:3.0:1788797070.200462:0:5828:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c68000/0xca7fc0c411f94310 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797070.200471:0:5828:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c68000/0xca7fc0c411f94310 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788797070.200618:0:5828:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00000001:00080000:3.0:1788797070.200877:0:5828:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00000100:00100000:3.0:1788797070.201004:0:5828:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb077f09880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5828:1875689374559360:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1788797070.201357:0:5828:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788797070.201388:0:5828:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb0411cab40 going to sleep for 11 seconds 00000100:00100000:1.0:1788797070.201939:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374559360 00000100:00100000:1.0:1788797070.201948:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374559360 00000100:00100000:1.0:1788797070.202066:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788797070.202078:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb077f0b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5828:x1875689374559360:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1788797070.202375:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb077f0b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5828:x1875689374559360:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 299us (1195us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797070.202382:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:3.0:1788797070.202927:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788797070.202963:0:5828:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967307 gen 2 00000004:00080000:3.0:1788797070.202970:0:5828:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967307 00000004:00080000:3.0:1788797070.202997:0:5828:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8cb079bc0a80, transno 4294967307 00000100:00100000:3.0:1788797070.203062:0:5828:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb077f09880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5828:1875689374559360:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1788797070.222516:0:5828:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00000100:00100000:2.0:1788797070.222663:0:5828:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb0778ddf80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5828:1875689374559488:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1788797070.222755:0:5828:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788797070.223469:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374559488 00000100:00100000:0.0:1788797070.223481:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374559488 00000100:00100000:0.0:1788797070.223555:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788797070.223566:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0778df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5828:x1875689374559488:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1788797070.223816:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0778df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5828:x1875689374559488:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 251us (1060us total) trans 4294967309 rc 0/0 00000100:00100000:0.0:1788797070.223824:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788797070.225630:0:5828:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb0484facc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788797070.225703:0:5828:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb0778ddf80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5828:1875689374559488:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1788797070.227355:0:5828:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00010000:00010000:2.0:1788797070.227471:0:5828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c68000/0xca7fc0c411f94310 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797070.227486:0:5828:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c68000/0xca7fc0c411f94310 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797070.227495:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c68000/0xca7fc0c411f94310 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797070.227502:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb077c68000 already unused, calling callback (ffffffffc1f014f0) 00010000:00010000:2.0:1788797070.227508:0:5828:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c68000/0xca7fc0c411f94310 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797070.227517:0:5828:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c68000/0xca7fc0c411f94310 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797070.227537:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8cb0821d4000) 00010000:00010000:2.0:1788797070.227540:0:5828:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1788797070.227544:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c68000/0xca7fc0c411f94310 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797070.227551:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c68000/0xca7fc0c411f94310 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788797070.228752:0:5828:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1788797070.229072:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 64 off8512 00000004:00080000:2.0:1788797070.229086:0:5828:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 359235056466ns, next at 360235053256ns, rc = 0 00000001:00080000:2.0:1788797070.229096:0:5828:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00010000:00010000:2.0:1788797070.229151:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8cb0821d4000) 00010000:00010000:2.0:1788797070.229155:0:5828:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1788797070.229180:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69a00/0xca7fc0c411f942fb lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee130d expref: 51 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788797070.229322:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb050635050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e6d050bb-169e-4784-be5b-7071799bf3b0+50:11597:x1875689351502720:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 44512us (44695us total) trans 4294967494 rc 0/0 00000100:00100000:2.0:1788797070.229333:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 56 00000020:00080000:2.0:1788797070.229339:0:5828:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1788797070.237244:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1788797070.240974:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351502976 00000100:00100000:3.0:1788797070.240991:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351502976 00000100:00100000:3.0:1788797070.241211:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 202 00000100:00100000:3.0:1788797070.241223:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0794f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6d050bb-169e-4784-be5b-7071799bf3b0+50:11597:x1875689351502976:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1788797070.241250:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788797070.241276:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c68400/0xca7fc0c411f94317 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c99e04559ee1314 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797070.241350:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c68400/0xca7fc0c411f94317 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1314 expref: 51 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797070.241370:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c68400/0xca7fc0c411f94317 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1314 expref: 51 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797070.241394:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8cb065cc2c00) 00010000:00010000:3.0:1788797070.241399:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788797070.241403:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb077c68400, rc 0) 00000100:00100000:3.0:1788797070.241495:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0794f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6d050bb-169e-4784-be5b-7071799bf3b0+51:11597:x1875689351502976:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 274us (4262us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797070.241502:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 202 00000100:00100000:0.0:1788797070.248594:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1788797070.248677:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351503232 00000100:00100000:1.0:1788797070.248688:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351503232 00000100:00100000:1.0:1788797070.248746:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 57 00000100:00100000:1.0:1788797070.248756:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0794f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e6d050bb-169e-4784-be5b-7071799bf3b0+51:11597:x1875689351503232:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:0.0:1788797070.249525:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0794f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e6d050bb-169e-4784-be5b-7071799bf3b0+52:11597:x1875689351503232:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 765us (937us total) trans 4294967495 rc 0/0 00000100:00100000:0.0:1788797070.249534:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 57 00000100:00100000:2.0:1788797070.382164:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1788797070.382360:0:7636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351503360 00000100:00100000:3.0:1788797070.382371:0:7636:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351503360 00000100:00100000:3.0:1788797070.382434:0:7636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 203 00000100:00100000:3.0:1788797070.382455:0:7636:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0778df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6d050bb-169e-4784-be5b-7071799bf3b0+52:11607:x1875689351503360:12345-192.168.204.38@tcp:34:lfs.0 00010000:00010000:3.0:1788797070.382532:0:7636:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69c00/0xca7fc0c411f9431e lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797070.382567:0:7636:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69c00/0xca7fc0c411f9431e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797070.382591:0:7636:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69c00/0xca7fc0c411f9431e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797070.382610:0:7636:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c68200/0xca7fc0c411f94325 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797070.382618:0:7636:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c68200/0xca7fc0c411f94325 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797070.382626:0:7636:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c68200/0xca7fc0c411f94325 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797070.382716:0:7636:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69400/0xca7fc0c411f9432c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797070.382724:0:7636:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69400/0xca7fc0c411f9432c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797070.382732:0:7636:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69400/0xca7fc0c411f9432c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788797070.382792:0:7636:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69400/0xca7fc0c411f9432c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797070.382806:0:7636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69c00/0xca7fc0c411f9431e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797070.382813:0:7636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69c00/0xca7fc0c411f9431e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797070.382831:0:7636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69c00/0xca7fc0c411f9431e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797070.382838:0:7636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb077c69c00 already unused, calling callback (ffffffffc1f014f0) 00010000:00010000:3.0:1788797070.382843:0:7636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69c00/0xca7fc0c411f9431e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797070.382851:0:7636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69c00/0xca7fc0c411f9431e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797070.382864:0:7636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8cb058766500) 00010000:00010000:3.0:1788797070.382867:0:7636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788797070.382872:0:7636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69c00/0xca7fc0c411f9431e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797070.382879:0:7636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69c00/0xca7fc0c411f9431e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797070.382894:0:7636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c68200/0xca7fc0c411f94325 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797070.382901:0:7636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c68200/0xca7fc0c411f94325 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797070.382908:0:7636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c68200/0xca7fc0c411f94325 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797070.382913:0:7636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb077c68200 already unused, calling callback (ffffffffc1f014f0) 00010000:00010000:3.0:1788797070.382917:0:7636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c68200/0xca7fc0c411f94325 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797070.382932:0:7636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c68200/0xca7fc0c411f94325 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797070.382941:0:7636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8cb065cc2300) 00010000:00010000:3.0:1788797070.382944:0:7636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788797070.382947:0:7636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c68200/0xca7fc0c411f94325 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797070.382954:0:7636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c68200/0xca7fc0c411f94325 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797070.382972:0:7636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69400/0xca7fc0c411f9432c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797070.382979:0:7636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69400/0xca7fc0c411f9432c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797070.382986:0:7636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69400/0xca7fc0c411f9432c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797070.382992:0:7636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb077c69400 already unused, calling callback (ffffffffc1f014f0) 00010000:00010000:3.0:1788797070.382995:0:7636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69400/0xca7fc0c411f9432c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797070.383002:0:7636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69400/0xca7fc0c411f9432c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797070.383009:0:7636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8cb065cc2c00) 00010000:00010000:3.0:1788797070.383012:0:7636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788797070.383015:0:7636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69400/0xca7fc0c411f9432c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797070.383090:0:7636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69400/0xca7fc0c411f9432c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788797070.383191:0:7636:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0778df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6d050bb-169e-4784-be5b-7071799bf3b0+52:11607:x1875689351503360:12345-192.168.204.38@tcp:34:lfs.0 Request processed in 747us (1038us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797070.383199:0:7636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 203 00000100:00100000:2.0:1788797070.449809:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1788797070.452109:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351503616 00000100:00100000:0.0:1788797070.452141:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351503616 00000100:00100000:1.0:1788797070.452527:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 204 00000100:00100000:1.0:1788797070.452545:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0778dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6d050bb-169e-4784-be5b-7071799bf3b0+52:11610:x1875689351503616:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1788797070.452573:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788797070.452596:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045200/0xca7fc0c411f94333 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c99e04559ee131b expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797070.452713:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045e00/0xca7fc0c411f9433a lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797070.452734:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045e00/0xca7fc0c411f9433a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797070.452749:0:5826:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045e00/0xca7fc0c411f9433a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797070.452998:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045c00/0xca7fc0c411f94341 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797070.453008:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045c00/0xca7fc0c411f94341 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797070.453017:0:5826:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045c00/0xca7fc0c411f94341 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797070.453225:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045600/0xca7fc0c411f94348 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797070.453234:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045600/0xca7fc0c411f94348 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797070.453243:0:5826:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045600/0xca7fc0c411f94348 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788797070.453880:0:5826:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:1.0:1788797070.453994:0:5826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045e00/0xca7fc0c411f9433a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797070.454002:0:5826:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045e00/0xca7fc0c411f9433a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797070.454020:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045e00/0xca7fc0c411f9433a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797070.454057:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb082045e00 already unused, calling callback (ffffffffc1f014f0) 00010000:00010000:1.0:1788797070.454063:0:5826:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045e00/0xca7fc0c411f9433a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797070.454072:0:5826:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045e00/0xca7fc0c411f9433a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797070.454088:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8cb058766500) 00010000:00010000:1.0:1788797070.454092:0:5826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788797070.454096:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045e00/0xca7fc0c411f9433a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797070.454103:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045e00/0xca7fc0c411f9433a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797070.454116:0:5826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045c00/0xca7fc0c411f94341 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797070.454122:0:5826:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045c00/0xca7fc0c411f94341 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797070.454128:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045c00/0xca7fc0c411f94341 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797070.454132:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb082045c00 already unused, calling callback (ffffffffc1f014f0) 00010000:00010000:1.0:1788797070.454135:0:5826:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045c00/0xca7fc0c411f94341 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797070.454153:0:5826:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045c00/0xca7fc0c411f94341 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797070.454162:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8cb06ce84c00) 00010000:00010000:1.0:1788797070.454164:0:5826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788797070.454167:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045c00/0xca7fc0c411f94341 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797070.454173:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045c00/0xca7fc0c411f94341 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797070.454230:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045200/0xca7fc0c411f94333 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee131b expref: 55 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797070.454246:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045600/0xca7fc0c411f94348 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee131b expref: 54 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797070.455384:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8cb065cc2c00) 00010000:00010000:1.0:1788797070.455397:0:5826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788797070.455403:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb082045600, rc 0) 00000100:00100000:1.0:1788797070.455567:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0778dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6d050bb-169e-4784-be5b-7071799bf3b0+54:11610:x1875689351503616:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 3020us (5775us total) trans 4294967496 rc 0/0 00000100:00100000:1.0:1788797070.455578:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 204 00000100:00100000:0.0:1788797070.470918:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1788797070.471081:0:7636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351503744 00000100:00100000:3.0:1788797070.471094:0:7636:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351503744 00000100:00100000:3.0:1788797070.471165:0:7636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 205 00000100:00100000:3.0:1788797070.471179:0:7636:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb079bc3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6d050bb-169e-4784-be5b-7071799bf3b0+54:11610:x1875689351503744:12345-192.168.204.38@tcp:54:lfs.0 00010000:00010000:3.0:1788797070.471279:0:7636:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69400/0xca7fc0c411f94356 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797070.471299:0:7636:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69400/0xca7fc0c411f94356 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797070.471313:0:7636:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69400/0xca7fc0c411f94356 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797070.471343:0:7636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69400/0xca7fc0c411f94356 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797070.471350:0:7636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69400/0xca7fc0c411f94356 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797070.471357:0:7636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69400/0xca7fc0c411f94356 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797070.471364:0:7636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb077c69400 already unused, calling callback (ffffffffc1f014f0) 00010000:00010000:3.0:1788797070.471369:0:7636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69400/0xca7fc0c411f94356 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797070.471396:0:7636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69400/0xca7fc0c411f94356 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797070.471412:0:7636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8cb065cc2c00) 00010000:00010000:3.0:1788797070.471416:0:7636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788797070.471423:0:7636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69400/0xca7fc0c411f94356 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797070.471429:0:7636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69400/0xca7fc0c411f94356 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788797070.471532:0:7636:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb079bc3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6d050bb-169e-4784-be5b-7071799bf3b0+54:11610:x1875689351503744:12345-192.168.204.38@tcp:54:lfs.0 Request processed in 356us (628us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797070.471539:0:7636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 205 00000100:00100000:2.0:1788797070.476976:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1788797070.477116:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351504000 00000100:00100000:3.0:1788797070.477128:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351504000 00000100:00100000:3.0:1788797070.477205:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 58 00000100:00100000:3.0:1788797070.477216:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0778df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e6d050bb-169e-4784-be5b-7071799bf3b0+54:11610:x1875689351504000:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:3.0:1788797070.477534:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0778df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e6d050bb-169e-4784-be5b-7071799bf3b0+55:11610:x1875689351504000:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 319us (567us total) trans 4294967497 rc 0/0 00000100:00100000:3.0:1788797070.477543:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 58 00000100:00100000:2.0:1788797070.633345:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1788797070.633472:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351504256 00000100:00100000:3.0:1788797070.633485:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351504256 00000100:00100000:3.0:1788797070.633556:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 206 00000100:00100000:3.0:1788797070.633567:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0778dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6d050bb-169e-4784-be5b-7071799bf3b0+55:11620:x1875689351504256:12345-192.168.204.38@tcp:101:bash.0 00010000:00010000:3.0:1788797070.633604:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788797070.633608:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788797070.633665:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c68e00/0xca7fc0c411f942d8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee12ff expref: 55 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797070.633687:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8cb058766500) 00010000:00010000:3.0:1788797070.633693:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788797070.633713:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69400/0xca7fc0c411f9435d lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c99e04559ee1322 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797070.633844:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c68200/0xca7fc0c411f94364 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797070.633860:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c68200/0xca7fc0c411f94364 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797070.633872:0:5827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c68200/0xca7fc0c411f94364 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788797070.633883:0:5827:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:3.0:1788797070.634014:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69400/0xca7fc0c411f9435d lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1322 expref: 57 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797070.634107:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c68200/0xca7fc0c411f94364 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1322 expref: 56 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797070.634115:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8cb065cc2c00) 00010000:00010000:3.0:1788797070.634118:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788797070.634121:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb077c68200, rc 0) 00000100:00100000:3.0:1788797070.634197:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0778dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6d050bb-169e-4784-be5b-7071799bf3b0+56:11620:x1875689351504256:12345-192.168.204.38@tcp:101:bash.0 Request processed in 630us (867us total) trans 4294967498 rc 0/0 00000100:00100000:3.0:1788797070.634206:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 206 00000100:00100000:1.0:1788797070.650590:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1788797070.650808:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351504384 00000100:00100000:3.0:1788797070.650820:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351504384 00000100:00100000:3.0:1788797070.650888:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 16 00000100:00100000:3.0:1788797070.650898:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb050383100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e6d050bb-169e-4784-be5b-7071799bf3b0+56:2355:x1875689351504384:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788797070.650918:0:5811:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788797070.650944:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c68200/0xca7fc0c411f94364 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1322 expref: 56 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797070.650963:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8cb065cc2c00) 00010000:00010000:3.0:1788797070.650968:0:5811:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788797070.651078:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb050383100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e6d050bb-169e-4784-be5b-7071799bf3b0+55:2355:x1875689351504384:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 133us (449us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797070.651086:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 16 00000100:00100000:0.0:1788797070.656767:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1788797070.656868:0:7636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351504640 00000100:00100000:3.0:1788797070.656880:0:7636:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351504640 00000100:00100000:3.0:1788797070.656946:0:7636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 207 00000100:00100000:3.0:1788797070.656958:0:7636:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb079bc0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6d050bb-169e-4784-be5b-7071799bf3b0+55:11620:x1875689351504640:12345-192.168.204.38@tcp:36:bash.0 00010000:00010000:3.0:1788797070.657074:0:7636:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788797070.657118:0:7636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045600/0xca7fc0c411f94348 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee131b expref: 55 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797070.657147:0:7636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8cb065cc2c00) 00010000:00010000:3.0:1788797070.657153:0:7636:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788797070.657398:0:7636:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c68200/0xca7fc0c411f94372 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797070.657413:0:7636:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c68200/0xca7fc0c411f94372 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797070.657453:0:7636:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c68200/0xca7fc0c411f94372 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788797070.657510:0:7636:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967499 00000004:00010000:3.0:1788797070.657536:0:7636:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e2437ff8 reply state 00000000a07538cf transno 4294967500 ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c68200/0xca7fc0c411f94372 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788797070.657547:0:7636:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788797070.657674:0:7636:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb079bc0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6d050bb-169e-4784-be5b-7071799bf3b0+57:11620:x1875689351504640:12345-192.168.204.38@tcp:36:bash.0 Request processed in 718us (937us total) trans 4294967500 rc 0/0 00000100:00100000:3.0:1788797070.657682:0:7636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 207 00000020:00080000:3.0:1788797070.657688:0:7636:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788797070.672201:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c68200/0xca7fc0c411f94372 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797070.672225:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c68200/0xca7fc0c411f94372 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797070.672235:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c68200/0xca7fc0c411f94372 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797070.672241:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb077c68200 already unused, calling callback (ffffffffc1f014f0) 00010000:00010000:3.0:1788797070.672249:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c68200/0xca7fc0c411f94372 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797070.672260:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c68200/0xca7fc0c411f94372 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797070.672287:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8cb065cc2c00) 00010000:00010000:3.0:1788797070.672290:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788797070.672321:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c68200/0xca7fc0c411f94372 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797070.672329:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c68200/0xca7fc0c411f94372 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788797070.677885:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1788797070.677987:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351504768 00000100:00100000:3.0:1788797070.678002:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351504768 00000100:00100000:3.0:1788797070.678111:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 208 00000100:00100000:3.0:1788797070.678123:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb04945fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6d050bb-169e-4784-be5b-7071799bf3b0+56:11620:x1875689351504768:12345-192.168.204.38@tcp:101:bash.0 00010000:00010000:3.0:1788797070.678151:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788797070.678175:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69400/0xca7fc0c411f94379 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c99e04559ee1329 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797070.678284:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c68e00/0xca7fc0c411f94380 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797070.678300:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c68e00/0xca7fc0c411f94380 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797070.678314:0:5827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c68e00/0xca7fc0c411f94380 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788797070.678349:0:5827:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:3.0:1788797070.678355:0:5827:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788797070.678376:0:5827:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c68e00/0xca7fc0c411f94380 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797070.678410:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69400/0xca7fc0c411f94379 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1329 expref: 58 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797070.678428:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c68e00/0xca7fc0c411f94380 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1329 expref: 57 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797070.678463:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8cb065cc2c00) 00010000:00010000:3.0:1788797070.678466:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788797070.678469:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb077c68e00, rc 0) 00000100:00100000:3.0:1788797070.678523:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb04945fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6d050bb-169e-4784-be5b-7071799bf3b0+57:11620:x1875689351504768:12345-192.168.204.38@tcp:101:bash.0 Request processed in 402us (652us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797070.678530:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 208 00000100:00100000:2.0:1788797070.696007:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1788797070.696188:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351505024 00000100:00100000:3.0:1788797070.696200:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351505024 00000100:00100000:3.0:1788797070.696274:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 59 00000100:00100000:3.0:1788797070.696289:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0778dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e6d050bb-169e-4784-be5b-7071799bf3b0+57:11620:x1875689351505024:12345-192.168.204.38@tcp:35:bash.0 00000100:00100000:3.0:1788797070.696634:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0778dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e6d050bb-169e-4784-be5b-7071799bf3b0+58:11620:x1875689351505024:12345-192.168.204.38@tcp:35:bash.0 Request processed in 348us (638us total) trans 4294967501 rc 0/0 00000100:00100000:3.0:1788797070.696642:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 59 00000100:00100000:0.0:1788797070.815798:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1788797070.815950:0:7636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351505152 00000100:00100000:3.0:1788797070.815961:0:7636:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351505152 00000100:00100000:3.0:1788797070.816025:0:7636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 209 00000100:00100000:3.0:1788797070.816078:0:7636:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb04940a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6d050bb-169e-4784-be5b-7071799bf3b0+58:11626:x1875689351505152:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1788797070.816102:0:7636:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788797070.816122:0:7636:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69400/0xca7fc0c411f94387 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c99e04559ee1330 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797070.816189:0:7636:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c68200/0xca7fc0c411f9438e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797070.816206:0:7636:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c68200/0xca7fc0c411f9438e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797070.816231:0:7636:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c68200/0xca7fc0c411f9438e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788797070.816266:0:7636:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:3.0:1788797070.816270:0:7636:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788797070.816289:0:7636:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c68200/0xca7fc0c411f9438e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797070.816317:0:7636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69400/0xca7fc0c411f94387 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1330 expref: 60 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797070.816338:0:7636:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c68200/0xca7fc0c411f9438e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1330 expref: 59 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797070.816347:0:7636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8cb058766500) 00010000:00010000:3.0:1788797070.816350:0:7636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788797070.816354:0:7636:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb077c68200, rc 0) 00000100:00100000:3.0:1788797070.816427:0:7636:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb04940a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6d050bb-169e-4784-be5b-7071799bf3b0+59:11626:x1875689351505152:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 353us (641us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797070.816435:0:7636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 209 00000100:00100000:2.0:1788797070.830612:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1788797070.830724:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351505280 00000100:00100000:3.0:1788797070.830736:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351505280 00000100:00100000:3.0:1788797070.830828:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 210 00000100:00100000:3.0:1788797070.830841:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0778dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6d050bb-169e-4784-be5b-7071799bf3b0+59:11626:x1875689351505280:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1788797070.830870:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788797070.830895:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69400/0xca7fc0c411f94395 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c99e04559ee1337 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797070.830990:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69c00/0xca7fc0c411f9439c lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797070.831007:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69c00/0xca7fc0c411f9439c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797070.831021:0:5827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69c00/0xca7fc0c411f9439c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797070.831072:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69800/0xca7fc0c411f943a3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797070.831080:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69800/0xca7fc0c411f943a3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797070.831088:0:5827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69800/0xca7fc0c411f943a3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797070.831179:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69200/0xca7fc0c411f943aa lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797070.831189:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69200/0xca7fc0c411f943aa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797070.831196:0:5827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69200/0xca7fc0c411f943aa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788797070.831236:0:5827:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:3.0:1788797070.831241:0:5827:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788797070.831262:0:5827:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69200/0xca7fc0c411f943aa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797070.831290:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69200/0xca7fc0c411f943aa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797070.831299:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69c00/0xca7fc0c411f9439c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797070.831306:0:5827:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69c00/0xca7fc0c411f9439c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797070.831313:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69c00/0xca7fc0c411f9439c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797070.831319:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb077c69c00 already unused, calling callback (ffffffffc1f014f0) 00010000:00010000:3.0:1788797070.831323:0:5827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69c00/0xca7fc0c411f9439c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797070.831331:0:5827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69c00/0xca7fc0c411f9439c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797070.831343:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8cb058766500) 00010000:00010000:3.0:1788797070.831346:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788797070.831352:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69c00/0xca7fc0c411f9439c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797070.831357:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69c00/0xca7fc0c411f9439c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797070.831370:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69800/0xca7fc0c411f943a3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797070.831376:0:5827:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69800/0xca7fc0c411f943a3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797070.831389:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69800/0xca7fc0c411f943a3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797070.831394:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb077c69800 already unused, calling callback (ffffffffc1f014f0) 00010000:00010000:3.0:1788797070.831397:0:5827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69800/0xca7fc0c411f943a3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797070.831404:0:5827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69800/0xca7fc0c411f943a3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797070.831412:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8cb065cc2300) 00010000:00010000:3.0:1788797070.831415:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788797070.831418:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69800/0xca7fc0c411f943a3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797070.831423:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69800/0xca7fc0c411f943a3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797070.831467:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69400/0xca7fc0c411f94395 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1337 expref: 61 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797070.831481:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69200/0xca7fc0c411f943aa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1337 expref: 60 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797070.831488:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8cb065cc2c00) 00010000:00010000:3.0:1788797070.831490:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788797070.831492:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb077c69200, rc 0) 00000100:00100000:3.0:1788797070.831574:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0778dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6d050bb-169e-4784-be5b-7071799bf3b0+60:11626:x1875689351505280:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 736us (975us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797070.831592:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 210 00000100:00100000:2.0:1788797070.850662:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1788797070.850803:0:7636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351505536 00000100:00100000:3.0:1788797070.850816:0:7636:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351505536 00000100:00100000:3.0:1788797070.850891:0:7636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 211 00000100:00100000:3.0:1788797070.850902:0:7636:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0778dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6d050bb-169e-4784-be5b-7071799bf3b0+60:11626:x1875689351505536:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1788797070.850926:0:7636:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788797070.850952:0:7636:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69400/0xca7fc0c411f943b1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c99e04559ee133e expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797070.851128:0:7636:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69800/0xca7fc0c411f943b8 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797070.851143:0:7636:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c68e00/0xca7fc0c411f94380 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1329 expref: 61 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797070.851150:0:7636:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69200/0xca7fc0c411f943aa lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1337 expref: 61 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797070.851157:0:7636:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69800/0xca7fc0c411f943b8 lrc: 5/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797070.851192:0:7636:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69200/0xca7fc0c411f943aa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1337 expref: 61 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797070.851205:0:7636:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69200/0xca7fc0c411f943aa lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1337 expref: 61 pid: 5827 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788797070.851218:0:7636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb077f09880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7636:1875689374559616:192.168.204.38@tcp:104: 00010000:00010000:3.0:1788797070.851339:0:7636:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c68e00/0xca7fc0c411f94380 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1329 expref: 61 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797070.851348:0:7636:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c68e00/0xca7fc0c411f94380 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1329 expref: 61 pid: 5827 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788797070.851357:0:7636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb077f0ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7636:1875689374559744:192.168.204.38@tcp:104: 00000100:00100000:3.0:1788797070.851385:0:7636:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb06cfc1780 going to sleep for 11 seconds 00000100:00100000:0.0:1788797070.854320:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1788797070.854478:0:11663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351505664 00000100:00100000:2.0:1788797070.854491:0:11663:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351505664 00010000:00010000:2.0:1788797070.854548:0:11663:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69200/0xca7fc0c411f943aa lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1337 expref: 62 pid: 5827 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788797070.854607:0:11663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 76 00000100:00100000:2.0:1788797070.854618:0:11663:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb077e30a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e6d050bb-169e-4784-be5b-7071799bf3b0+62:2353:x1875689351505664:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788797070.854637:0:11663:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788797070.854643:0:11663:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69200/0xca7fc0c411f943aa lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1337 expref: 62 pid: 5827 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797070.854657:0:11663:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69200/0xca7fc0c411f943aa lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1337 expref: 62 pid: 5827 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797070.854706:0:11663:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8cb065cc2c00) 00010000:00010000:2.0:1788797070.854712:0:11663:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69800/0xca7fc0c411f943b8 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797070.854721:0:11663:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69800/0xca7fc0c411f943b8 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797070.854727:0:11663:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788797070.854803:0:11663:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb077e30a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e6d050bb-169e-4784-be5b-7071799bf3b0+62:2353:x1875689351505664:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 187us (496us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797070.854811:0:11663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 76 00010000:00010000:3.0:1788797070.858256:0:7636:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.204.38@tcp) returned -22 from blocking AST (req@00000000cecbef8e x1875689374559616) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69200/0xca7fc0c411f943aa lrc: 1/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1337 expref: 61 pid: 5827 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797070.858285:0:7636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69200/0xca7fc0c411f943aa lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1337 expref: 61 pid: 5827 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788797070.858305:0:7636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb077f09880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7636:1875689374559616:192.168.204.38@tcp:104: 00000100:00100000:3.0:1788797070.858321:0:7636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb077f0ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7636:1875689374559744:192.168.204.38@tcp:104: 00010000:00010000:3.0:1788797070.858350:0:7636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8cb065cc2c00) 00010000:00010000:3.0:1788797070.858356:0:7636:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69800/0xca7fc0c411f943b8 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797070.858367:0:7636:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69800/0xca7fc0c411f943b8 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797070.858377:0:7636:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69800/0xca7fc0c411f943b8 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788797070.859567:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1788797070.859686:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351505792 00000100:00100000:0.0:1788797070.859697:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351505792 00010000:00010000:0.0:1788797070.859744:0:5813:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c68e00/0xca7fc0c411f94380 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1329 expref: 61 pid: 5827 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788797070.859789:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 77 00000100:00100000:0.0:1788797070.859800:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0778dc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e6d050bb-169e-4784-be5b-7071799bf3b0+61:2355:x1875689351505792:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788797070.859818:0:5813:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788797070.859825:0:5813:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c68e00/0xca7fc0c411f94380 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1329 expref: 61 pid: 5827 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797070.859839:0:5813:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c68e00/0xca7fc0c411f94380 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1329 expref: 61 pid: 5827 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797070.859882:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c68e00/0xca7fc0c411f94380 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1329 expref: 61 pid: 5827 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797070.859899:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8cb065cc2c00) 00010000:00010000:0.0:1788797070.859918:0:5813:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69800/0xca7fc0c411f943b8 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797070.859930:0:5813:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69800/0xca7fc0c411f943b8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797070.859938:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69800/0xca7fc0c411f943b8 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797070.859972:0:5813:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788797070.860079:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0778dc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e6d050bb-169e-4784-be5b-7071799bf3b0+60:2355:x1875689351505792:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 280us (518us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797070.860088:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 77 00010000:00010000:2.0:1788797070.861535:0:7636:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69800/0xca7fc0c411f943b8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797070.861554:0:7636:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69800/0xca7fc0c411f943b8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788797070.861579:0:7636:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:2.0:1788797070.861758:0:7636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69400/0xca7fc0c411f943b1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee133e expref: 61 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797070.861781:0:7636:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69800/0xca7fc0c411f943b8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee133e expref: 60 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797070.861790:0:7636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8cb065cc2c00) 00010000:00010000:2.0:1788797070.861793:0:7636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788797070.861797:0:7636:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb077c69800, rc 0) 00000100:00100000:2.0:1788797070.861884:0:7636:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0778dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6d050bb-169e-4784-be5b-7071799bf3b0+60:11626:x1875689351505536:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 10983us (11234us total) trans 4294967502 rc 0/0 00000100:00100000:2.0:1788797070.861893:0:7636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 211 00000100:00100000:2.0:1788797070.883868:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1788797070.884097:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351506048 00000100:00100000:1.0:1788797070.884109:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351506048 00000100:00100000:1.0:1788797070.884194:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 17 00000100:00100000:1.0:1788797070.884204:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0778de300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e6d050bb-169e-4784-be5b-7071799bf3b0+60:11626:x1875689351506048:12345-192.168.204.38@tcp:103:lfs.0 00010000:00010000:1.0:1788797070.884256:0:6698:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788797070.884290:0:6698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c68400/0xca7fc0c411f94317 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1314 expref: 60 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797070.884315:0:6698:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8cb065cc2c00) 00010000:00010000:1.0:1788797070.884320:0:6698:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788797070.884394:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0778de300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e6d050bb-169e-4784-be5b-7071799bf3b0+59:11626:x1875689351506048:12345-192.168.204.38@tcp:103:lfs.0 Request processed in 191us (542us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797070.884401:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 17 00000100:00100000:0.0:1788797070.907322:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1788797070.907496:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351506176 00000100:00100000:3.0:1788797070.907523:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351506176 00000100:00100000:3.0:1788797070.907601:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 212 00000100:00100000:3.0:1788797070.907613:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0774e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6d050bb-169e-4784-be5b-7071799bf3b0+59:11626:x1875689351506176:12345-192.168.204.38@tcp:58:lfs.0 00010000:00010000:3.0:1788797070.907711:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69200/0xca7fc0c411f943c6 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797070.907729:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69200/0xca7fc0c411f943c6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797070.907740:0:5827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69200/0xca7fc0c411f943c6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788797070.907941:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:3.0:1788797070.908071:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0774e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6d050bb-169e-4784-be5b-7071799bf3b0+59:11626:x1875689351506176:12345-192.168.204.38@tcp:58:lfs.0 Request processed in 459us (759us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797070.908079:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 212 00000100:00100000:0.0:1788797070.923205:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1788797070.925706:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351506304 00000100:00100000:1.0:1788797070.925730:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351506304 00000100:00100000:0.0:1788797070.929780:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 213 00000100:00100000:0.0:1788797070.929805:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb07902ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6d050bb-169e-4784-be5b-7071799bf3b0+59:11626:x1875689351506304:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1788797070.929832:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788797070.929859:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3200/0xca7fc0c411f943cd lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c99e04559ee1345 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797070.929940:0:5825:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69200/0xca7fc0c411f943c6 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797070.929969:0:5825:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3200/0xca7fc0c411f943cd lrc: 4/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1345 expref: 60 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797070.929988:0:5825:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69200/0xca7fc0c411f943c6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797070.930003:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3200/0xca7fc0c411f943cd lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1345 expref: 60 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797070.930017:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8cb065cc2c00) 00010000:00010000:0.0:1788797070.930021:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788797070.930025:0:5825:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3200/0xca7fc0c411f943cd lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1345 expref: 60 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797070.930071:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb042ea3200, rc 0) 00000100:00100000:0.0:1788797070.930146:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb07902ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6d050bb-169e-4784-be5b-7071799bf3b0+60:11626:x1875689351506304:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 352us (6951us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797070.930154:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 213 00010000:00010000:1.0:1788797071.154213:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788797071.858307:0:11679:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788797071.858317:0:11679:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788797071.858364:0:11679:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:1.0:1788797071.858373:0:11679:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788797071.858521:0:11679:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb050382a00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11679:1875689374559872:192.168.204.38@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788797071.858637:0:11679:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb0436043c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788797071.884580:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1788797071.884676:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351506432 00000100:00100000:2.0:1788797071.884686:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351506432 00000100:00100000:2.0:1788797071.884745:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 214 00000100:00100000:2.0:1788797071.884755:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb07902bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6d050bb-169e-4784-be5b-7071799bf3b0+61:11627:x1875689351506432:12345-192.168.204.38@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788797071.884786:0:5826:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788797071.884888:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb07902bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6d050bb-169e-4784-be5b-7071799bf3b0+61:11627:x1875689351506432:12345-192.168.204.38@tcp:53:lhsmtool_posix.0 Request processed in 135us (317us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797071.884896:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 214 00000100:00100000:2.0:1788797071.891025:0:11679:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb050382a00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11679:1875689374559872:192.168.204.38@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788797071.892015:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1788797071.892275:0:7636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351506560 00000100:00100000:2.0:1788797071.892286:0:7636:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351506560 00000100:00100000:2.0:1788797071.892346:0:7636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 215 00000100:00100000:2.0:1788797071.892357:0:7636:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb079029f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6d050bb-169e-4784-be5b-7071799bf3b0+60:11627:x1875689351506560:12345-192.168.204.38@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1788797071.892451:0:7636:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040031400/0xca7fc0c411f943d4 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797071.892474:0:7636:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040031400/0xca7fc0c411f943d4 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797071.892489:0:7636:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040031400/0xca7fc0c411f943d4 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797071.892510:0:7636:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040030c00/0xca7fc0c411f943db lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797071.892535:0:7636:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040030c00/0xca7fc0c411f943db lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797071.892543:0:7636:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040030c00/0xca7fc0c411f943db lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797071.892571:0:7636:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040031e00/0xca7fc0c411f943e2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797071.892589:0:7636:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040031e00/0xca7fc0c411f943e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797071.892596:0:7636:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040031e00/0xca7fc0c411f943e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788797071.892683:0:7636:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:2.0:1788797071.892688:0:7636:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788797071.892707:0:7636:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040031e00/0xca7fc0c411f943e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797071.892718:0:7636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040031400/0xca7fc0c411f943d4 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797071.892994:0:7636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040031400/0xca7fc0c411f943d4 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797071.893005:0:7636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040031400/0xca7fc0c411f943d4 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797071.893010:0:7636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb040031400 already unused, calling callback (ffffffffc1f014f0) 00010000:00010000:2.0:1788797071.893015:0:7636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040031400/0xca7fc0c411f943d4 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797071.893062:0:7636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040031400/0xca7fc0c411f943d4 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797071.893080:0:7636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8cb05088a400) 00010000:00010000:2.0:1788797071.893082:0:7636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788797071.893088:0:7636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040031400/0xca7fc0c411f943d4 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797071.893094:0:7636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040031400/0xca7fc0c411f943d4 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797071.893196:0:7636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040030c00/0xca7fc0c411f943db lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797071.893202:0:7636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040030c00/0xca7fc0c411f943db lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797071.893208:0:7636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040030c00/0xca7fc0c411f943db lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797071.893213:0:7636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb040030c00 already unused, calling callback (ffffffffc1f014f0) 00010000:00010000:2.0:1788797071.893216:0:7636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040030c00/0xca7fc0c411f943db lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797071.893221:0:7636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040030c00/0xca7fc0c411f943db lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797071.893229:0:7636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xafd4eada (ffff8cb05088a800) 00010000:00010000:2.0:1788797071.893231:0:7636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788797071.893234:0:7636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040030c00/0xca7fc0c411f943db lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797071.893250:0:7636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040030c00/0xca7fc0c411f943db lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797071.893268:0:7636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040031e00/0xca7fc0c411f943e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797071.893274:0:7636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040031e00/0xca7fc0c411f943e2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797071.893281:0:7636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040031e00/0xca7fc0c411f943e2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797071.893286:0:7636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb040031e00 already unused, calling callback (ffffffffc1f014f0) 00010000:00010000:2.0:1788797071.893289:0:7636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040031e00/0xca7fc0c411f943e2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797071.893294:0:7636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040031e00/0xca7fc0c411f943e2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797071.893302:0:7636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8cb065cc2c00) 00010000:00010000:2.0:1788797071.893305:0:7636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788797071.893308:0:7636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040031e00/0xca7fc0c411f943e2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797071.893313:0:7636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040031e00/0xca7fc0c411f943e2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788797071.893439:0:7636:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb079029f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6d050bb-169e-4784-be5b-7071799bf3b0+60:11627:x1875689351506560:12345-192.168.204.38@tcp:34:lhsmtool_posix.0 Request processed in 1081us (1426us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797071.893448:0:7636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 215 00000100:00100000:0.0:1788797071.905391:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1788797071.905501:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351506816 00000100:00100000:3.0:1788797071.905512:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351506816 00000100:00100000:3.0:1788797071.905608:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 216 00000100:00100000:3.0:1788797071.905620:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb07902b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6d050bb-169e-4784-be5b-7071799bf3b0+60:11627:x1875689351506816:12345-192.168.204.38@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788797071.905646:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788797071.905671:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69c00/0xca7fc0c411f943e9 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c99e04559ee134c expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797071.905809:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c68800/0xca7fc0c411f943f0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797071.905826:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c68800/0xca7fc0c411f943f0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797071.905866:0:5827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c68800/0xca7fc0c411f943f0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788797071.905881:0:5827:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:3.0:1788797071.905994:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c68800/0xca7fc0c411f943f0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797071.906004:0:5827:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c68800/0xca7fc0c411f943f0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797071.906011:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c68800/0xca7fc0c411f943f0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797071.906018:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb077c68800 already unused, calling callback (ffffffffc1f014f0) 00010000:00010000:3.0:1788797071.906023:0:5827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c68800/0xca7fc0c411f943f0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797071.906088:0:5827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c68800/0xca7fc0c411f943f0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797071.906113:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8cb065cc2c00) 00010000:00010000:3.0:1788797071.906116:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788797071.906121:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c68800/0xca7fc0c411f943f0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797071.906127:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c68800/0xca7fc0c411f943f0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797071.906172:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69c00/0xca7fc0c411f943e9 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee134c expref: 62 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797071.906194:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8cb05088a400) 00010000:00010000:3.0:1788797071.906196:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788797071.906201:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69c00/0xca7fc0c411f943e9 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee134c expref: 62 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797071.906211:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb077c69c00, rc 0) 00000100:00100000:3.0:1788797071.906276:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb07902b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6d050bb-169e-4784-be5b-7071799bf3b0+61:11627:x1875689351506816:12345-192.168.204.38@tcp:101:lhsmtool_posix.0 Request processed in 659us (901us total) trans 4294967503 rc 301/301 00000100:00100000:3.0:1788797071.906284:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 216 00000100:00100000:0.0:1788797071.917545:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1788797071.917644:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351506944 00000100:00100000:2.0:1788797071.917657:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351506944 00000100:00100000:2.0:1788797071.917723:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 217 00000100:00100000:2.0:1788797071.917744:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb079029880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6d050bb-169e-4784-be5b-7071799bf3b0+61:11627:x1875689351506944:12345-192.168.204.38@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788797071.917784:0:5825:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788797071.917970:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb079029880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6d050bb-169e-4784-be5b-7071799bf3b0+61:11627:x1875689351506944:12345-192.168.204.38@tcp:53:lhsmtool_posix.0 Request processed in 228us (435us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797071.917978:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 217 00000100:00100000:0.0:1788797071.920758:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1788797071.920873:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351507200 00000100:00100000:3.0:1788797071.920883:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351507200 00000100:00100000:3.0:1788797071.920947:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 218 00000100:00100000:3.0:1788797071.920958:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb077c32d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6d050bb-169e-4784-be5b-7071799bf3b0+61:11627:x1875689351507200:12345-192.168.204.38@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788797071.920984:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788797071.920988:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788797071.921059:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c68200/0xca7fc0c411f9438e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1330 expref: 61 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797071.921091:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8cb058766500) 00010000:00010000:3.0:1788797071.921107:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788797071.921125:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69c00/0xca7fc0c411f943fe lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c99e04559ee1353 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788797071.921726:0:5827:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x6:0x0], index 0: 0 00010000:00010000:3.0:1788797071.921972:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c68800/0xca7fc0c411f94405 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797071.922005:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c68800/0xca7fc0c411f94405 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797071.922019:0:5827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c68800/0xca7fc0c411f94405 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797071.922163:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69c00/0xca7fc0c411f943fe lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1353 expref: 63 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797071.922183:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c68800/0xca7fc0c411f94405 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1353 expref: 62 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797071.922192:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8cb065cc2300) 00010000:00010000:3.0:1788797071.922195:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788797071.922198:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb077c68800, rc 0) 00000100:00100000:3.0:1788797071.922294:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb077c32d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6d050bb-169e-4784-be5b-7071799bf3b0+62:11627:x1875689351507200:12345-192.168.204.38@tcp:101:lhsmtool_posix.0 Request processed in 1336us (1554us total) trans 4294967504 rc 0/0 00000100:00100000:3.0:1788797071.922303:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 218 00000100:00100000:0.0:1788797071.929950:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1788797071.930076:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351507456 00000100:00100000:2.0:1788797071.930091:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351507456 00000100:00100000:2.0:1788797071.930162:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 219 00000100:00100000:2.0:1788797071.930172:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb077c31880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6d050bb-169e-4784-be5b-7071799bf3b0+62:11627:x1875689351507456:12345-192.168.204.38@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788797071.930228:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788797071.930256:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c68800/0xca7fc0c411f94405 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1353 expref: 62 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797071.930276:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8cb065cc2300) 00010000:00010000:2.0:1788797071.930288:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788797071.930308:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040031e00/0xca7fc0c411f94413 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797071.930321:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040031e00/0xca7fc0c411f94413 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797071.930331:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040031e00/0xca7fc0c411f94413 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797071.930397:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040030c00/0xca7fc0c411f9441a lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0xc293d562 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797071.930430:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040030c00/0xca7fc0c411f9441a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xc293d562 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797071.930438:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040030c00/0xca7fc0c411f9441a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xc293d562 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797071.930505:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040031e00/0xca7fc0c411f94413 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797071.930512:0:5825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040031e00/0xca7fc0c411f94413 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797071.930519:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040031e00/0xca7fc0c411f94413 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797071.930526:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb040031e00 already unused, calling callback (ffffffffc1f014f0) 00010000:00010000:2.0:1788797071.930529:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040031e00/0xca7fc0c411f94413 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797071.930537:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040031e00/0xca7fc0c411f94413 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797071.930545:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8cb058766500) 00010000:00010000:2.0:1788797071.930548:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788797071.930552:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040031e00/0xca7fc0c411f94413 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797071.930558:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040031e00/0xca7fc0c411f94413 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797071.930569:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040030c00/0xca7fc0c411f9441a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xc293d562 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797071.930581:0:5825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040030c00/0xca7fc0c411f9441a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xc293d562 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797071.930586:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040030c00/0xca7fc0c411f9441a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xc293d562 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797071.930591:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb040030c00 already unused, calling callback (ffffffffc1f014f0) 00010000:00010000:2.0:1788797071.930594:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040030c00/0xca7fc0c411f9441a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xc293d562 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797071.930601:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040030c00/0xca7fc0c411f9441a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xc293d562 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797071.930609:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0xc293d562 (ffff8cb05088a800) 00010000:00010000:2.0:1788797071.930612:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788797071.930615:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040030c00/0xca7fc0c411f9441a lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xc293d562 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797071.930621:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040030c00/0xca7fc0c411f9441a lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xc293d562 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788797071.930692:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb077c31880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6d050bb-169e-4784-be5b-7071799bf3b0+61:11627:x1875689351507456:12345-192.168.204.38@tcp:36:lhsmtool_posix.0 Request processed in 521us (751us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788797071.930699:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 219 00000100:00100000:1.0:1788797071.933984:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1788797071.934257:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351507584 00000100:00100000:0.0:1788797071.934268:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351507584 00000100:00100000:0.0:1788797071.934322:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 220 00000100:00100000:0.0:1788797071.934348:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb050381880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6d050bb-169e-4784-be5b-7071799bf3b0+61:11627:x1875689351507584:12345-192.168.204.38@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788797071.934372:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788797071.934397:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3c00/0xca7fc0c411f94421 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c99e04559ee135a expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797071.934445:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2800/0xca7fc0c411f94428 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797071.934459:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2800/0xca7fc0c411f94428 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797071.934470:0:5827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2800/0xca7fc0c411f94428 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797071.934570:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3c00/0xca7fc0c411f94421 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee135a expref: 63 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797071.934601:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2800/0xca7fc0c411f94428 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee135a expref: 62 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797071.934610:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8cb0821d4100) 00010000:00010000:0.0:1788797071.934613:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788797071.934616:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb042ea2800, rc 0) 00000100:00100000:0.0:1788797071.934678:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb050381880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6d050bb-169e-4784-be5b-7071799bf3b0+62:11627:x1875689351507584:12345-192.168.204.38@tcp:101:lhsmtool_posix.0 Request processed in 333us (705us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797071.934685:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 220 00000100:00100000:0.0:1788797071.940723:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1788797071.940811:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351507840 00000100:00100000:2.0:1788797071.940820:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351507840 00000100:00100000:2.0:1788797071.940875:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 221 00000100:00100000:2.0:1788797071.940885:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb077c31c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6d050bb-169e-4784-be5b-7071799bf3b0+62:11627:x1875689351507840:12345-192.168.204.38@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788797071.940968:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040030c00/0xca7fc0c411f9442f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797071.940997:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040030c00/0xca7fc0c411f9442f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797071.941011:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040030c00/0xca7fc0c411f9442f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788797071.941644:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].8, 88 off8800 00000004:00080000:2.0:1788797071.941654:0:5825:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 360947625257ns, next at 361947622623ns, rc = 0 00000004:00010000:2.0:1788797071.941756:0:5825:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000fbb8b91b reply state 0000000069eacfc3 transno 4294967505 ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040030c00/0xca7fc0c411f9442f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788797071.941766:0:5825:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788797071.941860:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb077c31c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6d050bb-169e-4784-be5b-7071799bf3b0+64:11627:x1875689351507840:12345-192.168.204.38@tcp:36:lhsmtool_posix.0 Request processed in 974us (1145us total) trans 4294967505 rc 0/0 00000100:00100000:2.0:1788797071.941867:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 221 00010000:00010000:3.0:1788797071.944311:0:3286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040030c00/0xca7fc0c411f9442f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797071.944334:0:3286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040030c00/0xca7fc0c411f9442f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797071.944344:0:3286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040030c00/0xca7fc0c411f9442f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797071.944352:0:3286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb040030c00 already unused, calling callback (ffffffffc1f014f0) 00010000:00010000:3.0:1788797071.944358:0:3286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040030c00/0xca7fc0c411f9442f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797071.944393:0:3286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040030c00/0xca7fc0c411f9442f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797071.944429:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8cb0821d4100) 00010000:00010000:3.0:1788797071.944433:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788797071.944439:0:3286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040030c00/0xca7fc0c411f9442f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797071.944446:0:3286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040030c00/0xca7fc0c411f9442f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788797071.953159:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1788797071.953697:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351507968 00000100:00100000:3.0:1788797071.953709:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351507968 00000100:00100000:3.0:1788797071.953778:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 222 00000100:00100000:3.0:1788797071.953790:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb077c32680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6d050bb-169e-4784-be5b-7071799bf3b0+63:11627:x1875689351507968:12345-192.168.204.38@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788797071.953814:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788797071.953834:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69c00/0xca7fc0c411f94436 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c99e04559ee1361 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797071.953896:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69c00/0xca7fc0c411f94436 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1361 expref: 64 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797071.953911:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69c00/0xca7fc0c411f94436 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1361 expref: 64 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797071.953931:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8cb0821d4100) 00010000:00010000:3.0:1788797071.953935:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788797071.953938:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb077c69c00, rc 0) 00000100:00100000:3.0:1788797071.954017:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb077c32680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6d050bb-169e-4784-be5b-7071799bf3b0+64:11627:x1875689351507968:12345-192.168.204.38@tcp:101:lhsmtool_posix.0 Request processed in 229us (871us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797071.954024:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 222 00000100:00100000:1.0:1788797071.957689:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1788797071.958388:0:10829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351508096 00000100:00100000:0.0:1788797071.958442:0:10829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351508096 00000100:00100000:0.0:1788797071.958761:0:10829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 63 00000100:00100000:0.0:1788797071.958775:0:10829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb050382a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e6d050bb-169e-4784-be5b-7071799bf3b0+9:2352:x1875689351508096:12345-192.168.204.38@tcp:2:lhsmtool_posix.0 00000100:00080000:3.0:1788797071.958939:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788797071.959870:0:10829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb050382a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e6d050bb-169e-4784-be5b-7071799bf3b0+10:2352:x1875689351508096:12345-192.168.204.38@tcp:2:lhsmtool_posix.0 Request processed in 1096us (2188us total) trans 4294967319 rc 0/0 00000100:00100000:0.0:1788797071.959880:0:10829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 63 00000100:00100000:1.0:1788797071.962670:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1788797071.962767:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351508352 00000100:00100000:3.0:1788797071.962777:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351508352 00000100:00100000:3.0:1788797071.962835:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 60 00000100:00100000:3.0:1788797071.962846:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb047c18000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e6d050bb-169e-4784-be5b-7071799bf3b0+64:11627:x1875689351508352:12345-192.168.204.38@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788797071.964369:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb047c18000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e6d050bb-169e-4784-be5b-7071799bf3b0+65:11627:x1875689351508352:12345-192.168.204.38@tcp:35:lhsmtool_posix.0 Request processed in 1512us (1696us total) trans 4294967506 rc 0/0 00000100:00100000:3.0:1788797071.964383:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 60 00000100:00100000:2.0:1788797071.970667:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1788797071.971068:0:7636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351508608 00000100:00100000:3.0:1788797071.971080:0:7636:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351508608 00000100:00100000:3.0:1788797071.971456:0:7636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 223 00000100:00100000:3.0:1788797071.971468:0:7636:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0778dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6d050bb-169e-4784-be5b-7071799bf3b0+65:11627:x1875689351508608:12345-192.168.204.38@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788797071.971616:0:7636:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0778dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6d050bb-169e-4784-be5b-7071799bf3b0+65:11627:x1875689351508608:12345-192.168.204.38@tcp:57:lhsmtool_posix.0 Request processed in 150us (965us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797071.971624:0:7636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 223 00000100:00100000:1.0:1788797071.974674:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1788797071.977980:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351508736 00000100:00100000:3.0:1788797071.977998:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351508736 00000100:00100000:3.0:1788797071.978141:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 224 00000100:00100000:3.0:1788797071.978153:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb047c19f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6d050bb-169e-4784-be5b-7071799bf3b0+65:11627:x1875689351508736:12345-192.168.204.38@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788797071.978175:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788797071.978199:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c68200/0xca7fc0c411f9443d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c99e04559ee1368 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797071.978315:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c68800/0xca7fc0c411f94444 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797071.978333:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c68800/0xca7fc0c411f94444 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797071.978346:0:5827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c68800/0xca7fc0c411f94444 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788797071.978389:0:5827:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788797071.978408:0:5827:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c68800/0xca7fc0c411f94444 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797071.978449:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c68200/0xca7fc0c411f9443d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1368 expref: 67 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797071.978471:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c68800/0xca7fc0c411f94444 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1368 expref: 66 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797071.978480:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8cb0821d4100) 00010000:00010000:3.0:1788797071.978484:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1788797071.978488:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb077c68800, rc 0) 00000100:00100000:3.0:1788797071.978556:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb047c19f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6d050bb-169e-4784-be5b-7071799bf3b0+66:11627:x1875689351508736:12345-192.168.204.38@tcp:101:lhsmtool_posix.0 Request processed in 406us (3896us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797071.978562:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 224 00000100:00100000:1.0:1788797071.985234:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1788797071.985353:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351508864 00000100:00100000:2.0:1788797071.985365:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351508864 00000100:00100000:2.0:1788797071.985435:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 64 00000100:00100000:2.0:1788797071.985446:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb06ef1e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e6d050bb-169e-4784-be5b-7071799bf3b0+10:2354:x1875689351508864:12345-192.168.204.38@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788797071.985468:0:6684:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788797071.985494:0:6684:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d500f348/0xca7fc0c411f9444b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7c99e04559ee136f expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788797071.985524:0:6684:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9ee090, blocks: 0x1 00010000:00010000:2.0:1788797071.985548:0:6684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=360s v=(0 0) 00010000:00010000:2.0:1788797071.985552:0:6684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788797071.985578:0:6684:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d500f348/0xca7fc0c411f9444b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee136f expref: 11 pid: 6684 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797071.985597:0:6684:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d500f348/0xca7fc0c411f9444b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee136f expref: 11 pid: 6684 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797071.985611:0:6684:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb040031400, rc 0) 00000100:00100000:2.0:1788797071.985675:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb06ef1e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e6d050bb-169e-4784-be5b-7071799bf3b0+11:2354:x1875689351508864:12345-192.168.204.38@tcp:101:lhsmtool_posix.0 Request processed in 231us (453us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797071.985682:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 64 00000100:00100000:0.0:1788797071.997236:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1788797071.998447:0:7636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351509120 00000100:00100000:2.0:1788797071.998466:0:7636:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351509120 00000100:00100000:2.0:1788797071.998543:0:7636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 225 00000100:00100000:2.0:1788797071.998555:0:7636:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb077c33b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6d050bb-169e-4784-be5b-7071799bf3b0+66:11627:x1875689351509120:12345-192.168.204.38@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788797071.998753:0:7636:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb077c33b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6d050bb-169e-4784-be5b-7071799bf3b0+66:11627:x1875689351509120:12345-192.168.204.38@tcp:57:lhsmtool_posix.0 Request processed in 193us (1525us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797071.998762:0:7636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 225 00000100:00100000:1.0:1788797072.007546:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1788797072.007681:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351509248 00000100:00100000:2.0:1788797072.007693:0:6683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351509248 00000100:00100000:2.0:1788797072.007917:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 65 00000100:00100000:2.0:1788797072.007929:0:6683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb050387480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e6d050bb-169e-4784-be5b-7071799bf3b0+11:11627:x1875689351509248:12345-192.168.204.38@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788797072.007947:0:6683:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788797072.007967:0:6683:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000039ca93bf/0xca7fc0c411f94452 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7c99e04559ee1376 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797072.008001:0:6683:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d500f348/0xca7fc0c411f9444b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee136f expref: 12 pid: 6684 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797072.008070:0:6683:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1788797072.008075:0:6683:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788797072.008082:0:6683:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000039ca93bf/0xca7fc0c411f94452 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1376 expref: 12 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797072.009919:0:6683:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d500f348/0xca7fc0c411f9444b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee136f expref: 12 pid: 6684 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797072.009944:0:6683:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d500f348/0xca7fc0c411f9444b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee136f expref: 12 pid: 6684 timeout: 461 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788797072.009963:0:6683:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb0778ded80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6683:1875689374560000:192.168.204.38@tcp:104: 00000100:00100000:2.0:1788797072.010109:0:6683:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb0484faa80 going to sleep for 11 seconds 00000100:00100000:2.0:1788797072.015089:0:6683:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb0778ded80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6683:1875689374560000:192.168.204.38@tcp:104: 00010000:00010000:2.0:1788797072.015144:0:6683:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000039ca93bf/0xca7fc0c411f94452 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1376 expref: 12 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797072.015171:0:6683:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb040031e00, rc 0) 00000100:00100000:2.0:1788797072.015236:0:6683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb050387480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e6d050bb-169e-4784-be5b-7071799bf3b0+12:11627:x1875689351509248:12345-192.168.204.38@tcp:101:lhsmtool_posix.0 Request processed in 7309us (7703us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797072.015247:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 65 00000100:00100000:0.0:1788797072.020085:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1788797072.020504:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351509376 00000100:00100000:1.0:1788797072.020514:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351509376 00010000:00010000:1.0:1788797072.020561:0:5812:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d500f348/0xca7fc0c411f9444b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee136f expref: 12 pid: 6684 timeout: 461 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788797072.020632:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 78 00000100:00100000:1.0:1788797072.020643:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb077c30e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e6d050bb-169e-4784-be5b-7071799bf3b0+12:2355:x1875689351509376:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788797072.020659:0:5812:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788797072.020682:0:5812:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d500f348/0xca7fc0c411f9444b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee136f expref: 12 pid: 6684 timeout: 461 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797072.020697:0:5812:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d500f348/0xca7fc0c411f9444b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee136f expref: 12 pid: 6684 timeout: 461 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797072.020734:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d500f348/0xca7fc0c411f9444b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee136f expref: 12 pid: 6684 timeout: 461 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797072.020755:0:5812:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788797072.020759:0:5812:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788797072.020768:0:5812:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000039ca93bf/0xca7fc0c411f94452 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1376 expref: 11 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797072.020779:0:5812:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000039ca93bf/0xca7fc0c411f94452 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1376 expref: 11 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797072.020819:0:5812:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000039ca93bf/0xca7fc0c411f94452 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1376 expref: 11 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788797072.020834:0:5812:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb080477b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5812:1875689374560128:192.168.204.38@tcp:105: 00000100:00100000:1.0:1788797072.020953:0:5812:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb043604900 going to sleep for 11 seconds 00000100:00100000:1.0:1788797072.027134:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1788797072.027254:0:5812:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb080477b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5812:1875689374560128:192.168.204.38@tcp:105: 00010000:00010000:0.0:1788797072.027277:0:5812:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788797072.027345:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb077c30e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e6d050bb-169e-4784-be5b-7071799bf3b0+11:2355:x1875689351509376:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 6703us (7270us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797072.027358:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 78 00000100:00100000:3.0:1788797072.027487:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351509504 00000100:00100000:3.0:1788797072.027496:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351509504 00002000:00100000:3.0:1788797072.027548:0:6687:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x6:0x0] (0->12) req@ffff8cb080475880 x1875689351509504/t0(0) o4->e6d050bb-169e-4784-be5b-7071799bf3b0@192.168.204.38@tcp:498/0 lens 504/0 e 0 to 0 dl 1788797083 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788797072.027573:0:6687:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8cb080475880 with x1875689351509504 ext(0->12) 00002000:00010000:3.0:1788797072.027579:0:6687:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8cb080475880 00000100:00100000:3.0:1788797072.027614:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 6 00000100:00100000:3.0:1788797072.027626:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb080475880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e6d050bb-169e-4784-be5b-7071799bf3b0+11:2354:x1875689351509504:12345-192.168.204.38@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1788797072.028312:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb080475880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e6d050bb-169e-4784-be5b-7071799bf3b0+13:2354:x1875689351509504:12345-192.168.204.38@tcp:4:lhsmtool_posix.0 Request processed in 686us (1186us total) trans 4294967320 rc 0/0 00000100:00100000:3.0:1788797072.028321:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 6 00002000:00100000:3.0:1788797072.028328:0:6687:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x6:0x0] (0->12) req@ffff8cb080475880 x1875689351509504/t4294967320(0) o4->e6d050bb-169e-4784-be5b-7071799bf3b0@192.168.204.38@tcp:498/0 lens 504/448 e 0 to 0 dl 1788797083 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788797072.028337:0:6687:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8cb080475880 with x1875689351509504 ext(0->12) 00002000:00010000:3.0:1788797072.028342:0:6687:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8cb080475880 00000100:00100000:2.0:1788797072.030969:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1788797072.031898:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351509632 00000100:00100000:3.0:1788797072.031913:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351509632 00000100:00100000:3.0:1788797072.032014:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 226 00000100:00100000:3.0:1788797072.032025:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0778ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6d050bb-169e-4784-be5b-7071799bf3b0+66:11627:x1875689351509632:12345-192.168.204.38@tcp:44:lhsmtool_posix.0 00000100:00080000:0.0:1788797072.032184:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:2.0:1788797072.123461:0:5848:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967484 is committed 00000020:00080000:2.0:1788797072.123516:0:5848:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8cb0484fad80 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:2.0:1788797072.123522:0:5848:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8cb047c23700 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8cb0484fa240 00000020:00080000:2.0:1788797072.123525:0:5848:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8cb047c23200 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8cb077f5dc00 00000020:00080000:2.0:1788797072.123541:0:5848:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000001:00080000:2.0:1788797072.123549:0:5848:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967496 is committed 00000001:00080000:2.0:1788797072.123564:0:5848:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967505 is committed 00000004:00080000:2.0:1788797072.123568:0:5848:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 8 committed 00000004:00080000:2.0:1788797072.123585:0:5848:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000020:00080000:2.0:1788797072.123602:0:5848:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8cb0411ca240 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:2.0:1788797072.123605:0:5848:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8cb07a204400 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8cb047c30000 00000020:00080000:2.0:1788797072.123607:0:5848:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8cb07a204f00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8cb079bce400 00000001:00080000:2.0:1788797072.123622:0:5848:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967506 is committed 00000004:00080000:2.0:1788797072.123663:0:5848:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 7 committed 00000020:00080000:2.0:1788797072.123680:0:5859:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000020:00080000:2.0:1788797072.123929:0:5859:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:2.0:1788797072.124139:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb0778dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875689374560256:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788797072.124210:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788797072.124299:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb0778ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875689374560384:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1788797072.124323:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788797072.124345:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788797072.124351:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb0778de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875689374560512:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788797072.124391:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788797072.124450:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374560256 00000100:00100000:2.0:1788797072.124458:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374560256 00000100:00100000:2.0:1788797072.124516:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374560384 00000100:00100000:2.0:1788797072.124519:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374560384 00000100:00100000:2.0:1788797072.124530:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374560512 00000100:00100000:2.0:1788797072.124538:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374560512 00000100:00100000:2.0:1788797072.124558:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788797072.124567:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0778dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3303:x1875689374560256:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1788797072.124596:0:6681:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5 count 1 00010000:00010000:2.0:1788797072.124620:0:6681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004debd26a/0xca7fc0c411f94459 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797072.124644:0:6681:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c016a1a1/0xca7fc0c411f9421b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee12d5 expref: 12 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797072.124654:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=3s v=(0 0) 00010000:00010000:2.0:1788797072.124659:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788797072.124664:0:6681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004debd26a/0xca7fc0c411f94459 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797072.124692:0:6681:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c016a1a1/0xca7fc0c411f9421b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee12d5 expref: 12 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797072.124707:0:6681:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c016a1a1/0xca7fc0c411f9421b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee12d5 expref: 12 pid: 6683 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788797072.124720:0:6681:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb0795da680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6681:1875689374560640:192.168.204.38@tcp:104: 00000100:00100000:2.0:1788797072.124779:0:6681:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb0484faa80 going to sleep for 11 seconds 00000100:00100000:2.0:1788797072.124797:0:10829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788797072.124804:0:10829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0778dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3300:x1875689374560384:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1788797072.124938:0:10829:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1788797072.124947:0:10829:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 0 -> 1788797072 00002000:00010000:2.0:1788797072.124949:0:10829:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1788797072.124951:0:10829:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1788797072 -> 1788797072 00002000:00010000:2.0:1788797072.124953:0:10829:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1788797072.124995:0:10829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0778dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3300:x1875689374560384:12345-0@lo:2:osp-syn-0-0.0 Request processed in 191us (670us total) trans 4294967321 rc 0/0 00000100:00100000:2.0:1788797072.125004:0:10829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788797072.125025:0:10829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788797072.125056:0:10829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0795d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3300:x1875689374560512:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1788797072.125071:0:10829:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5 count 1 00002000:00010000:2.0:1788797072.125095:0:10829:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a9ee08e, atime: 0x6a9ee08e, ctime: 0x6a9ee08e, blocks: 0x1 00010000:00010000:2.0:1788797072.125101:0:10829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008bf68295/0xca7fc0c411f94460 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797072.125112:0:10829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=361s v=(0 0) 00010000:00010000:2.0:1788797072.125115:0:10829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788797072.125122:0:10829:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008bf68295/0xca7fc0c411f94460 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797072.125139:0:10829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008bf68295/0xca7fc0c411f94460 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797072.125150:0:10829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008bf68295/0xca7fc0c411f94460 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797072.125159:0:10829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008bf68295/0xca7fc0c411f94460 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 10829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797072.125190:0:10829:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788797072.125693:0:10829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0795d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3300:x1875689374560512:12345-0@lo:6:osp-syn-1-0.0 Request processed in 635us (1298us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1788797072.125701:0:10829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00080000:2.0:1788797072.125731:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788797072.125738:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788797072.125868:0:8446:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788797072.125876:0:8446:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008bf68295/0xca7fc0c411f94460 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797072.125884:0:8446:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb040030000 already unused, calling callback (ffffffffc14d98b0) 00010000:00010000:2.0:1788797072.125889:0:8446:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008bf68295/0xca7fc0c411f94460 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797072.125898:0:8446:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008bf68295/0xca7fc0c411f94460 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 10829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797072.125915:0:8446:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008bf68295/0xca7fc0c411f94460 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788797072.128590:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0778ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6d050bb-169e-4784-be5b-7071799bf3b0+20:11627:x1875689351509632:12345-192.168.204.38@tcp:44:lhsmtool_posix.0 Request processed in 96547us (97611us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797072.128609:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 226 00000100:00100000:1.0:1788797072.129752:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1788797072.130075:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351509760 00000100:00100000:3.0:1788797072.130089:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351509760 00010000:00010000:3.0:1788797072.130147:0:5811:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c016a1a1/0xca7fc0c411f9421b lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee12d5 expref: 13 pid: 6683 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788797072.130188:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 79 00000100:00100000:3.0:1788797072.130200:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0484c5c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e6d050bb-169e-4784-be5b-7071799bf3b0+13:2354:x1875689351509760:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788797072.130218:0:5811:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788797072.130242:0:5811:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c016a1a1/0xca7fc0c411f9421b lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee12d5 expref: 13 pid: 6683 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797072.130258:0:5811:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c016a1a1/0xca7fc0c411f9421b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee12d5 expref: 13 pid: 6683 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797072.130292:0:5811:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788797072.130298:0:5811:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788797072.130305:0:5811:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000004debd26a/0xca7fc0c411f94459 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797072.130317:0:5811:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004debd26a/0xca7fc0c411f94459 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797072.130346:0:5811:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788797072.130401:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0484c5c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e6d050bb-169e-4784-be5b-7071799bf3b0+13:2354:x1875689351509760:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 203us (662us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797072.130409:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 79 00010000:00010000:0.0:1788797072.132674:0:6681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c016a1a1/0xca7fc0c411f9421b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee12d5 expref: 12 pid: 6683 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788797072.132709:0:6681:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb0795da680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6681:1875689374560640:192.168.204.38@tcp:104: 00010000:00010000:0.0:1788797072.132761:0:6681:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000004debd26a/0xca7fc0c411f94459 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797072.132774:0:6681:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000004debd26a/0xca7fc0c411f94459 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797072.132781:0:6681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004debd26a/0xca7fc0c411f94459 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797072.132816:0:6681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004debd26a/0xca7fc0c411f94459 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797072.132825:0:6681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004debd26a/0xca7fc0c411f94459 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797072.132855:0:6681:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788797072.133537:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0778dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3303:x1875689374560256:12345-0@lo:6:osp-syn-0-0.0 Request processed in 8968us (9324us total) trans 4294967322 rc 0/0 00000100:00100000:0.0:1788797072.133546:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00010000:00010000:1.0:1788797072.134162:0:5815:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788797072.134174:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004debd26a/0xca7fc0c411f94459 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797072.134187:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb040030800 already unused, calling callback (ffffffffc14d98b0) 00010000:00010000:1.0:1788797072.134193:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004debd26a/0xca7fc0c411f94459 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797072.134207:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004debd26a/0xca7fc0c411f94459 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797072.134229:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004debd26a/0xca7fc0c411f94459 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797072.134237:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004debd26a/0xca7fc0c411f94459 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797072.134260:0:5815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788797072.134261:0:5815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788797072.134263:0:5815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1788797072.135517:0:3300:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8cb0778de680/2, rc 0, transno 4294967310 00000100:00100000:1.0:1788797072.135557:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb0778de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875689374560512:0@lo:6:osp-syn-1-0.0 00000004:00080000:1.0:1788797072.135591:0:3300:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8cb0778ddc00/2, rc 0, transno 4294967321 00000100:00100000:1.0:1788797072.135596:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb0778ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875689374560384:0@lo:2:osp-syn-0-0.0 00010000:00010000:2.0:1788797072.137203:0:8446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008bf68295/0xca7fc0c411f94460 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788797072.137295:0:3303:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8cb0778dd880/2, rc 0, transno 4294967322 00000100:00100000:2.0:1788797072.137304:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb0778dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875689374560256:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1788797072.137350:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788797072.137352:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788797072.137354:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788797072.152438:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1788797072.153896:0:10829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351509888 00000100:00100000:2.0:1788797072.153909:0:10829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351509888 00000100:00100000:2.0:1788797072.154982:0:10829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 69 00000100:00100000:2.0:1788797072.155002:0:10829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb077f0ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e6d050bb-169e-4784-be5b-7071799bf3b0+12:2352:x1875689351509888:12345-192.168.204.38@tcp:16:lhsmtool_posix.0 00010000:00010000:1.0:1788797072.178274:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1788797072.246634:0:6713:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967322 is committed 00000001:00080000:2.0:1788797072.246659:0:6713:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967319 is committed 00000001:00080000:2.0:1788797072.246682:0:6713:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967320 is committed 00000100:00100000:0.0:1788797072.252826:0:10829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb077f0ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e6d050bb-169e-4784-be5b-7071799bf3b0+7:2352:x1875689351509888:12345-192.168.204.38@tcp:16:lhsmtool_posix.0 Request processed in 97814us (100379us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797072.252845:0:10829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 69 00000100:00100000:3.0:1788797072.256129:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1788797072.256205:0:7636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351510144 00000100:00100000:2.0:1788797072.256216:0:7636:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351510144 00000100:00100000:2.0:1788797072.256266:0:7636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 227 00000100:00100000:2.0:1788797072.256277:0:7636:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb077f09880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6d050bb-169e-4784-be5b-7071799bf3b0+20:11627:x1875689351510144:12345-192.168.204.38@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788797072.256335:0:7636:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788797072.256362:0:7636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c68800/0xca7fc0c411f94444 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1368 expref: 20 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797072.256382:0:7636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8cb0821d4100) 00010000:00010000:2.0:1788797072.256387:0:7636:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788797072.256429:0:7636:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040030000/0xca7fc0c411f94467 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797072.256443:0:7636:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040030000/0xca7fc0c411f94467 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797072.256453:0:7636:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040030000/0xca7fc0c411f94467 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788797072.256737:0:7636:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000cecbef8e reply state 00000000a0b8e926 transno 4294967507 ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040030000/0xca7fc0c411f94467 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788797072.256856:0:7636:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788797072.256974:0:7636:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb077f09880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6d050bb-169e-4784-be5b-7071799bf3b0+21:11627:x1875689351510144:12345-192.168.204.38@tcp:36:lhsmtool_posix.0 Request processed in 697us (853us total) trans 4294967507 rc 0/0 00000100:00100000:2.0:1788797072.256982:0:7636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 227 00000100:00100000:1.0:1788797072.260391:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00010000:00010000:3.0:1788797072.260499:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040030000/0xca7fc0c411f94467 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797072.260513:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040030000/0xca7fc0c411f94467 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797072.260523:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040030000/0xca7fc0c411f94467 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797072.260546:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb040030000 already unused, calling callback (ffffffffc1f014f0) 00010000:00010000:3.0:1788797072.260552:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040030000/0xca7fc0c411f94467 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797072.260572:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040030000/0xca7fc0c411f94467 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797072.260602:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8cb0821d4100) 00010000:00010000:3.0:1788797072.260605:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788797072.260611:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040030000/0xca7fc0c411f94467 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797072.260618:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040030000/0xca7fc0c411f94467 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788797072.260983:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351510272 00000100:00100000:2.0:1788797072.260994:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351510272 00000100:00100000:2.0:1788797072.261075:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 70 00000100:00100000:2.0:1788797072.261088:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb080476d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e6d050bb-169e-4784-be5b-7071799bf3b0+7:2355:x1875689351510272:12345-192.168.204.38@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1788797072.261356:0:6684:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:2.0:1788797072.261360:0:6684:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 1788797072 -> 1788797071 00002000:00010000:2.0:1788797072.261362:0:6684:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 0 -> 1788797070 00002000:00010000:2.0:1788797072.261364:0:6684:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1788797072 -> 1788797071 00002000:00010000:2.0:1788797072.261367:0:6684:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:2.0:1788797072.261435:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb080476d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e6d050bb-169e-4784-be5b-7071799bf3b0+8:2355:x1875689351510272:12345-192.168.204.38@tcp:2:lhsmtool_posix.0 Request processed in 350us (1055us total) trans 4294967323 rc 0/0 00000100:00100000:2.0:1788797072.261442:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 70 00000100:00100000:1.0:1788797072.268397:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1788797072.268519:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351510528 00000100:00100000:2.0:1788797072.268530:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351510528 00000100:00100000:2.0:1788797072.268606:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 228 00000100:00100000:2.0:1788797072.268618:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb080475500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6d050bb-169e-4784-be5b-7071799bf3b0+20:11627:x1875689351510528:12345-192.168.204.38@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1788797072.268704:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040030c00/0xca7fc0c411f9446e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797072.268765:0:5826:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2800/0xca7fc0c411f94428 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee135a expref: 20 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797072.268774:0:5826:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040030c00/0xca7fc0c411f9446e lrc: 4/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797072.268811:0:5826:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2800/0xca7fc0c411f94428 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee135a expref: 20 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797072.268828:0:5826:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2800/0xca7fc0c411f94428 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee135a expref: 20 pid: 5827 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788797072.268844:0:5826:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb0795dbb80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5826:1875689374560768:192.168.204.38@tcp:104: 00000100:00100000:2.0:1788797072.268952:0:5826:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb0484fae40 going to sleep for 11 seconds 00000100:00100000:1.0:1788797072.273174:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1788797072.273510:0:11663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351510656 00000100:00100000:3.0:1788797072.273522:0:11663:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351510656 00010000:00010000:3.0:1788797072.273578:0:11663:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2800/0xca7fc0c411f94428 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee135a expref: 21 pid: 5827 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788797072.273630:0:11663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 80 00000100:00100000:3.0:1788797072.273641:0:11663:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb080477b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e6d050bb-169e-4784-be5b-7071799bf3b0+21:2354:x1875689351510656:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788797072.273660:0:11663:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788797072.273668:0:11663:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2800/0xca7fc0c411f94428 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee135a expref: 21 pid: 5827 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797072.273684:0:11663:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2800/0xca7fc0c411f94428 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee135a expref: 21 pid: 5827 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797072.273754:0:11663:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8cb0821d4100) 00010000:00010000:3.0:1788797072.273760:0:11663:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040030c00/0xca7fc0c411f9446e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797072.273771:0:11663:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040030c00/0xca7fc0c411f9446e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797072.273780:0:11663:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040030c00/0xca7fc0c411f9446e lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797072.273802:0:11663:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788797072.273868:0:11663:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb080477b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e6d050bb-169e-4784-be5b-7071799bf3b0+21:2354:x1875689351510656:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 228us (704us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797072.273877:0:11663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 80 00010000:00010000:2.0:1788797072.274952:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2800/0xca7fc0c411f94428 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee135a expref: 20 pid: 5827 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788797072.274973:0:5826:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb0795dbb80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5826:1875689374560768:192.168.204.38@tcp:104: 00010000:00010000:2.0:1788797072.274998:0:5826:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040030c00/0xca7fc0c411f9446e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797072.275007:0:5826:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040030c00/0xca7fc0c411f9446e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797072.275013:0:5826:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040030c00/0xca7fc0c411f9446e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797072.275090:0:5826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040030c00/0xca7fc0c411f9446e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797072.275113:0:5826:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040030c00/0xca7fc0c411f9446e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797072.275121:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040030c00/0xca7fc0c411f9446e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797072.275127:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb040030c00 already unused, calling callback (ffffffffc1f014f0) 00010000:00010000:2.0:1788797072.275132:0:5826:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040030c00/0xca7fc0c411f9446e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797072.275139:0:5826:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040030c00/0xca7fc0c411f9446e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797072.275154:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8cb0821d4100) 00010000:00010000:2.0:1788797072.275157:0:5826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1788797072.275163:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040030c00/0xca7fc0c411f9446e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797072.275169:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040030c00/0xca7fc0c411f9446e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788797072.275260:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb080475500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6d050bb-169e-4784-be5b-7071799bf3b0+19:11627:x1875689351510528:12345-192.168.204.38@tcp:55:lhsmtool_posix.0 Request processed in 6644us (6873us total) trans 0 rc -22/-22 00000100:00100000:2.0:1788797072.275270:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 228 00000100:00100000:0.0:1788797072.279433:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1788797072.279483:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1788797072.279521:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1788797072.279737:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351510784 00000100:00100000:2.0:1788797072.279747:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351510784 00000100:00100000:2.0:1788797072.279802:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 302 00000100:00100000:2.0:1788797072.279811:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb060707450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4d9d1a9-601d-459e-8721-8bfc2fdde84f+13:2355:x1875689351510784:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:2.0:1788797072.279892:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb060707450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4d9d1a9-601d-459e-8721-8bfc2fdde84f+13:2355:x1875689351510784:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 82us (409us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797072.279914:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 302 00000100:00100000:1.0:1788797072.279989:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351510912 00000100:00100000:1.0:1788797072.279993:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351510912 00000100:00100000:1.0:1788797072.280071:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 67 00000100:00100000:1.0:1788797072.280080:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb077c31f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e6d050bb-169e-4784-be5b-7071799bf3b0+7:2355:x1875689351510912:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:1.0:1788797072.280120:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb077c31f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e6d050bb-169e-4784-be5b-7071799bf3b0+7:2355:x1875689351510912:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 42us (710us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797072.280127:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 67 00000100:00080000:2.0:1788797072.280342:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788797072.280668:0:7636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351511040 00000100:00100000:3.0:1788797072.280675:0:7636:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351511040 00000100:00100000:3.0:1788797072.280733:0:7636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 166 00000100:00100000:3.0:1788797072.280742:0:7636:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb077c33100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed124ec0-b908-4000-b768-8e53d5def0fc+5:2355:x1875689351511040:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:3.0:1788797072.280785:0:7636:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb077c33100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed124ec0-b908-4000-b768-8e53d5def0fc+5:2355:x1875689351511040:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 45us (1263us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797072.280791:0:7636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 166 00000100:00080000:2.0:1788797072.284136:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788797072.287053:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1788797072.287168:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351511168 00000100:00100000:2.0:1788797072.287180:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351511168 00000100:00100000:2.0:1788797072.287245:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 71 00000100:00100000:2.0:1788797072.287256:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb077c33800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e6d050bb-169e-4784-be5b-7071799bf3b0+8:2354:x1875689351511168:12345-192.168.204.38@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1788797072.287321:0:6684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000000153eebb/0xca7fc0c411f94475 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797072.287344:0:6684:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000039ca93bf/0xca7fc0c411f94452 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1376 expref: 8 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797072.287352:0:6684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788797072.287357:0:6684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788797072.287361:0:6684:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000153eebb/0xca7fc0c411f94475 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797072.287397:0:6684:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000039ca93bf/0xca7fc0c411f94452 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1376 expref: 8 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797072.287422:0:6684:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000039ca93bf/0xca7fc0c411f94452 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1376 expref: 8 pid: 6683 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788797072.287436:0:6684:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb0795dbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6684:1875689374560896:192.168.204.38@tcp:104: 00000100:00100000:2.0:1788797072.287536:0:6684:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb0484fa900 going to sleep for 11 seconds 00000100:00100000:3.0:1788797072.303899:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1788797072.304280:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351511296 00000100:00100000:0.0:1788797072.304291:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351511296 00010000:00010000:0.0:1788797072.304337:0:5812:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000039ca93bf/0xca7fc0c411f94452 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1376 expref: 9 pid: 6683 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788797072.304383:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 81 00000100:00100000:0.0:1788797072.304395:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb077f0a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e6d050bb-169e-4784-be5b-7071799bf3b0+9:2353:x1875689351511296:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788797072.304420:0:5812:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788797072.304459:0:5812:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000039ca93bf/0xca7fc0c411f94452 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1376 expref: 9 pid: 6683 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797072.304475:0:5812:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000039ca93bf/0xca7fc0c411f94452 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1376 expref: 9 pid: 6683 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797072.304502:0:5812:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788797072.304519:0:5812:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788797072.304525:0:5812:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000153eebb/0xca7fc0c411f94475 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797072.304535:0:5812:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000153eebb/0xca7fc0c411f94475 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797072.304563:0:5812:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788797072.304624:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb077f0a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e6d050bb-169e-4784-be5b-7071799bf3b0+9:2353:x1875689351511296:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 232us (734us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797072.304632:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 81 00010000:00010000:2.0:1788797072.305141:0:6684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000039ca93bf/0xca7fc0c411f94452 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1376 expref: 8 pid: 6683 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788797072.305159:0:6684:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb0795dbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6684:1875689374560896:192.168.204.38@tcp:104: 00010000:00010000:2.0:1788797072.305179:0:6684:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000000153eebb/0xca7fc0c411f94475 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797072.305190:0:6684:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000000153eebb/0xca7fc0c411f94475 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797072.305198:0:6684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000153eebb/0xca7fc0c411f94475 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797072.305224:0:6684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000000153eebb/0xca7fc0c411f94475 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797072.305233:0:6684:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000153eebb/0xca7fc0c411f94475 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797072.305243:0:6684:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000153eebb/0xca7fc0c411f94475 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797072.305251:0:6684:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb040030c00 already unused, calling callback (ffffffffc14d98b0) 00010000:00010000:2.0:1788797072.305256:0:6684:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000153eebb/0xca7fc0c411f94475 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797072.305281:0:6684:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000153eebb/0xca7fc0c411f94475 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797072.305327:0:6684:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000153eebb/0xca7fc0c411f94475 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797072.305335:0:6684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000153eebb/0xca7fc0c411f94475 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788797072.305404:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb077c33800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e6d050bb-169e-4784-be5b-7071799bf3b0+7:2354:x1875689351511168:12345-192.168.204.38@tcp:1:lhsmtool_posix.0 Request processed in 18150us (18392us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797072.305424:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 71 00000100:00100000:3.0:1788797072.310379:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1788797072.310487:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351511552 00000100:00100000:1.0:1788797072.310505:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351511552 00000100:00100000:1.0:1788797072.310841:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 229 00000100:00100000:1.0:1788797072.310855:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb077f08a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6d050bb-169e-4784-be5b-7071799bf3b0+19:11627:x1875689351511552:12345-192.168.204.38@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1788797072.310958:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045c00/0xca7fc0c411f9447c lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797072.310982:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045c00/0xca7fc0c411f9447c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797072.310998:0:5827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045c00/0xca7fc0c411f9447c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797072.311946:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3400/0xca7fc0c411f94483 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797072.311965:0:5827:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69c00/0xca7fc0c411f94436 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1361 expref: 20 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797072.311975:0:5827:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3400/0xca7fc0c411f94483 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797072.312023:0:5827:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69c00/0xca7fc0c411f94436 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1361 expref: 20 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797072.312379:0:5827:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69c00/0xca7fc0c411f94436 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1361 expref: 20 pid: 5827 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788797072.312400:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb077c31500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5827:1875689374561024:192.168.204.38@tcp:104: 00000100:00100000:0.0:1788797072.313339:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb04887e3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788797072.323151:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1788797072.323768:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb077c31500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5827:1875689374561024:192.168.204.38@tcp:104: 00010000:00010000:3.0:1788797072.323795:0:5827:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3400/0xca7fc0c411f94483 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788797072.324098:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351511680 00000100:00100000:1.0:1788797072.324115:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351511680 00010000:00010000:1.0:1788797072.324158:0:6698:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69c00/0xca7fc0c411f94436 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1361 expref: 21 pid: 5827 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788797072.324201:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 82 00000100:00100000:1.0:1788797072.324211:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb077c33480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e6d050bb-169e-4784-be5b-7071799bf3b0+21:2355:x1875689351511680:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788797072.324228:0:6698:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788797072.324235:0:6698:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69c00/0xca7fc0c411f94436 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1361 expref: 21 pid: 5827 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797072.324248:0:6698:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69c00/0xca7fc0c411f94436 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1361 expref: 21 pid: 5827 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797072.324272:0:6698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69c00/0xca7fc0c411f94436 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1361 expref: 21 pid: 5827 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797072.324291:0:6698:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8cb0821d4100) 00010000:00010000:1.0:1788797072.324296:0:6698:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3400/0xca7fc0c411f94483 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797072.324306:0:6698:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3400/0xca7fc0c411f94483 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797072.324314:0:6698:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3400/0xca7fc0c411f94483 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797072.324341:0:6698:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788797072.324394:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb077c33480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e6d050bb-169e-4784-be5b-7071799bf3b0+20:2355:x1875689351511680:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 184us (1257us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797072.324420:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 82 00010000:00010000:0.0:1788797072.324868:0:5827:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3400/0xca7fc0c411f94483 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797072.324878:0:5827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3400/0xca7fc0c411f94483 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788797072.325104:0:5827:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967508 00000001:00080000:0.0:1788797072.325235:0:5827:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967509 00000001:00080000:0.0:1788797072.325272:0:5827:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967510 00000100:00100000:0.0:1788797072.325342:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb077c32a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5827:1875689374561152:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1788797072.325394:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788797072.325435:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb049151d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788797072.326383:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374561152 00000100:00100000:1.0:1788797072.326392:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374561152 00000100:00100000:1.0:1788797072.326456:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788797072.326466:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb077c30000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5827:x1875689374561152:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1788797072.326593:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb077c30000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5827:x1875689374561152:12345-0@lo:1000:mdt00_002.0 Request processed in 129us (1198us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797072.326600:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788797072.327202:0:5827:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967322 gen 2 00000004:00080000:2.0:1788797072.327209:0:5827:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967317 committed transno 4294967322 00000004:00080000:2.0:1788797072.327228:0:5827:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8cb0778ddc00, transno 4294967321 00000004:00080000:2.0:1788797072.327241:0:5827:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8cb0778dd880, transno 4294967322 00000100:00100000:2.0:1788797072.327249:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb077c32a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5827:1875689374561152:0@lo:1000:mdt00_002.0 00000001:00080000:3.0:1788797072.329806:0:5827:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000100:00100000:3.0:1788797072.330111:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb0794f6680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5827:1875689374561280:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1788797072.330198:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788797072.330258:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb04919a0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788797072.330280:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374561280 00000100:00100000:1.0:1788797072.330292:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374561280 00000100:00100000:1.0:1788797072.330353:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788797072.330364:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb050383100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5827:x1875689374561280:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1788797072.332388:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb050383100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5827:x1875689374561280:12345-0@lo:1000:mdt00_002.0 Request processed in 2017us (2182us total) trans 4294967324 rc 0/0 00000100:00100000:1.0:1788797072.332402:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788797072.332495:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb0794f6680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5827:1875689374561280:0@lo:1000:mdt00_002.0 00010000:00010000:3.0:1788797072.332562:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3400/0xca7fc0c411f94483 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797072.332577:0:5827:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3400/0xca7fc0c411f94483 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797072.332587:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3400/0xca7fc0c411f94483 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797072.332595:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb042ea3400 already unused, calling callback (ffffffffc1f014f0) 00010000:00010000:3.0:1788797072.332602:0:5827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3400/0xca7fc0c411f94483 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797072.332612:0:5827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3400/0xca7fc0c411f94483 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797072.332634:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8cb0821d4100) 00010000:00010000:3.0:1788797072.332637:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788797072.332645:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3400/0xca7fc0c411f94483 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797072.332651:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3400/0xca7fc0c411f94483 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797072.332701:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69200/0xca7fc0c411f943c6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797072.332731:0:5827:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69200/0xca7fc0c411f943c6 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797072.332737:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69200/0xca7fc0c411f943c6 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797072.332742:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb077c69200 already unused, calling callback (ffffffffc1f014f0) 00010000:00010000:3.0:1788797072.332746:0:5827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69200/0xca7fc0c411f943c6 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797072.332752:0:5827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69200/0xca7fc0c411f943c6 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797072.332761:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8cb065cc2c00) 00010000:00010000:3.0:1788797072.332764:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788797072.332772:0:5827:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3200/0xca7fc0c411f943cd lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1345 expref: 23 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797072.332786:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3200/0xca7fc0c411f943cd lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1345 expref: 23 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797072.332797:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3200/0xca7fc0c411f943cd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1345 expref: 23 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797072.332840:0:5827:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3200/0xca7fc0c411f943cd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1345 expref: 23 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788797072.332855:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb077e30a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5827:1875689374561408:192.168.204.38@tcp:105: 00000100:00100000:3.0:1788797072.333230:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb04887e6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788797072.341419:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1788797072.341696:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb077e30a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5827:1875689374561408:192.168.204.38@tcp:105: 00010000:00010000:3.0:1788797072.341725:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69200/0xca7fc0c411f943c6 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797072.341735:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69200/0xca7fc0c411f943c6 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797072.341767:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c68600/0xca7fc0c411f9448a lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797072.341781:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c68600/0xca7fc0c411f9448a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797072.341792:0:5827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c68600/0xca7fc0c411f9448a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797072.341802:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c68600/0xca7fc0c411f9448a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797072.341807:0:5827:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c68600/0xca7fc0c411f9448a lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797072.341813:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c68600/0xca7fc0c411f9448a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797072.341818:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb077c68600 already unused, calling callback (ffffffffc1f014f0) 00010000:00010000:3.0:1788797072.341823:0:5827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c68600/0xca7fc0c411f9448a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797072.341829:0:5827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c68600/0xca7fc0c411f9448a lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797072.341863:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8cb065cc2c00) 00010000:00010000:3.0:1788797072.341866:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788797072.341867:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351511808 00000100:00100000:1.0:1788797072.341875:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351511808 00010000:00010000:3.0:1788797072.341884:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c68600/0xca7fc0c411f9448a lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797072.341893:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c68600/0xca7fc0c411f9448a lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797072.341906:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045c00/0xca7fc0c411f9447c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797072.341913:0:5827:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045c00/0xca7fc0c411f9447c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797072.341920:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045c00/0xca7fc0c411f9447c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797072.341925:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb082045c00 already unused, calling callback (ffffffffc1f014f0) 00010000:00010000:3.0:1788797072.341927:0:5827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045c00/0xca7fc0c411f9447c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797072.341940:0:5827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045c00/0xca7fc0c411f9447c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797072.341950:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8cb065cc2c00) 00010000:00010000:3.0:1788797072.341953:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788797072.341956:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045c00/0xca7fc0c411f9447c lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797072.341962:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045c00/0xca7fc0c411f9447c lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788797072.341981:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 61 00000100:00100000:1.0:1788797072.341993:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb077c31180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e6d050bb-169e-4784-be5b-7071799bf3b0+24:11626:x1875689351511808:12345-192.168.204.38@tcp:49:lfs.0 00000100:00100000:1.0:1788797072.342156:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb077c31180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e6d050bb-169e-4784-be5b-7071799bf3b0+24:11626:x1875689351511808:12345-192.168.204.38@tcp:49:lfs.0 Request processed in 165us (758us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797072.342173:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 61 00000100:00100000:3.0:1788797072.342224:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb077f08a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6d050bb-169e-4784-be5b-7071799bf3b0+23:11627:x1875689351511552:12345-192.168.204.38@tcp:57:lhsmtool_posix.0 Request processed in 31357us (31841us total) trans 4294967512 rc 0/0 00000100:00100000:3.0:1788797072.342234:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 229 00000020:00080000:3.0:1788797072.342239:0:5827:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1788797072.342325:0:11679:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788797072.342330:0:11679:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788797072.342864:0:11679:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:2.0:1788797072.342872:0:11679:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788797072.350394:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1788797072.350463:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1788797072.350531:0:7636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351512320 00000100:00100000:3.0:1788797072.350541:0:7636:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351512320 00000100:00100000:3.0:1788797072.350600:0:7636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 230 00000100:00100000:3.0:1788797072.350609:0:7636:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0795c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6d050bb-169e-4784-be5b-7071799bf3b0+23:11626:x1875689351512320:12345-192.168.204.38@tcp:58:lfs.0 00000040:00080000:3.0:1788797072.350979:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:3.0:1788797072.351141:0:7636:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0795c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6d050bb-169e-4784-be5b-7071799bf3b0+23:11626:x1875689351512320:12345-192.168.204.38@tcp:58:lfs.0 Request processed in 532us (676us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797072.351150:0:7636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 230 00000100:00100000:0.0:1788797072.351998:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351512064 00000100:00100000:0.0:1788797072.352009:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351512064 00000100:00100000:0.0:1788797072.352094:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 62 00000100:00100000:0.0:1788797072.352104:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb050637850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e6d050bb-169e-4784-be5b-7071799bf3b0+23:11627:x1875689351512064:12345-192.168.204.38@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1788797072.362387:0:5829:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1788797072.362533:0:5829:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967513 00010000:00010000:2.0:1788797072.364280:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040030c00/0xca7fc0c411f94491 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797072.364320:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040030c00/0xca7fc0c411f94491 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797072.364334:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040030c00/0xca7fc0c411f94491 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797072.364345:0:5829:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040030c00/0xca7fc0c411f94491 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797072.364352:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040030c00/0xca7fc0c411f94491 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797072.364358:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040030c00/0xca7fc0c411f94491 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797072.364386:0:5829:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788797072.364525:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb050637850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e6d050bb-169e-4784-be5b-7071799bf3b0+25:11627:x1875689351512064:12345-192.168.204.38@tcp:35:lhsmtool_posix.0 Request processed in 12418us (14135us total) trans 4294967514 rc 0/0 00000100:00100000:2.0:1788797072.364536:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 62 00000020:00080000:2.0:1788797072.364543:0:5829:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788797072.365045:0:5815:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788797072.365064:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040030c00/0xca7fc0c411f94491 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797072.365070:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb040030c00 already unused, calling callback (ffffffffc14d98b0) 00010000:00010000:1.0:1788797072.365074:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040030c00/0xca7fc0c411f94491 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797072.365083:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040030c00/0xca7fc0c411f94491 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797072.365097:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8cb05088a800) 00010000:00010000:1.0:1788797072.365100:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788797072.365105:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040030c00/0xca7fc0c411f94491 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797072.365111:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040030c00/0xca7fc0c411f94491 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797072.365132:0:5815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788797072.365134:0:5815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788797072.365135:0:5815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788797072.419969:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1788797072.423145:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351512448 00000100:00100000:2.0:1788797072.423165:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351512448 00000100:00100000:2.0:1788797072.423257:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 231 00000100:00100000:2.0:1788797072.423270:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0795c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6d050bb-169e-4784-be5b-7071799bf3b0+25:11630:x1875689351512448:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1788797072.423310:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788797072.423338:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040030000/0xca7fc0c411f94498 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c99e04559ee137d expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797072.423426:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040030800/0xca7fc0c411f9449f lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797072.423454:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040030800/0xca7fc0c411f9449f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797072.423468:0:5826:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040030800/0xca7fc0c411f9449f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797072.423483:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040031400/0xca7fc0c411f944a6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797072.423490:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040031400/0xca7fc0c411f944a6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797072.423497:0:5826:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040031400/0xca7fc0c411f944a6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797072.425212:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040030c00/0xca7fc0c411f944ad lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797072.425235:0:5826:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69800/0xca7fc0c411f943b8 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee133e expref: 26 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797072.425246:0:5826:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040030c00/0xca7fc0c411f944ad lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797072.425289:0:5826:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69800/0xca7fc0c411f943b8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee133e expref: 26 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797072.425306:0:5826:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69800/0xca7fc0c411f943b8 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee133e expref: 26 pid: 7636 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788797072.425337:0:5826:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb0795dbb80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5826:1875689374561536:192.168.204.38@tcp:104: 00000100:00100000:2.0:1788797072.425487:0:5826:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb0484fa780 going to sleep for 11 seconds 00000100:00100000:3.0:1788797072.434693:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1788797072.434877:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351512704 00000100:00100000:1.0:1788797072.434889:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351512704 00000100:00100000:1.0:1788797072.434972:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 63 00000100:00100000:1.0:1788797072.434985:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb077e30a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e6d050bb-169e-4784-be5b-7071799bf3b0+27:5608:x1875689351512704:12345-192.168.204.38@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1788797072.435273:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb077e30a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e6d050bb-169e-4784-be5b-7071799bf3b0+28:5608:x1875689351512704:12345-192.168.204.38@tcp:35:ldlm_bl.0 Request processed in 280us (578us total) trans 4294967515 rc 0/0 00000100:00100000:1.0:1788797072.435281:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 63 00000100:00100000:2.0:1788797072.436420:0:5826:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb0795dbb80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5826:1875689374561536:192.168.204.38@tcp:104: 00010000:00010000:2.0:1788797072.436450:0:5826:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040030c00/0xca7fc0c411f944ad lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788797072.439867:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1788797072.440159:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351512832 00000100:00100000:1.0:1788797072.440179:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351512832 00010000:00010000:1.0:1788797072.440216:0:5813:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69800/0xca7fc0c411f943b8 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee133e expref: 28 pid: 7636 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788797072.440346:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 83 00000100:00100000:1.0:1788797072.440356:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb077c30a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e6d050bb-169e-4784-be5b-7071799bf3b0+28:2355:x1875689351512832:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788797072.440372:0:5813:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788797072.440378:0:5813:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69800/0xca7fc0c411f943b8 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee133e expref: 28 pid: 7636 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797072.440391:0:5813:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69800/0xca7fc0c411f943b8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee133e expref: 28 pid: 7636 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797072.440423:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69800/0xca7fc0c411f943b8 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee133e expref: 28 pid: 7636 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797072.440439:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8cb065cc2c00) 00010000:00010000:1.0:1788797072.440443:0:5813:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040030c00/0xca7fc0c411f944ad lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797072.440453:0:5813:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040030c00/0xca7fc0c411f944ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797072.440460:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040030c00/0xca7fc0c411f944ad lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797072.440491:0:5813:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788797072.440548:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb077c30a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e6d050bb-169e-4784-be5b-7071799bf3b0+27:2355:x1875689351512832:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 194us (691us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797072.440575:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 83 00010000:00010000:2.0:1788797072.440635:0:5826:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040030c00/0xca7fc0c411f944ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797072.440645:0:5826:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040030c00/0xca7fc0c411f944ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788797072.440687:0:5826:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:2.0:1788797072.440692:0:5826:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788797072.440712:0:5826:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040030c00/0xca7fc0c411f944ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797072.440736:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040030c00/0xca7fc0c411f944ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797072.440745:0:5826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040030800/0xca7fc0c411f9449f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797072.440752:0:5826:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040030800/0xca7fc0c411f9449f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797072.440758:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040030800/0xca7fc0c411f9449f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797072.440763:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb040030800 already unused, calling callback (ffffffffc1f014f0) 00010000:00010000:2.0:1788797072.440774:0:5826:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040030800/0xca7fc0c411f9449f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797072.440783:0:5826:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040030800/0xca7fc0c411f9449f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797072.440792:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8cb058766500) 00010000:00010000:2.0:1788797072.440795:0:5826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788797072.440799:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040030800/0xca7fc0c411f9449f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797072.440805:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040030800/0xca7fc0c411f9449f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797072.440817:0:5826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040031400/0xca7fc0c411f944a6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797072.440823:0:5826:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040031400/0xca7fc0c411f944a6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797072.440828:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040031400/0xca7fc0c411f944a6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797072.440833:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb040031400 already unused, calling callback (ffffffffc1f014f0) 00010000:00010000:2.0:1788797072.440836:0:5826:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040031400/0xca7fc0c411f944a6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797072.440841:0:5826:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040031400/0xca7fc0c411f944a6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797072.440847:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8cb05088ad00) 00010000:00010000:2.0:1788797072.440849:0:5826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788797072.440858:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040031400/0xca7fc0c411f944a6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797072.440864:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040031400/0xca7fc0c411f944a6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797072.440899:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040030000/0xca7fc0c411f94498 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee137d expref: 27 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797072.440924:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040030c00/0xca7fc0c411f944ad lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee137d expref: 26 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797072.440931:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8cb065cc2c00) 00010000:00010000:2.0:1788797072.440933:0:5826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788797072.440935:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb040030c00, rc 0) 00000100:00100000:2.0:1788797072.440959:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0795c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6d050bb-169e-4784-be5b-7071799bf3b0+26:11630:x1875689351512448:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 17693us (21007us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797072.440966:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 231 00010000:00010000:1.0:1788797073.202411:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788797073.395336:0:11679:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788797073.395346:0:11679:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788797073.395399:0:11679:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:2.0:1788797073.395494:0:11679:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788797073.395683:0:11679:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb0795dbb80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11679:1875689374561664:192.168.204.38@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788797073.397902:0:11679:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb047c30e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788797073.416593:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1788797073.416691:0:11679:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb0795dbb80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11679:1875689374561664:192.168.204.38@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788797073.417116:0:7636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351512960 00000100:00100000:3.0:1788797073.417131:0:7636:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351512960 00000100:00100000:3.0:1788797073.417215:0:7636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 232 00000100:00100000:3.0:1788797073.417230:0:7636:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0795c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6d050bb-169e-4784-be5b-7071799bf3b0+26:11642:x1875689351512960:12345-192.168.204.38@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788797073.417282:0:7636:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788797073.417437:0:7636:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0795c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6d050bb-169e-4784-be5b-7071799bf3b0+26:11642:x1875689351512960:12345-192.168.204.38@tcp:53:lhsmtool_posix.0 Request processed in 211us (854us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797073.417445:0:7636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 232 00000100:00100000:0.0:1788797073.428551:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1788797073.428617:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351513216 00000100:00100000:2.0:1788797073.428630:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351513216 00000100:00100000:2.0:1788797073.428715:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 233 00000100:00100000:2.0:1788797073.428729:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb077c30700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6d050bb-169e-4784-be5b-7071799bf3b0+26:11642:x1875689351513216:12345-192.168.204.38@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788797073.428771:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788797073.428798:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040031e00/0xca7fc0c411f944b4 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c99e04559ee1384 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797073.428925:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040030800/0xca7fc0c411f944bb lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797073.428944:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040030800/0xca7fc0c411f944bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797073.428958:0:5827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040030800/0xca7fc0c411f944bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788797073.428972:0:5827:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:2.0:1788797073.429165:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040031e00/0xca7fc0c411f944b4 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1384 expref: 29 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797073.429183:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040030800/0xca7fc0c411f944bb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1384 expref: 28 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797073.429192:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8cb065cc2c00) 00010000:00010000:2.0:1788797073.429196:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788797073.429200:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb040030800, rc 0) 00000100:00100000:2.0:1788797073.429424:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb077c30700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6d050bb-169e-4784-be5b-7071799bf3b0+28:11642:x1875689351513216:12345-192.168.204.38@tcp:101:lhsmtool_posix.0 Request processed in 697us (880us total) trans 4294967516 rc 0/0 00000100:00100000:2.0:1788797073.429434:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 233 00000100:00100000:0.0:1788797073.440086:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1788797073.440177:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1788797073.440217:0:7636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351513600 00000100:00100000:0.0:1788797073.440230:0:7636:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351513600 00000100:00100000:0.0:1788797073.440290:0:7636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 234 00000100:00100000:0.0:1788797073.440300:0:7636:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb077c30380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6d050bb-169e-4784-be5b-7071799bf3b0+28:11642:x1875689351513600:12345-192.168.204.38@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1788797073.440410:0:7636:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2c00/0xca7fc0c411f944c9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797073.440433:0:7636:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2c00/0xca7fc0c411f944c9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797073.440448:0:7636:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2c00/0xca7fc0c411f944c9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788797073.440515:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351513344 00000100:00100000:2.0:1788797073.440520:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351513344 00000100:00100000:2.0:1788797073.440566:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 18 00000100:00100000:2.0:1788797073.440587:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb077c32300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e6d050bb-169e-4784-be5b-7071799bf3b0+29:2353:x1875689351513344:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788797073.440600:0:5811:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788797073.440620:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040030800/0xca7fc0c411f944bb lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1384 expref: 29 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797073.440639:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8cb065cc2c00) 00010000:00010000:2.0:1788797073.440646:0:5811:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788797073.440712:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb077c32300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e6d050bb-169e-4784-be5b-7071799bf3b0+29:2353:x1875689351513344:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 126us (634us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797073.440721:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 18 00010000:00010000:0.0:1788797073.440727:0:7636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2c00/0xca7fc0c411f944c9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797073.440738:0:7636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2c00/0xca7fc0c411f944c9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797073.440745:0:7636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2c00/0xca7fc0c411f944c9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797073.440751:0:7636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb042ea2c00 already unused, calling callback (ffffffffc1f014f0) 00010000:00010000:0.0:1788797073.440756:0:7636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2c00/0xca7fc0c411f944c9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797073.440765:0:7636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2c00/0xca7fc0c411f944c9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797073.440775:0:7636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8cb065cc2c00) 00010000:00010000:0.0:1788797073.440785:0:7636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788797073.440790:0:7636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2c00/0xca7fc0c411f944c9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797073.440796:0:7636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2c00/0xca7fc0c411f944c9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788797073.440935:0:7636:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb077c30380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6d050bb-169e-4784-be5b-7071799bf3b0+28:11642:x1875689351513600:12345-192.168.204.38@tcp:57:lhsmtool_posix.0 Request processed in 625us (745us total) trans 4294967517 rc 0/0 00000100:00100000:0.0:1788797073.440944:0:7636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 234 00000040:00080000:2.0:1788797073.443093:0:11679:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788797073.443103:0:11679:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788797073.443676:0:11679:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:2.0:1788797073.443687:0:11679:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788797073.451660:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1788797073.452517:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351513856 00000100:00100000:1.0:1788797073.452529:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351513856 00000100:00100000:1.0:1788797073.452601:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 64 00000100:00100000:1.0:1788797073.452614:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0795d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e6d050bb-169e-4784-be5b-7071799bf3b0+28:11642:x1875689351513856:12345-192.168.204.38@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788797073.453299:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0795d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e6d050bb-169e-4784-be5b-7071799bf3b0+29:11642:x1875689351513856:12345-192.168.204.38@tcp:35:lhsmtool_posix.0 Request processed in 685us (1648us total) trans 4294967518 rc 0/0 00000100:00100000:1.0:1788797073.453310:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 64 00000100:00100000:2.0:1788797073.458616:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb0795c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875689374561792:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788797073.458700:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788797073.458796:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374561792 00000100:00100000:2.0:1788797073.458806:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374561792 00000100:00100000:2.0:1788797073.458867:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788797073.459145:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0795d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3302:x1875689374561792:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788797073.459172:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3856662528 00000100:00100000:2.0:1788797073.459238:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0795d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3302:x1875689374561792:12345-0@lo:13:osp-pre-0-0.0 Request processed in 349us (537us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797073.459248:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788797073.459511:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb0795c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875689374561792:0@lo:13:osp-pre-0-0.0 00000040:00080000:1.0:1788797073.512211:0:12506:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788797073.512222:0:12506:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788797073.512276:0:12506:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:1.0:1788797073.512283:0:12506:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788797073.788179:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1788797073.800809:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351514112 00000100:00100000:2.0:1788797073.800843:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351514112 00000100:00100000:2.0:1788797073.803732:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 235 00000100:00100000:2.0:1788797073.803754:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb077c31180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6d050bb-169e-4784-be5b-7071799bf3b0+29:11655:x1875689351514112:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1788797073.803788:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788797073.803822:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040031400/0xca7fc0c411f944d0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c99e04559ee138b expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797073.803975:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040030000/0xca7fc0c411f944d7 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797073.803992:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040030000/0xca7fc0c411f944d7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797073.804006:0:5826:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040030000/0xca7fc0c411f944d7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788797073.804020:0:5826:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:2.0:1788797073.804212:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040031400/0xca7fc0c411f944d0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee138b expref: 32 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797073.804239:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040030000/0xca7fc0c411f944d7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee138b expref: 31 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797073.804248:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8cb065cc2c00) 00010000:00010000:2.0:1788797073.804251:0:5826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1788797073.804255:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb040030000, rc 0) 00000100:00100000:2.0:1788797073.804337:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb077c31180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6d050bb-169e-4784-be5b-7071799bf3b0+31:11655:x1875689351514112:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 593us (16170us total) trans 4294967519 rc 0/0 00000100:00100000:2.0:1788797073.804345:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 235 00000100:00100000:2.0:1788797073.829403:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1788797073.830817:0:7636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351514240 00000100:00100000:0.0:1788797073.830832:0:7636:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351514240 00000100:00100000:0.0:1788797073.830911:0:7636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 236 00000100:00100000:0.0:1788797073.830922:0:7636:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0795db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6d050bb-169e-4784-be5b-7071799bf3b0+31:11655:x1875689351514240:12345-192.168.204.38@tcp:54:lfs.0 00010000:00010000:0.0:1788797073.831080:0:7636:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2c00/0xca7fc0c411f944e5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797073.831104:0:7636:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2c00/0xca7fc0c411f944e5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797073.832312:0:7636:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2c00/0xca7fc0c411f944e5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797073.832347:0:7636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2c00/0xca7fc0c411f944e5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797073.832354:0:7636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2c00/0xca7fc0c411f944e5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797073.832393:0:7636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2c00/0xca7fc0c411f944e5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797073.832398:0:7636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb042ea2c00 already unused, calling callback (ffffffffc1f014f0) 00010000:00010000:0.0:1788797073.832403:0:7636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2c00/0xca7fc0c411f944e5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797073.832411:0:7636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2c00/0xca7fc0c411f944e5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797073.832424:0:7636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8cb065cc2c00) 00010000:00010000:0.0:1788797073.832427:0:7636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788797073.832432:0:7636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2c00/0xca7fc0c411f944e5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797073.832438:0:7636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2c00/0xca7fc0c411f944e5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7636 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788797073.832545:0:7636:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0795db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6d050bb-169e-4784-be5b-7071799bf3b0+31:11655:x1875689351514240:12345-192.168.204.38@tcp:54:lfs.0 Request processed in 1620us (3160us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797073.832554:0:7636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 236 00000100:00100000:1.0:1788797073.970428:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb0778dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3302:1875689374562304:0@lo:400:kworker.0 00000100:00100000:1.0:1788797073.970514:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788797073.970595:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788797073.970602:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb0778df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:3302:1875689374561920:0@lo:400:kworker.0 00000100:00100000:1.0:1788797073.970637:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788797073.970665:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb0778dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875689374562432:0@lo:400:kworker.0 00000100:00100000:1.0:1788797073.970699:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788797073.970735:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb0778dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3300:1875689374562048:0@lo:400:kworker.0 00000100:00100000:1.0:1788797073.970757:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788797073.970773:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788797073.970779:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb0778ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3300:1875689374562176:0@lo:400:kworker.0 00000100:00100000:1.0:1788797073.970822:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788797073.970852:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374561920 00000100:00100000:1.0:1788797073.970860:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374561920 00000100:00100000:1.0:1788797073.970904:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 303 00000100:00100000:1.0:1788797073.970914:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb060705850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+19:3302:x1875689374561920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788797073.970969:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb060705850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+19:3302:x1875689374561920:12345-0@lo:400:kworker.0 Request processed in 57us (332us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797073.970977:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 303 00000100:00100000:1.0:1788797073.971012:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374562432 00000100:00100000:1.0:1788797073.971016:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374562432 00000100:00100000:1.0:1788797073.971071:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788797073.971079:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0795c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3302:x1875689374562432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788797073.971111:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0795c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3302:x1875689374562432:12345-0@lo:400:kworker.0 Request processed in 34us (411us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797073.971117:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788797073.971134:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374562304 00000100:00100000:1.0:1788797073.971138:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374562304 00000100:00100000:1.0:1788797073.971164:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374562048 00000100:00100000:1.0:1788797073.971167:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374562048 00000100:00100000:1.0:1788797073.971178:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374562176 00000100:00100000:1.0:1788797073.971180:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374562176 00000100:00100000:1.0:1788797073.971195:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1788797073.971201:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0795c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1875689374562304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788797073.971231:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0795c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1875689374562304:12345-0@lo:400:kworker.0 Request processed in 30us (718us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797073.971237:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1788797073.971248:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1788797073.971254:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0795c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1875689374562048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788797073.971291:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0795c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1875689374562048:12345-0@lo:400:kworker.0 Request processed in 38us (533us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797073.971297:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1788797073.971309:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1788797073.971316:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0795c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1875689374562176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788797073.971339:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0795c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1875689374562176:12345-0@lo:400:kworker.0 Request processed in 25us (517us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797073.971344:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1788797073.971390:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb0778ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3300:1875689374562176:0@lo:400:kworker.0 00000100:00100000:1.0:1788797073.971402:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb0778dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3300:1875689374562048:0@lo:400:kworker.0 00000100:00100000:1.0:1788797073.971429:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb0778df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:3302:1875689374561920:0@lo:400:kworker.0 00000100:00100000:1.0:1788797073.971439:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb0778dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875689374562432:0@lo:400:kworker.0 00000100:00100000:1.0:1788797073.971448:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb0778dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3302:1875689374562304:0@lo:400:kworker.0 00000100:00100000:2.0:1788797073.972184:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788797073.972196:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb0795db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875689374562560:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788797073.972233:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788797073.972275:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788797073.972330:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374562560 00000100:00100000:0.0:1788797073.972335:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374562560 00000100:00100000:0.0:1788797073.972384:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788797073.972394:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0795d9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3301:x1875689374562560:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788797073.972433:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 52756480 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788797073.972485:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0795d9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3301:x1875689374562560:12345-0@lo:13:osp-pre-1-0.0 Request processed in 93us (250us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797073.972492:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788797073.972885:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb0795db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875689374562560:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788797074.024418:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1788797074.024530:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351514368 00000100:00100000:1.0:1788797074.024544:0:6683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351514368 00000100:00100000:1.0:1788797074.024637:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 72 00000100:00100000:1.0:1788797074.024650:0:6683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0795db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e6d050bb-169e-4784-be5b-7071799bf3b0+7:2352:x1875689351514368:12345-192.168.204.38@tcp:101:cat.0 00010000:00010000:1.0:1788797074.024675:0:6683:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788797074.024722:0:6683:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fff90cbe/0xca7fc0c411f944ec lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7c99e04559ee1392 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788797074.024753:0:6683:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 13, mtime: 0x6a9ee08f, atime: 0x6a9ee08e, ctime: 0x6a9ee08f, blocks: 0xb 00010000:00010000:1.0:1788797074.024774:0:6683:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=363s v=(0 0) 00010000:00010000:1.0:1788797074.024792:0:6683:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788797074.024801:0:6683:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fff90cbe/0xca7fc0c411f944ec lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1392 expref: 8 pid: 6683 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797074.024823:0:6683:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fff90cbe/0xca7fc0c411f944ec lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1392 expref: 8 pid: 6683 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797074.024838:0:6683:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb082045200, rc 0) 00000100:00100000:1.0:1788797074.024907:0:6683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0795db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e6d050bb-169e-4784-be5b-7071799bf3b0+8:2352:x1875689351514368:12345-192.168.204.38@tcp:101:cat.0 Request processed in 260us (506us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797074.024914:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 72 00000100:00080000:2.0:1788797074.027166:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788797074.037490:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1788797074.037671:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351514496 00000100:00100000:3.0:1788797074.037693:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351514496 00002000:00100000:3.0:1788797074.037754:0:6688:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x6:0x0] (0->4095) req@ffff8cb0795c4700 x1875689351514496/t0(0) o3->e6d050bb-169e-4784-be5b-7071799bf3b0@192.168.204.38@tcp:500/0 lens 488/0 e 0 to 0 dl 1788797085 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788797074.037780:0:6688:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8cb0795c4700 with x1875689351514496 ext(0->4095) 00002000:00010000:3.0:1788797074.037786:0:6688:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8cb0795c4700 00000100:00100000:3.0:1788797074.037822:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 7 00000100:00100000:3.0:1788797074.037831:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0795c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:e6d050bb-169e-4784-be5b-7071799bf3b0+8:2352:x1875689351514496:12345-192.168.204.38@tcp:3:cat.0 00000100:00100000:3.0:1788797074.038236:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0795c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:e6d050bb-169e-4784-be5b-7071799bf3b0+8:2352:x1875689351514496:12345-192.168.204.38@tcp:3:cat.0 Request processed in 404us (758us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1788797074.038244:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 7 00002000:00100000:3.0:1788797074.038251:0:6688:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x6:0x0] (0->4095) req@ffff8cb0795c4700 x1875689351514496/t0(0) o3->e6d050bb-169e-4784-be5b-7071799bf3b0@192.168.204.38@tcp:500/0 lens 488/4536 e 0 to 0 dl 1788797085 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788797074.038260:0:6688:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8cb0795c4700 with x1875689351514496 ext(0->4095) 00002000:00010000:3.0:1788797074.038264:0:6688:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8cb0795c4700 00010000:00010000:1.0:1788797074.226338:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1788797074.554916:0:7640:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967309 is committed 00000001:00080000:2.0:1788797074.555015:0:7640:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967308 is committed 00000001:00080000:2.0:1788797074.555321:0:7640:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967310 is committed 00010000:00010000:0.0:1788797075.252794:0:5815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788797075.507377:0:11679:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788797075.507389:0:11679:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788797075.507427:0:11679:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:2.0:1788797075.507433:0:11679:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1788797076.274518:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1788797077.203208:0:5848:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967517 is committed 00000001:00080000:1.0:1788797077.203239:0:5848:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967518 is committed 00000001:00080000:1.0:1788797077.203253:0:5848:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967519 is committed 00000020:00080000:1.0:1788797077.203266:0:5848:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00000020:00080000:1.0:1788797077.203296:0:5848:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8cb0484fac00 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:1.0:1788797077.203301:0:5848:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8cb0792e5700 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8cb0484fa240 00000020:00080000:1.0:1788797077.203305:0:5848:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8cb0792e5400 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8cb06f584800 00000020:00080000:0.0:1788797077.203811:0:5859:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:0.0:1788797077.204054:0:5859:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00010000:00010000:1.0:1788797077.299228:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788797077.419358:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1788797077.419458:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1788797077.419536:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1788797077.419586:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1788797077.419683:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1788797077.419719:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351515136 00000100:00100000:0.0:1788797077.419732:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351515136 00000100:00100000:0.0:1788797077.419824:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351514752 00000100:00100000:0.0:1788797077.419831:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351514752 00000100:00100000:0.0:1788797077.419878:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 170 00000100:00100000:0.0:1788797077.419895:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb077c31500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed124ec0-b908-4000-b768-8e53d5def0fc+5:2354:x1875689351515136:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:0.0:1788797077.420011:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb077c31500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed124ec0-b908-4000-b768-8e53d5def0fc+5:2354:x1875689351515136:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 118us (471us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797077.420023:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 170 00000100:00100000:0.0:1788797077.420094:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 171 00000100:00100000:0.0:1788797077.420109:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb077c30e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6d050bb-169e-4784-be5b-7071799bf3b0+18:2354:x1875689351514752:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:0.0:1788797077.420167:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb077c30e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6d050bb-169e-4784-be5b-7071799bf3b0+18:2354:x1875689351514752:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 60us (580us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797077.420178:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 171 00000100:00100000:0.0:1788797077.420217:0:10829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351514880 00000100:00100000:0.0:1788797077.420226:0:10829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351514880 00000100:00100000:0.0:1788797077.420329:0:10829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351515008 00000100:00100000:0.0:1788797077.420336:0:10829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351515008 00000100:00100000:0.0:1788797077.420386:0:10829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 69 00000100:00100000:0.0:1788797077.420399:0:10829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb077c32a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e6d050bb-169e-4784-be5b-7071799bf3b0+8:2354:x1875689351514880:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:0.0:1788797077.420490:0:10829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb077c32a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e6d050bb-169e-4784-be5b-7071799bf3b0+8:2354:x1875689351514880:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 92us (1031us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797077.420506:0:10829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 69 00000100:00100000:0.0:1788797077.420524:0:10829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 70 00000100:00100000:0.0:1788797077.420530:0:10829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8caf42062a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e6d050bb-169e-4784-be5b-7071799bf3b0+5:2354:x1875689351515008:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:0.0:1788797077.420568:0:10829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8caf42062a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e6d050bb-169e-4784-be5b-7071799bf3b0+5:2354:x1875689351515008:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 34us (881us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797077.420581:0:10829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 70 00000100:00100000:2.0:1788797077.421460:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351514624 00000100:00100000:2.0:1788797077.421476:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351514624 00000100:00100000:2.0:1788797077.421543:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 304 00000100:00100000:2.0:1788797077.421559:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb060705050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4d9d1a9-601d-459e-8721-8bfc2fdde84f+13:2354:x1875689351514624:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:2.0:1788797077.421658:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb060705050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4d9d1a9-601d-459e-8721-8bfc2fdde84f+13:2354:x1875689351514624:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 103us (2314us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797077.421665:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 304 00000100:00080000:2.0:1788797077.421700:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788797077.421705:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788797077.421709:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:2.0:1788797077.638120:0:6713:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967324 is committed 00000001:00080000:2.0:1788797077.638148:0:6713:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967323 is committed 00010000:00010000:0.0:1788797078.322488:0:5815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788797078.578541:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788797078.578568:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb0795c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875689374562688:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788797078.578648:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788797078.578823:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374562688 00000100:00100000:1.0:1788797078.578834:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374562688 00000100:00100000:1.0:1788797078.578931:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788797078.578948:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8caf42060000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1875689374562688:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788797078.579071:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788797078.579194:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8caf42060000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1875689374562688:12345-0@lo:13:osp-pre-0-0.0 Request processed in 248us (541us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797078.579206:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00080000:2.0:1788797078.579439:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788797078.579653:0:3300:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 2 00000004:00080000:1.0:1788797078.579660:0:3300:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967324 committed transno 4294967324 00000100:00100000:1.0:1788797078.579696:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb0795c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875689374562688:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788797079.091182:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb0778de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875689374562816:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788797079.091253:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788797079.091330:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8caf42061180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:3303:1875689374562944:0@lo:400:kworker.0 00000100:00100000:3.0:1788797079.091341:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8caf42062300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3302:1875689374563328:0@lo:400:kworker.0 00000100:00100000:0.0:1788797079.091372:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788797079.091379:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788797079.091409:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8caf42060380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3303:1875689374563456:0@lo:400:kworker.0 00000100:00100000:0.0:1788797079.091447:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788797079.091481:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8caf42060a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3300:1875689374563072:0@lo:400:kworker.0 00000100:00100000:0.0:1788797079.091502:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788797079.091520:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788797079.091525:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8caf42060700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875689374563200:0@lo:400:kworker.0 00000100:00100000:0.0:1788797079.091544:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788797079.091572:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374562944 00000100:00100000:0.0:1788797079.091578:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374562944 00000100:00100000:0.0:1788797079.091623:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 305 00000100:00100000:0.0:1788797079.091631:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb051758c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+19:3303:x1875689374562944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788797079.091685:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb051758c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+19:3303:x1875689374562944:12345-0@lo:400:kworker.0 Request processed in 54us (313us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797079.091693:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 305 00000100:00100000:0.0:1788797079.091725:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374563328 00000100:00100000:0.0:1788797079.091729:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374563328 00000100:00100000:0.0:1788797079.091764:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374563456 00000100:00100000:0.0:1788797079.091767:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374563456 00000100:00100000:0.0:1788797079.091779:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374563072 00000100:00100000:0.0:1788797079.091781:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374563072 00000100:00100000:0.0:1788797079.091794:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:0.0:1788797079.091800:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0778dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1875689374563328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788797079.091840:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0778dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1875689374563328:12345-0@lo:400:kworker.0 Request processed in 40us (461us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797079.091846:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:0.0:1788797079.091859:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:0.0:1788797079.091866:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8caf42062d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1875689374563456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788797079.091896:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8caf42062d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1875689374563456:12345-0@lo:400:kworker.0 Request processed in 31us (449us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797079.091902:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:0.0:1788797079.091916:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:0.0:1788797079.091923:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8caf42061880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1875689374563072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788797079.091957:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8caf42061880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1875689374563072:12345-0@lo:400:kworker.0 Request processed in 36us (455us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797079.091963:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:0.0:1788797079.091993:0:10829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374563200 00000100:00100000:0.0:1788797079.091996:0:10829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374563200 00000100:00100000:0.0:1788797079.092020:0:10829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788797079.092066:0:10829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8caf42061c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3300:x1875689374563200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788797079.092101:0:10829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8caf42061c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3300:x1875689374563200:12345-0@lo:400:kworker.0 Request processed in 38us (555us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797079.092107:0:10829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00080000:0.0:1788797079.092128:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788797079.092160:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8caf42060700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875689374563200:0@lo:400:kworker.0 00000100:00100000:0.0:1788797079.092169:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8caf42060a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3300:1875689374563072:0@lo:400:kworker.0 00000100:00100000:0.0:1788797079.092192:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8caf42061180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:3303:1875689374562944:0@lo:400:kworker.0 00000100:00100000:0.0:1788797079.092202:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8caf42060380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3303:1875689374563456:0@lo:400:kworker.0 00000100:00100000:0.0:1788797079.092228:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8caf42062300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3302:1875689374563328:0@lo:400:kworker.0 00000100:00100000:1.0:1788797079.093187:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374562816 00000100:00100000:1.0:1788797079.093195:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374562816 00000100:00100000:1.0:1788797079.093315:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788797079.093325:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0778dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875689374562816:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788797079.093357:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788797079.093428:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0778dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875689374562816:12345-0@lo:13:osp-pre-1-0.0 Request processed in 94us (2163us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797079.093436:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788797079.093472:0:3302:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:1.0:1788797079.093477:0:3302:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967309 committed transno 4294967310 00000004:00080000:1.0:1788797079.093499:0:3302:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8cb0778de680, transno 4294967310 00000100:00100000:1.0:1788797079.093518:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb0778de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875689374562816:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1788797079.103638:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1788797079.347059:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788797080.235766:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1788797080.235874:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351515264 00000100:00100000:2.0:1788797080.235884:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351515264 00000100:00100000:2.0:1788797080.235964:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 237 00000100:00100000:2.0:1788797080.235976:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8caf42062300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6d050bb-169e-4784-be5b-7071799bf3b0+18:11315:x1875689351515264:12345-192.168.204.38@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1788797080.236127:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8caf42062300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6d050bb-169e-4784-be5b-7071799bf3b0+18:11315:x1875689351515264:12345-192.168.204.38@tcp:60:lhsmtool_posix.0 Request processed in 154us (372us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797080.236136:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 237 00000100:00080000:0.0:1788797080.236202:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788797080.252215:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1788797080.252330:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351515520 00000100:00100000:1.0:1788797080.252340:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351515520 00000100:00100000:1.0:1788797080.252394:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 65 00000100:00100000:1.0:1788797080.252402:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8caf42060380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e6d050bb-169e-4784-be5b-7071799bf3b0+18:11315:x1875689351515520:12345-192.168.204.38@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788797080.252799:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8caf42060380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e6d050bb-169e-4784-be5b-7071799bf3b0+19:11315:x1875689351515520:12345-192.168.204.38@tcp:35:lhsmtool_posix.0 Request processed in 396us (591us total) trans 4294967520 rc 0/0 00000100:00100000:1.0:1788797080.252808:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 65 00010000:00010000:1.0:1788797080.372310:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788797081.394437:0:5815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:3.0:1788797082.259576:0:5848:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000020:00080000:3.0:1788797082.259615:0:5859:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:3.0:1788797082.259627:0:5859:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000001:00080000:3.0:1788797082.259652:0:5848:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967520 is committed 00010000:00010000:1.0:1788797082.419799:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788797082.526457:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1788797082.526501:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1788797082.526528:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1788797082.526546:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1788797082.526569:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1788797082.526600:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351515904 00000100:00100000:0.0:1788797082.526609:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351515904 00000100:00100000:0.0:1788797082.526720:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351516032 00000100:00100000:0.0:1788797082.526723:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351516032 00000100:00100000:0.0:1788797082.526748:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 72 00000100:00100000:0.0:1788797082.526759:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8caf42061180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e6d050bb-169e-4784-be5b-7071799bf3b0+7:2352:x1875689351515904:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:0.0:1788797082.526851:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8caf42061180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e6d050bb-169e-4784-be5b-7071799bf3b0+7:2352:x1875689351515904:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 94us (349us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797082.526860:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 72 00000100:00100000:0.0:1788797082.526879:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 73 00000100:00100000:0.0:1788797082.526886:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb077ffcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e6d050bb-169e-4784-be5b-7071799bf3b0+5:2352:x1875689351516032:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:0.0:1788797082.526911:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb077ffcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e6d050bb-169e-4784-be5b-7071799bf3b0+5:2352:x1875689351516032:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 26us (342us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797082.526918:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 73 00000100:00100000:0.0:1788797082.527085:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351516160 00000100:00100000:0.0:1788797082.527089:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351516160 00000100:00100000:0.0:1788797082.527114:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351515776 00000100:00100000:0.0:1788797082.527117:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351515776 00000100:00100000:0.0:1788797082.527138:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 175 00000100:00100000:0.0:1788797082.527144:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8caf42060a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed124ec0-b908-4000-b768-8e53d5def0fc+5:2352:x1875689351516160:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:0.0:1788797082.527171:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8caf42060a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed124ec0-b908-4000-b768-8e53d5def0fc+5:2352:x1875689351516160:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 27us (643us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797082.527177:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 175 00000100:00100000:0.0:1788797082.527189:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 176 00000100:00100000:0.0:1788797082.527195:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8caf42060700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6d050bb-169e-4784-be5b-7071799bf3b0+18:2352:x1875689351515776:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:0.0:1788797082.527236:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8caf42060700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6d050bb-169e-4784-be5b-7071799bf3b0+18:2352:x1875689351515776:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 40us (689us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797082.527242:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 176 00000100:00080000:0.0:1788797082.527264:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788797082.527268:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788797082.527271:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788797082.535103:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351515648 00000100:00100000:1.0:1788797082.535120:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351515648 00000100:00100000:1.0:1788797082.535288:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 306 00000100:00100000:1.0:1788797082.535299:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb051758450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4d9d1a9-601d-459e-8721-8bfc2fdde84f+13:2352:x1875689351515648:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:1.0:1788797082.535388:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb051758450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4d9d1a9-601d-459e-8721-8bfc2fdde84f+13:2352:x1875689351515648:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 90us (8942us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797082.535396:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 306 00000001:02000400:2.0:1788797082.988887:0:12712:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 12:04:41 (1788797081) 00010000:00010000:3.0:1788797083.443188:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788797083.698385:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788797083.698414:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb0795c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875689374563584:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788797083.698997:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788797083.699319:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374563584 00000100:00100000:0.0:1788797083.699332:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374563584 00000100:00100000:0.0:1788797083.699410:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1788797083.699422:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0795daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1875689374563584:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788797083.700851:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:0.0:1788797083.701669:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788797083.701866:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0795daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1875689374563584:12345-0@lo:13:osp-pre-0-0.0 Request processed in 2440us (2864us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797083.701880:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1788797083.701993:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb0795c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875689374563584:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788797084.210604:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8caf42062a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:3301:1875689374563712:0@lo:400:kworker.0 00000100:00100000:0.0:1788797084.210671:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788797084.210722:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8caf42063b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3301:1875689374564224:0@lo:400:kworker.0 00000100:00100000:0.0:1788797084.210748:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788797084.210776:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788797084.210782:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8caf42062680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3301:1875689374564096:0@lo:400:kworker.0 00000100:00100000:0.0:1788797084.210803:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788797084.210832:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8caf42061c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875689374563840:0@lo:400:kworker.0 00000100:00100000:0.0:1788797084.210854:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788797084.210870:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8caf42060e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875689374564352:0@lo:400:kworker.0 00000100:00100000:0.0:1788797084.210891:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788797084.210909:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788797084.210914:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8caf42061180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875689374563968:0@lo:400:kworker.0 00000100:00100000:0.0:1788797084.210934:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788797084.210968:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374563712 00000100:00100000:0.0:1788797084.210977:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374563712 00000100:00100000:0.0:1788797084.211059:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 307 00000100:00100000:0.0:1788797084.211078:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb05175ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+19:3301:x1875689374563712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788797084.211128:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb05175ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+19:3301:x1875689374563712:12345-0@lo:400:kworker.0 Request processed in 51us (456us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797084.211135:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 307 00000100:00100000:0.0:1788797084.211195:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374564224 00000100:00100000:0.0:1788797084.211200:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374564224 00000100:00100000:0.0:1788797084.211240:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374564096 00000100:00100000:0.0:1788797084.211243:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374564096 00000100:00100000:0.0:1788797084.211365:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374563840 00000100:00100000:0.0:1788797084.211369:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374563840 00000100:00100000:0.0:1788797084.211381:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1788797084.211386:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8caf42061f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1875689374564224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788797084.211417:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8caf42061f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1875689374564224:12345-0@lo:400:kworker.0 Request processed in 31us (668us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797084.211422:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1788797084.211432:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1788797084.211437:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8caf42063100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1875689374564096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788797084.211461:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8caf42063100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1875689374564096:12345-0@lo:400:kworker.0 Request processed in 24us (657us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797084.211466:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1788797084.211476:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1788797084.211481:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8caf42063800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875689374563840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788797084.211513:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8caf42063800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875689374563840:12345-0@lo:400:kworker.0 Request processed in 31us (658us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797084.211518:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1788797084.211544:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374564352 00000100:00100000:0.0:1788797084.211547:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374564352 00000100:00100000:0.0:1788797084.211585:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374563968 00000100:00100000:0.0:1788797084.211588:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374563968 00000100:00100000:0.0:1788797084.211604:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788797084.211610:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8caf42061500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1875689374564352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788797084.211640:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8caf42061500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1875689374564352:12345-0@lo:400:kworker.0 Request processed in 30us (748us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797084.211646:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788797084.211656:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788797084.211661:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8caf42063480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1875689374563968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788797084.211683:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8caf42063480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1875689374563968:12345-0@lo:400:kworker.0 Request processed in 23us (749us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797084.211687:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:0.0:1788797084.211709:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788797084.211714:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788797084.211754:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8caf42061180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875689374563968:0@lo:400:kworker.0 00000100:00100000:0.0:1788797084.211765:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8caf42061c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875689374563840:0@lo:400:kworker.0 00000100:00100000:0.0:1788797084.211773:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8caf42060e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875689374564352:0@lo:400:kworker.0 00000100:00100000:0.0:1788797084.211818:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8caf42062680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3301:1875689374564096:0@lo:400:kworker.0 00000100:00100000:0.0:1788797084.211827:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8caf42062a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:3301:1875689374563712:0@lo:400:kworker.0 00000100:00100000:0.0:1788797084.211837:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8caf42063b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3301:1875689374564224:0@lo:400:kworker.0 00000100:00100000:0.0:1788797084.212070:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788797084.212079:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8caf42063b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875689374564480:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788797084.212121:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788797084.212151:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374564480 00000100:00100000:0.0:1788797084.212161:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374564480 00000100:00100000:0.0:1788797084.212204:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1788797084.212210:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8caf42062a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875689374564480:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788797084.212242:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788797084.215750:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8caf42062a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875689374564480:12345-0@lo:13:osp-pre-1-0.0 Request processed in 3530us (3618us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797084.215765:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1788797084.215849:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8caf42063b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875689374564480:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788797084.466473:0:5815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788797085.490963:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788797085.739717:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1788797085.740071:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351516288 00000100:00100000:1.0:1788797085.740085:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351516288 00000100:00100000:1.0:1788797085.740190:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 238 00000100:00100000:1.0:1788797085.740204:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8caf42063b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed124ec0-b908-4000-b768-8e53d5def0fc+5:12320:x1875689351516288:12345-192.168.204.38@tcp:101:lsof.0 00010000:00010000:1.0:1788797085.740230:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788797085.740311:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082044600/0xca7fc0c411f944f3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c99e04559ee1399 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797085.740390:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045e00/0xca7fc0c411f944fa lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797085.740403:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045e00/0xca7fc0c411f944fa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797085.740415:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045e00/0xca7fc0c411f944fa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788797085.740450:0:5825:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788797085.740454:0:5825:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000100:00080000:0.0:1788797085.740612:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00010000:1.0:1788797085.741694:0:5825:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045e00/0xca7fc0c411f944fa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797085.741733:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082044600/0xca7fc0c411f944f3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1399 expref: 7 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797085.741754:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045e00/0xca7fc0c411f944fa lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1399 expref: 6 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797085.741763:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cb058766400) 00010000:00010000:1.0:1788797085.741767:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788797085.741770:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb082045e00, rc 0) 00000100:00100000:1.0:1788797085.741852:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8caf42063b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed124ec0-b908-4000-b768-8e53d5def0fc+6:12320:x1875689351516288:12345-192.168.204.38@tcp:101:lsof.0 Request processed in 1652us (2146us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797085.741861:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 238 00000040:00080000:2.0:1788797085.746754:0:11679:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788797085.746765:0:11679:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788797085.748264:0:11679:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:2.0:1788797085.748276:0:11679:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1788797086.517069:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788797087.538754:0:5815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788797087.636594:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1788797087.636652:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1788797087.636689:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1788797087.636859:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351516672 00000100:00100000:0.0:1788797087.636878:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351516672 00000100:00100000:0.0:1788797087.637000:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 76 00000100:00100000:0.0:1788797087.637014:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0795c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e6d050bb-169e-4784-be5b-7071799bf3b0+7:2353:x1875689351516672:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:0.0:1788797087.637186:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0795c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e6d050bb-169e-4784-be5b-7071799bf3b0+7:2353:x1875689351516672:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 174us (530us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797087.637196:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 76 00000100:00080000:0.0:1788797087.637238:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788797087.639230:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351516416 00000100:00100000:2.0:1788797087.639264:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351516416 00000100:00100000:2.0:1788797087.639355:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 308 00000100:00100000:2.0:1788797087.639367:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb051759450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4d9d1a9-601d-459e-8721-8bfc2fdde84f+13:2353:x1875689351516416:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:2.0:1788797087.639474:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb051759450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4d9d1a9-601d-459e-8721-8bfc2fdde84f+13:2353:x1875689351516416:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 109us (2898us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797087.639484:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 308 00000100:00100000:1.0:1788797087.640621:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1788797087.641467:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351516928 00000100:00100000:3.0:1788797087.641485:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351516928 00000100:00100000:3.0:1788797087.641692:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 180 00000100:00100000:3.0:1788797087.641728:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0795c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed124ec0-b908-4000-b768-8e53d5def0fc+6:2353:x1875689351516928:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:3.0:1788797087.641841:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0795c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed124ec0-b908-4000-b768-8e53d5def0fc+6:2353:x1875689351516928:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 118us (5149us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797087.641849:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 180 00000100:00080000:0.0:1788797087.641928:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788797087.647541:0:7636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351516544 00000100:00100000:2.0:1788797087.647588:0:7636:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351516544 00000100:00100000:3.0:1788797087.647874:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 181 00000100:00100000:3.0:1788797087.647898:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0795c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6d050bb-169e-4784-be5b-7071799bf3b0+18:2353:x1875689351516544:12345-192.168.204.38@tcp:400:kworker.0 00000100:00080000:0.0:1788797087.647959:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788797087.648091:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0795c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6d050bb-169e-4784-be5b-7071799bf3b0+18:2353:x1875689351516544:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 202us (7479us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797087.648100:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 181 00000100:00100000:1.0:1788797087.649550:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1788797087.659431:0:10829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351516800 00000100:00100000:3.0:1788797087.659455:0:10829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351516800 00000100:00100000:3.0:1788797087.659590:0:10829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 77 00000100:00100000:3.0:1788797087.659607:0:10829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0795c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e6d050bb-169e-4784-be5b-7071799bf3b0+5:2353:x1875689351516800:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:3.0:1788797087.659740:0:10829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0795c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e6d050bb-169e-4784-be5b-7071799bf3b0+5:2353:x1875689351516800:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 138us (10200us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797087.659749:0:10829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 77 00000100:00080000:0.0:1788797087.660300:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788797088.390464:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1788797088.393420:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351517184 00000100:00100000:2.0:1788797088.393444:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351517184 00000100:00100000:2.0:1788797088.393577:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 66 00000100:00100000:2.0:1788797088.393591:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8caf42062680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e6d050bb-169e-4784-be5b-7071799bf3b0+18:12321:x1875689351517184:12345-192.168.204.38@tcp:35:umount.0 00000100:00100000:2.0:1788797088.394234:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8caf42062680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e6d050bb-169e-4784-be5b-7071799bf3b0+19:12321:x1875689351517184:12345-192.168.204.38@tcp:35:umount.0 Request processed in 642us (3775us total) trans 4294967521 rc 0/0 00000100:00100000:2.0:1788797088.394244:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 66 00000100:00100000:2.0:1788797088.397802:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1788797088.402647:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351517440 00000100:00100000:1.0:1788797088.402668:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351517440 00000100:00100000:1.0:1788797088.402855:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 67 00000100:00100000:1.0:1788797088.402868:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0795d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e6d050bb-169e-4784-be5b-7071799bf3b0+19:12321:x1875689351517440:12345-192.168.204.38@tcp:35:umount.0 00000100:00100000:1.0:1788797088.403325:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0795d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e6d050bb-169e-4784-be5b-7071799bf3b0+20:12321:x1875689351517440:12345-192.168.204.38@tcp:35:umount.0 Request processed in 456us (5744us total) trans 4294967522 rc 0/0 00000100:00100000:1.0:1788797088.403334:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 67 00000100:00100000:3.0:1788797088.407989:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1788797088.408202:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351517696 00000100:00100000:2.0:1788797088.408217:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351517696 00000100:00100000:2.0:1788797088.408312:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 68 00000100:00100000:2.0:1788797088.408326:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb050635c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e6d050bb-169e-4784-be5b-7071799bf3b0+20:12321:x1875689351517696:12345-192.168.204.38@tcp:35:umount.0 00000100:00100000:2.0:1788797088.408888:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb050635c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e6d050bb-169e-4784-be5b-7071799bf3b0+21:12321:x1875689351517696:12345-192.168.204.38@tcp:35:umount.0 Request processed in 554us (903us total) trans 4294967523 rc 0/0 00000100:00100000:2.0:1788797088.409069:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 68 00000100:00100000:0.0:1788797088.415333:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1788797088.415524:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351517952 00000100:00100000:1.0:1788797088.415534:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351517952 00000100:00100000:1.0:1788797088.415597:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 69 00000100:00100000:1.0:1788797088.415607:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8caf42060e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e6d050bb-169e-4784-be5b-7071799bf3b0+21:12321:x1875689351517952:12345-192.168.204.38@tcp:35:umount.0 00000100:00100000:1.0:1788797088.416274:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8caf42060e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e6d050bb-169e-4784-be5b-7071799bf3b0+22:12321:x1875689351517952:12345-192.168.204.38@tcp:35:umount.0 Request processed in 665us (948us total) trans 4294967524 rc 0/0 00000100:00100000:1.0:1788797088.416284:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 69 00000100:00100000:0.0:1788797088.431959:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1788797088.433213:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1788797088.433264:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1788797088.433319:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1788797088.433400:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351518208 00000100:00100000:0.0:1788797088.433417:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351518208 00000100:00100000:0.0:1788797088.433503:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351518464 00000100:00100000:0.0:1788797088.433507:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351518464 00000100:00100000:0.0:1788797088.433525:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351518336 00000100:00100000:0.0:1788797088.433529:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351518336 00000100:00100000:0.0:1788797088.433546:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19 00000100:00100000:0.0:1788797088.433557:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8caf42061180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b4d9d1a9-601d-459e-8721-8bfc2fdde84f+15:2352:x1875689351518208:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788797088.433575:0:5811:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788797088.433597:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cb079b81a00/0xca7fc0c411f93580 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee0f2b expref: 15 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797088.433616:0:5811:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788797088.433683:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8caf42061180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b4d9d1a9-601d-459e-8721-8bfc2fdde84f+14:2352:x1875689351518208:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 126us (481us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797088.433691:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19 00000100:00100000:0.0:1788797088.433709:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 20 00000100:00100000:0.0:1788797088.433715:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0484c7050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b4d9d1a9-601d-459e-8721-8bfc2fdde84f+13:2352:x1875689351518464:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788797088.433723:0:5811:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788797088.433733:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cb080436c00/0xca7fc0c411f93794 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee0ff6 expref: 13 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797088.433743:0:5811:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788797088.433760:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0484c7050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b4d9d1a9-601d-459e-8721-8bfc2fdde84f+12:2352:x1875689351518464:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 46us (496us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797088.433767:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 20 00000100:00100000:0.0:1788797088.433808:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 21 00000100:00100000:0.0:1788797088.433814:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8caf42060380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b4d9d1a9-601d-459e-8721-8bfc2fdde84f+11:2352:x1875689351518336:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788797088.433828:0:5811:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788797088.433837:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cb0821f1c00/0xca7fc0c411f934e6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee0ef3 expref: 11 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797088.433846:0:5811:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788797088.433864:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8caf42060380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b4d9d1a9-601d-459e-8721-8bfc2fdde84f+10:2352:x1875689351518336:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 50us (546us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797088.433871:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 21 00000100:00100000:2.0:1788797088.437003:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351518080 00000100:00100000:2.0:1788797088.437021:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351518080 00000100:00100000:3.0:1788797088.437349:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 73 00000100:00100000:3.0:1788797088.437364:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8caf42061c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e6d050bb-169e-4784-be5b-7071799bf3b0+5:2351:x1875689351518080:12345-192.168.204.38@tcp:9:umount.0 00000020:00000080:3.0:1788797088.437421:0:6684:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xca7fc0c411f93858 00000100:00080000:3.0:1788797088.437440:0:6684:0:(import.c:65:import_set_state_nolock()) ffff8cb046308000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788797088.437489:0:6684:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:3.0:1788797088.437812:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8caf42061c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e6d050bb-169e-4784-be5b-7071799bf3b0+2:2351:x1875689351518080:12345-192.168.204.38@tcp:9:umount.0 Request processed in 451us (5863us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797088.437836:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 73 00010000:00010000:2.0:1788797088.438246:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788797088.444009:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1788797088.444177:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351518848 00000100:00100000:1.0:1788797088.444187:0:6683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351518848 00000100:00100000:1.0:1788797088.444254:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 74 00000100:00100000:1.0:1788797088.444265:0:6683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8caf42061180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e6d050bb-169e-4784-be5b-7071799bf3b0+7:2351:x1875689351518848:12345-192.168.204.38@tcp:9:umount.0 00000020:00000080:1.0:1788797088.444299:0:6683:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xca7fc0c411f93ab9 00000020:00010000:1.0:1788797088.444311:0:6683:0:(genops.c:1920:obd_stale_export_put()) Put export ffff8cb0502a1000: total 0 00000100:00080000:1.0:1788797088.444316:0:6683:0:(import.c:65:import_set_state_nolock()) ffff8cb0502fe800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788797088.444374:0:6683:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967324 00000020:00010000:2.0:1788797088.444702:0:5814:0:(genops.c:1906:obd_stale_export_get()) Get export ffff8cb0502a1000: total 0 00010000:00010000:2.0:1788797088.444747:0:5814:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8cb0502a1000, canceled 0 locks, left on hash table 2. 00010000:00010000:2.0:1788797088.444821:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000042895792/0xca7fc0c411f93e5c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee11cb expref: 6 pid: 10829 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797088.444863:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fff90cbe/0xca7fc0c411f944ec lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1392 expref: 5 pid: 6683 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797088.444879:0:5814:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8cb0502a1000, canceled 2 locks, left on hash table 0. 00010000:00010000:2.0:1788797088.444891:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788797088.444913:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788797088.444915:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788797088.445173:0:6683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8caf42061180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e6d050bb-169e-4784-be5b-7071799bf3b0+2:2351:x1875689351518848:12345-192.168.204.38@tcp:9:umount.0 Request processed in 908us (1177us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797088.445181:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 74 00000100:00100000:1.0:1788797088.454346:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1788797088.454901:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351519872 00000100:00100000:0.0:1788797088.454915:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351519872 00000100:00100000:0.0:1788797088.454987:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 239 00000100:00100000:0.0:1788797088.454999:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0795c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6d050bb-169e-4784-be5b-7071799bf3b0+22:2351:x1875689351519872:12345-192.168.204.38@tcp:39:umount.0 00000020:00000080:0.0:1788797088.455071:0:5827:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xca7fc0c411f934f4 00000020:00010000:0.0:1788797088.455089:0:5827:0:(genops.c:1920:obd_stale_export_put()) Put export ffff8cb042fd3800: total 0 00000100:00080000:0.0:1788797088.455104:0:5827:0:(import.c:65:import_set_state_nolock()) ffff8cb042fd7000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788797088.455129:0:5827:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967524 00000020:00010000:1.0:1788797088.455511:0:5815:0:(genops.c:1906:obd_stale_export_get()) Get export ffff8cb042fd3800: total 0 00010000:00010000:1.0:1788797088.455566:0:5815:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8cb042fd3800, canceled 0 locks, left on hash table 13. 00010000:00010000:1.0:1788797088.455676:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8cb065cc2c00) 00010000:00010000:1.0:1788797088.455681:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788797088.455689:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040030c00/0xca7fc0c411f944ad lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee137d expref: 22 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797088.455713:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8cb06ce84d00) 00010000:00010000:1.0:1788797088.455729:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1788797088.455734:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb0821f0e00/0xca7fc0c411f9382e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1020 expref: 21 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797088.455750:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cb058766400) 00010000:00010000:1.0:1788797088.455753:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788797088.455756:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3e00/0xca7fc0c411f93eb0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee11e0 expref: 20 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797088.455771:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8cb065cc2c00) 00010000:00010000:1.0:1788797088.455773:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1788797088.455776:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040030000/0xca7fc0c411f944d7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee138b expref: 19 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797088.455788:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8cb06ce84d00) 00010000:00010000:1.0:1788797088.455790:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788797088.455793:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484800/0xca7fc0c411f93b1b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee10f2 expref: 18 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797088.455811:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8cb058766700) 00010000:00010000:1.0:1788797088.455813:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788797088.455817:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045400/0xca7fc0c411f93d3d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee117e expref: 17 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797088.455831:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8cb058766500) 00010000:00010000:1.0:1788797088.455833:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788797088.455837:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb040031a00/0xca7fc0c411f941ab lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee12b9 expref: 16 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797088.455863:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8cb058766500) 00010000:00010000:1.0:1788797088.455865:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1788797088.455869:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea2200/0xca7fc0c411f93ecc lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee11e7 expref: 15 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797088.455886:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8cb05088a400) 00010000:00010000:1.0:1788797088.455888:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788797088.455892:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041485600/0xca7fc0c411f937da lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee100b expref: 14 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797088.455908:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8cb058766700) 00010000:00010000:1.0:1788797088.455910:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788797088.455914:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082044200/0xca7fc0c411f93e1d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee11b6 expref: 13 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797088.455925:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8cb065cc2c00) 00010000:00010000:1.0:1788797088.455928:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788797088.455931:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb042ea3200/0xca7fc0c411f943cd lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1345 expref: 12 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797088.455947:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8cb065cc2f00) 00010000:00010000:1.0:1788797088.455949:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788797088.455953:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080436200/0xca7fc0c411f937be lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1004 expref: 11 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797088.455967:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8cb058766700) 00010000:00010000:1.0:1788797088.455969:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1788797088.455980:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69000/0xca7fc0c411f93e47 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee11c4 expref: 10 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797088.455994:0:5815:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8cb042fd3800, canceled 13 locks, left on hash table 0. 00010000:00010000:1.0:1788797088.456008:0:5815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788797088.456011:0:5815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788797088.456012:0:5815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788797088.456982:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0795c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6d050bb-169e-4784-be5b-7071799bf3b0+7:2351:x1875689351519872:12345-192.168.204.38@tcp:39:umount.0 Request processed in 1980us (2642us total) trans 4294967525 rc 0/0 00000100:00100000:0.0:1788797088.456997:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 239 00010000:00010000:2.0:1788797088.564616:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788797088.820102:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb0795c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875689374564608:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788797088.820189:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788797088.820510:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374564608 00000100:00100000:1.0:1788797088.820519:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374564608 00000100:00100000:1.0:1788797088.820584:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1788797088.820594:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8caf42062680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1875689374564608:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788797088.820641:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788797088.820701:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8caf42062680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1875689374564608:12345-0@lo:13:osp-pre-0-0.0 Request processed in 109us (511us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797088.820708:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1788797088.820759:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb0795c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875689374564608:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788797088.820995:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788797089.330294:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb06ec6ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875689374564736:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788797089.330400:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788797089.330535:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374564736 00000100:00100000:3.0:1788797089.330544:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374564736 00000100:00100000:3.0:1788797089.330617:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1788797089.330639:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0795c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1875689374564736:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788797089.330685:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:0.0:1788797089.331023:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788797089.332696:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb0795d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:3302:1875689374564864:0@lo:400:kworker.0 00000100:00100000:0.0:1788797089.332781:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788797089.332874:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788797089.332882:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb0795d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875689374564992:0@lo:400:kworker.0 00000100:00100000:0.0:1788797089.332913:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788797089.332953:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374564864 00000100:00100000:0.0:1788797089.332961:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374564864 00000100:00100000:0.0:1788797089.333021:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 309 00000100:00100000:0.0:1788797089.333052:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb051758850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+19:3302:x1875689374564864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788797089.333123:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb051758850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+19:3302:x1875689374564864:12345-0@lo:400:kworker.0 Request processed in 74us (342us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797089.333131:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 309 00000100:00100000:0.0:1788797089.333185:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb0795d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:3302:1875689374564864:0@lo:400:kworker.0 00000100:00100000:0.0:1788797089.333214:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb0795d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875689374565120:0@lo:400:kworker.0 00000100:00100000:0.0:1788797089.333246:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788797089.333283:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374565120 00000100:00100000:0.0:1788797089.333287:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374565120 00000100:00100000:0.0:1788797089.333318:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1788797089.333325:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb077e30a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3300:x1875689374565120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788797089.333364:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb077e30a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3300:x1875689374565120:12345-0@lo:400:kworker.0 Request processed in 40us (117us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797089.333371:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1788797089.333841:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb0795d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875689374565120:0@lo:400:kworker.0 00000100:00100000:0.0:1788797089.333883:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374564992 00000100:00100000:0.0:1788797089.333888:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374564992 00000100:00100000:0.0:1788797089.333926:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:0.0:1788797089.333934:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb06ec6c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875689374564992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788797089.333984:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb06ec6c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875689374564992:12345-0@lo:400:kworker.0 Request processed in 51us (1071us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797089.334002:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:0.0:1788797089.334075:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb0795d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875689374564992:0@lo:400:kworker.0 00000100:00100000:3.0:1788797089.334840:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0795c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1875689374564736:12345-0@lo:13:osp-pre-1-0.0 Request processed in 4198us (4434us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797089.334854:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1788797089.337071:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb0795d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3302:1875689374565376:0@lo:400:kworker.0 00000100:00100000:3.0:1788797089.337188:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788797089.338175:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788797089.338200:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb0795d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3300:1875689374565248:0@lo:400:kworker.0 00000100:00100000:0.0:1788797089.338254:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788797089.338318:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374565376 00000100:00100000:0.0:1788797089.338329:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374565376 00000100:00100000:0.0:1788797089.338392:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374565248 00000100:00100000:0.0:1788797089.338395:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374565248 00000100:00100000:0.0:1788797089.338420:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:0.0:1788797089.338429:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0778df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1875689374565376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788797089.339709:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:2.0:1788797089.339732:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb077e33b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1875689374565248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788797089.339830:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb077e33b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1875689374565248:12345-0@lo:400:kworker.0 Request processed in 110us (1574us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797089.339838:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:2.0:1788797089.339919:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb0795d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3300:1875689374565248:0@lo:400:kworker.0 00000100:00080000:2.0:1788797089.339984:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788797089.340224:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb06ec6ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875689374564736:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788797089.344699:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0778df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1875689374565376:12345-0@lo:400:kworker.0 Request processed in 6258us (7499us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797089.344717:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:3.0:1788797089.348498:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb0795d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3302:1875689374565376:0@lo:400:kworker.0 00010000:00010000:2.0:1788797089.594751:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788797089.937674:0:7640:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of e6d050bb-169e-4784-be5b-7071799bf3b0 00000020:00000080:0.0:1788797089.937691:0:7640:0:(genops.c:885:class_export_put()) final put ffff8cb04630c800/e6d050bb-169e-4784-be5b-7071799bf3b0 00000020:00000080:2.0:1788797089.938987:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8cb04630c800/e6d050bb-169e-4784-be5b-7071799bf3b0 for lustre-OST0001 00000020:00000080:2.0:1788797089.939119:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8cb046308000 for lustre-OST0001 00010000:00010000:1.0:1788797090.612401:0:5815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788797090.790277:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1788797090.790336:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1788797090.790462:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1788797090.790923:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351520000 00000100:00100000:1.0:1788797090.790938:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351520000 00000100:00100000:1.0:1788797090.791113:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351520128 00000100:00100000:1.0:1788797090.791117:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351520128 00000100:00100000:1.0:1788797090.791144:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351520256 00000100:00100000:1.0:1788797090.791147:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351520256 00000100:00100000:1.0:1788797090.791165:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 22 00000100:00100000:1.0:1788797090.791176:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb077e31500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b4d9d1a9-601d-459e-8721-8bfc2fdde84f+12:2355:x1875689351520000:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788797090.791222:0:6698:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788797090.791245:0:6698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cb080436000/0xca7fc0c411f935c6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee0f40 expref: 12 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797090.791265:0:6698:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788797090.791328:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb077e31500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b4d9d1a9-601d-459e-8721-8bfc2fdde84f+11:2355:x1875689351520000:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 153us (1066us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797090.791336:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 22 00000100:00100000:1.0:1788797090.791358:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 23 00000100:00100000:1.0:1788797090.791364:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb06f57df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b4d9d1a9-601d-459e-8721-8bfc2fdde84f+10:2354:x1875689351520128:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788797090.791372:0:6698:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788797090.791402:0:6698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cb079b81000/0xca7fc0c411f935cd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee0f6a expref: 10 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797090.791412:0:6698:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788797090.791431:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb06f57df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b4d9d1a9-601d-459e-8721-8bfc2fdde84f+9:2354:x1875689351520128:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 67us (1095us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797090.791437:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 23 00000100:00100000:1.0:1788797090.791451:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 24 00000100:00100000:1.0:1788797090.791457:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb06f57f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b4d9d1a9-601d-459e-8721-8bfc2fdde84f+8:2354:x1875689351520256:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788797090.791466:0:6698:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788797090.791475:0:6698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cb042ea2000/0xca7fc0c411f9378d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee0fef expref: 8 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797090.791483:0:6698:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788797090.791513:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb06f57f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b4d9d1a9-601d-459e-8721-8bfc2fdde84f+7:2354:x1875689351520256:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 55us (1050us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797090.792091:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 24 00000100:00100000:3.0:1788797090.825941:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1788797090.826083:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351520512 00000100:00100000:2.0:1788797090.826095:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351520512 00000100:00100000:2.0:1788797090.826178:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 240 00000100:00100000:2.0:1788797090.826189:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0778dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed124ec0-b908-4000-b768-8e53d5def0fc+6:2351:x1875689351520512:12345-192.168.204.38@tcp:39:umount.0 00000020:00000080:2.0:1788797090.826231:0:5826:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xca7fc0c411f935db 00000020:00010000:2.0:1788797090.826240:0:5826:0:(genops.c:1920:obd_stale_export_put()) Put export ffff8cb046310000: total 0 00000100:00080000:2.0:1788797090.826245:0:5826:0:(import.c:65:import_set_state_nolock()) ffff8cb046314000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788797090.826270:0:5826:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967525 00000100:00100000:2.0:1788797090.826550:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0778dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed124ec0-b908-4000-b768-8e53d5def0fc+5:2351:x1875689351520512:12345-192.168.204.38@tcp:39:umount.0 Request processed in 362us (631us total) trans 4294967526 rc 0/0 00000100:00100000:2.0:1788797090.826559:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 240 00000100:00080000:0.0:1788797090.826905:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00010000:0.0:1788797090.826935:0:8446:0:(genops.c:1906:obd_stale_export_get()) Get export ffff8cb046310000: total 0 00010000:00010000:0.0:1788797090.826941:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788797090.827000:0:8446:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8cb046310000, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1788797090.827087:0:8446:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cb058766400) 00010000:00010000:0.0:1788797090.827092:0:8446:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788797090.827101:0:8446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb082045e00/0xca7fc0c411f944fa lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1399 expref: 4 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797090.827148:0:8446:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8cb046310000, canceled 1 locks, left on hash table 0. 00010000:00010000:0.0:1788797090.827160:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788797090.827162:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788797090.827164:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788797090.867462:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1788797090.867608:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351520768 00000100:00100000:0.0:1788797090.867620:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351520768 00000100:00100000:0.0:1788797090.867711:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 310 00000100:00100000:0.0:1788797090.867723:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0465dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4d9d1a9-601d-459e-8721-8bfc2fdde84f+7:2351:x1875689351520768:12345-192.168.204.38@tcp:251:umount.0 00000020:00000080:0.0:1788797090.867781:0:5819:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xca7fc0c411f934d1 00000020:00010000:0.0:1788797090.867790:0:5819:0:(genops.c:1920:obd_stale_export_put()) Put export ffff8cb050174800: total 0 00000100:00080000:0.0:1788797090.867797:0:5819:0:(import.c:65:import_set_state_nolock()) ffff8cb050170800 : changing import state from FULL to CLOSED 00000020:00010000:2.0:1788797090.868014:0:5814:0:(genops.c:1906:obd_stale_export_get()) Get export ffff8cb050174800: total 0 00010000:00010000:2.0:1788797090.868112:0:5814:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8cb050174800, canceled 0 locks, left on hash table 1. 00010000:00010000:2.0:1788797090.868151:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cb041484a00/0xca7fc0c411f93587 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee0f32 expref: 3 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797090.868186:0:5814:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8cb050174800, canceled 1 locks, left on hash table 0. 00010000:00010000:2.0:1788797090.868200:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788797090.868203:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788797090.868205:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788797090.886823:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0465dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4d9d1a9-601d-459e-8721-8bfc2fdde84f+1:2351:x1875689351520768:12345-192.168.204.38@tcp:251:umount.0 Request processed in 18769us (19043us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797090.886849:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 310 00000020:00000080:1.0:1788797090.886877:0:5819:0:(genops.c:885:class_export_put()) final put ffff8cb050174800/b4d9d1a9-601d-459e-8721-8bfc2fdde84f 00000020:00000080:2.0:1788797090.889077:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8cb050174800/b4d9d1a9-601d-459e-8721-8bfc2fdde84f for MGS 00000020:00000080:2.0:1788797090.889147:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8cb050170800 for MGS 00010000:00010000:0.0:1788797091.664099:0:5815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788797092.516646:0:5848:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of e6d050bb-169e-4784-be5b-7071799bf3b0 00000001:00080000:0.0:1788797092.516663:0:5848:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967525 is committed 00000001:00100000:0.0:1788797092.516676:0:5848:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of ed124ec0-b908-4000-b768-8e53d5def0fc 00000001:00080000:0.0:1788797092.516681:0:5848:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967526 is committed 00000020:00000080:0.0:1788797092.516684:0:5848:0:(genops.c:885:class_export_put()) final put ffff8cb046310000/ed124ec0-b908-4000-b768-8e53d5def0fc 00000020:00000080:0.0:1788797092.516705:0:5848:0:(genops.c:885:class_export_put()) final put ffff8cb042fd3800/e6d050bb-169e-4784-be5b-7071799bf3b0 00000020:00000080:1.0:1788797092.516853:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8cb046310000/ed124ec0-b908-4000-b768-8e53d5def0fc for lustre-MDT0000 00000020:00000080:1.0:1788797092.516915:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8cb042fd3800/e6d050bb-169e-4784-be5b-7071799bf3b0 for lustre-MDT0000 00000020:00000080:1.0:1788797092.516947:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8cb046314000 for lustre-MDT0000 00000020:00000080:1.0:1788797092.516953:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8cb042fd7000 for lustre-MDT0000 00010000:00010000:0.0:1788797092.658286:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788797093.046605:0:6713:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of e6d050bb-169e-4784-be5b-7071799bf3b0 00000020:00000080:1.0:1788797093.046617:0:6713:0:(genops.c:885:class_export_put()) final put ffff8cb0502a1000/e6d050bb-169e-4784-be5b-7071799bf3b0 00000020:00000080:3.0:1788797093.046794:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8cb0502a1000/e6d050bb-169e-4784-be5b-7071799bf3b0 for lustre-OST0000 00000020:00000080:3.0:1788797093.046869:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8cb0502fe800 for lustre-OST0000 00000020:01000004:1.0:1788797093.212461:0:12913:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:1.0:1788797093.237196:0:12913:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:1.0:1788797093.237264:0:12913:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.138@tcp lock: ffff8cb079b80400/0xca7fc0c411f93556 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xca7fc0c411f9355d expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797093.237284:0:12913:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.138@tcp lock: ffff8cb079b80400/0xca7fc0c411f93556 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xca7fc0c411f9355d expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797093.237294:0:12913:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.138@tcp lock: ffff8cb079b80400/0xca7fc0c411f93556 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xca7fc0c411f9355d expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797093.237301:0:12913:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.138@tcp lock: ffff8cb079b80400/0xca7fc0c411f93556 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xca7fc0c411f9355d expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797093.237325:0:12913:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1788797093.237331:0:12913:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1788797093.237367:0:12913:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788797093.237403:0:12913:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1788797093.237412:0:12913:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1788797093.237449:0:12913:0:(import.c:65:import_set_state_nolock()) ffff8cb042f33800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1788797093.237631:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb0795c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3299:1875689374565504:0@lo:39:umount.0 00000100:00100000:0.0:1788797093.237708:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788797093.237950:0:5814:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788797093.237958:0:5814:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.138@tcp lock: ffff8cb079b80400/0xca7fc0c411f93556 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xca7fc0c411f9355d expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797093.237966:0:5814:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb079b80400 already unused, calling callback (ffffffffc1adac20) 10000000:00010000:2.0:1788797093.237970:0:5814:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.138@tcp lock: ffff8cb079b80400/0xca7fc0c411f93556 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xca7fc0c411f9355d expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797093.237980:0:5814:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.138@tcp lock: ffff8cb079b80400/0xca7fc0c411f93556 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0xca7fc0c411f9355d expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788797093.237990:0:5814:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.138@tcp lock: ffff8cb079b80400/0xca7fc0c411f93556 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0xca7fc0c411f9355d expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788797093.237997:0:5814:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788797093.238010:0:5814:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1788797093.238013:0:5814:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1788797093.238071:0:5814:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.138@tcp lock: ffff8cb079b80400/0xca7fc0c411f93556 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xca7fc0c411f9355d expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797093.238079:0:5814:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1788797093.238135:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb0795d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:3303:1875689374565632:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788797093.238169:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788797093.238232:0:5814:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.138@tcp lock: ffff8cb079b80400/0xca7fc0c411f93556 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xca7fc0c411f9355d expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788797093.238236:0:7636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374565504 00000100:00100000:1.0:1788797093.238246:0:7636:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374565504 00010000:00010000:2.0:1788797093.238258:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.138@tcp lock: ffff8cb079b80400/0xca7fc0c411f93556 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xca7fc0c411f9355d expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797093.238273:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788797093.238276:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788797093.238279:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788797093.238301:0:7636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:1.0:1788797093.238312:0:7636:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb06f57d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1875689374565504:12345-0@lo:39:umount.0 00000020:00000080:1.0:1788797093.238346:0:7636:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xca7fc0c411f932e0 00000100:00080000:1.0:1788797093.238356:0:7636:0:(import.c:65:import_set_state_nolock()) ffff8cb04550b800 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1788797093.238521:0:7636:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb06f57d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+1:3299:x1875689374565504:12345-0@lo:39:umount.0 Request processed in 210us (811us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797093.238528:0:7636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000020:00000080:1.0:1788797093.238538:0:7636:0:(genops.c:885:class_export_put()) final put ffff8cb04550d000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:1.0:1788797093.238566:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8cb04550d000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:1.0:1788797093.238614:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8cb04550b800 for lustre-MDT0000 00000100:00080000:1.0:1788797093.242187:0:3299:0:(import.c:65:import_set_state_nolock()) ffff8cb042f33800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1788797093.242216:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb0795c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3299:1875689374565504:0@lo:39:umount.0 00000100:00080000:1.0:1788797093.242260:0:12913:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788797093.242264:0:12913:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1788797093.242269:0:12913:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1788797093.243235:0:12913:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.138@tcp lock: ffff8cb080437800/0xca7fc0c411f93564 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xca7fc0c411f9356b expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797093.243250:0:12913:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.138@tcp lock: ffff8cb080437800/0xca7fc0c411f93564 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xca7fc0c411f9356b expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797093.243257:0:12913:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.138@tcp lock: ffff8cb080437800/0xca7fc0c411f93564 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xca7fc0c411f9356b expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797093.243284:0:12913:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.138@tcp lock: ffff8cb080437800/0xca7fc0c411f93564 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xca7fc0c411f9356b expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788797093.246789:0:11663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374565632 00000100:00100000:3.0:1788797093.246807:0:11663:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374565632 00000100:00100000:3.0:1788797093.246970:0:11663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788797093.246982:0:11663:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb06f57ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+19:3303:x1875689374565632:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788797093.247014:0:11663:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788797093.247062:0:11663:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cb0821f0000/0xca7fc0c411f9355d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xca7fc0c411f93556 expref: 19 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797093.247081:0:11663:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788797093.247752:0:5815:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788797093.247765:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.138@tcp lock: ffff8cb080437800/0xca7fc0c411f93564 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xca7fc0c411f9356b expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797093.247776:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb080437800 already unused, calling callback (ffffffffc1adac20) 10000000:00010000:2.0:1788797093.247781:0:5815:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.138@tcp lock: ffff8cb080437800/0xca7fc0c411f93564 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xca7fc0c411f9356b expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797093.247985:0:5815:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.138@tcp lock: ffff8cb080437800/0xca7fc0c411f93564 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0xca7fc0c411f9356b expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788797093.247996:0:5815:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.138@tcp lock: ffff8cb080437800/0xca7fc0c411f93564 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0xca7fc0c411f9356b expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788797093.248012:0:5815:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788797093.248015:0:5815:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:2.0:1788797093.248077:0:5815:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.138@tcp lock: ffff8cb080437800/0xca7fc0c411f93564 lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xca7fc0c411f9356b expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797093.248085:0:5815:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788797093.248128:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.138@tcp lock: ffff8cb080437800/0xca7fc0c411f93564 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xca7fc0c411f9356b expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797093.248140:0:5815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788797093.248155:0:5815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788797093.248157:0:5815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788797093.248187:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb0795da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:3300:1875689374565760:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788797093.248255:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788797093.248348:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374565760 00000100:00100000:2.0:1788797093.248356:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374565760 00000100:00100000:2.0:1788797093.248426:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788797093.248434:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0795d8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+19:3300:x1875689374565760:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788797093.248445:0:6698:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788797093.248458:0:6698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cb080437400/0xca7fc0c411f9356b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xca7fc0c411f93564 expref: 19 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797093.248469:0:6698:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788797093.248502:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0795d8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+18:3300:x1875689374565760:12345-0@lo:103:ldlm_bl.0 Request processed in 69us (246us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797093.248510:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788797093.248549:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb0795da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:3300:1875689374565760:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788797093.250997:0:12913:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788797093.251025:0:12913:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.138@tcp lock: ffff8cb080437800/0xca7fc0c411f93564 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xca7fc0c411f9356b expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797093.251125:0:12913:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.138@tcp lock: ffff8cb079b80200/0xca7fc0c411f9348b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xca7fc0c411f93492 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797093.251136:0:12913:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.138@tcp lock: ffff8cb079b80200/0xca7fc0c411f9348b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xca7fc0c411f93492 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797093.251144:0:12913:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.138@tcp lock: ffff8cb079b80200/0xca7fc0c411f9348b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xca7fc0c411f93492 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797093.251151:0:12913:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.138@tcp lock: ffff8cb079b80200/0xca7fc0c411f9348b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xca7fc0c411f93492 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797093.251172:0:12913:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788797093.251180:0:12913:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.138@tcp lock: ffff8cb080437e00/0xca7fc0c411f9377f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xca7fc0c411f93786 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797093.251188:0:12913:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.138@tcp lock: ffff8cb080437e00/0xca7fc0c411f9377f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xca7fc0c411f93786 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797093.251193:0:12913:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.138@tcp lock: ffff8cb080437e00/0xca7fc0c411f9377f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xca7fc0c411f93786 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797093.251226:0:12913:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.138@tcp lock: ffff8cb080437e00/0xca7fc0c411f9377f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xca7fc0c411f93786 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797093.251237:0:12913:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788797093.251243:0:12913:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.138@tcp lock: ffff8cb041485a00/0xca7fc0c411f9323f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xca7fc0c411f93246 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797093.251249:0:12913:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.138@tcp lock: ffff8cb041485a00/0xca7fc0c411f9323f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xca7fc0c411f93246 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797093.251254:0:12913:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.138@tcp lock: ffff8cb041485a00/0xca7fc0c411f9323f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xca7fc0c411f93246 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797093.251260:0:12913:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.138@tcp lock: ffff8cb041485a00/0xca7fc0c411f9323f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xca7fc0c411f93246 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797093.251267:0:12913:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 10000000:01000000:1.0:1788797093.251273:0:12913:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:1.0:1788797093.251283:0:12913:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:1.0:1788797093.251334:0:12913:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-MDT0000 00000020:01000000:1.0:1788797093.251339:0:12913:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:1.0:1788797093.251347:0:12913:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788797093.251354:0:12913:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 2/5 00000020:00080000:1.0:1788797093.251362:0:12913:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff8caf41994000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788797093.251370:0:12913:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff8cb0812c9800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788797093.253277:0:12913:0:(genops.c:1552:class_disconnect_exports()) OBD device 5 (ffff8cb0457019c0) has exports, disconnecting them 00000020:00080000:1.0:1788797093.253288:0:12913:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8caf41994000), last request at 1788797089 00000020:00000080:1.0:1788797093.253299:0:12913:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xca7fc0c411f93453 00000100:00080000:1.0:1788797093.253352:0:12913:0:(import.c:65:import_set_state_nolock()) ffff8caf41995800 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1788797093.253423:0:12913:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8caf41994000): rc 0 00000020:00000080:1.0:1788797093.253425:0:12913:0:(genops.c:885:class_export_put()) final put ffff8caf41994000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:1.0:1788797093.253440:0:12913:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8cb0812c9800), last request at 1788797089 00000020:00000080:1.0:1788797093.253444:0:12913:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xca7fc0c411f933c7 00000100:00080000:1.0:1788797093.253453:0:12913:0:(import.c:65:import_set_state_nolock()) ffff8cb0812cc800 : changing import state from FULL to CLOSED 00000020:00000080:1.0:1788797093.253463:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8caf41994000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:1.0:1788797093.253511:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8caf41995800 for lustre-MDT0000 00000020:00080000:1.0:1788797093.253526:0:12913:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8cb0812c9800): rc 0 00000020:00000080:1.0:1788797093.253528:0:12913:0:(genops.c:885:class_export_put()) final put ffff8cb0812c9800/lustre-MDT0000-lwp-OST0000_UUID 00000004:00000080:1.0:1788797093.253540:0:12913:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffac66c15ffae0 00000020:00000080:1.0:1788797093.253551:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8cb0812c9800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00010000:00010000:2.0:1788797093.253832:0:8446:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788797093.253846:0:8446:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.138@tcp lock: ffff8cb079b80200/0xca7fc0c411f9348b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xca7fc0c411f93492 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797093.253857:0:8446:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb079b80200 already unused, calling callback (ffffffffc1adac20) 10000000:00010000:2.0:1788797093.253926:0:8446:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.138@tcp lock: ffff8cb079b80200/0xca7fc0c411f9348b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xca7fc0c411f93492 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797093.253940:0:8446:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.138@tcp lock: ffff8cb079b80200/0xca7fc0c411f9348b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xca7fc0c411f93492 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788797093.253956:0:8446:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.138@tcp lock: ffff8cb079b80200/0xca7fc0c411f9348b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xca7fc0c411f93492 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788797093.253975:0:8446:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:2.0:1788797093.253979:0:8446:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:2.0:1788797093.253982:0:8446:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:2.0:1788797093.254061:0:8446:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.138@tcp lock: ffff8cb079b80200/0xca7fc0c411f9348b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xca7fc0c411f93492 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797093.254068:0:8446:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788797093.254095:0:8446:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.138@tcp lock: ffff8cb079b80200/0xca7fc0c411f9348b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xca7fc0c411f93492 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797093.254102:0:8446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.138@tcp lock: ffff8cb079b80200/0xca7fc0c411f9348b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xca7fc0c411f93492 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797093.254121:0:8446:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788797093.254125:0:8446:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.138@tcp lock: ffff8cb080437e00/0xca7fc0c411f9377f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xca7fc0c411f93786 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797093.254132:0:8446:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb080437e00 already unused, calling callback (ffffffffc1adac20) 10000000:00010000:2.0:1788797093.254135:0:8446:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.138@tcp lock: ffff8cb080437e00/0xca7fc0c411f9377f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xca7fc0c411f93786 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797093.254142:0:8446:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.138@tcp lock: ffff8cb080437e00/0xca7fc0c411f9377f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xca7fc0c411f93786 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788797093.254268:0:8446:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.138@tcp lock: ffff8cb080437e00/0xca7fc0c411f9377f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xca7fc0c411f93786 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788797093.254274:0:8446:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1788797093.254276:0:8446:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1788797093.254278:0:8446:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1788797093.254299:0:8446:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.138@tcp lock: ffff8cb080437e00/0xca7fc0c411f9377f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xca7fc0c411f93786 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797093.254305:0:8446:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788797093.254315:0:8446:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.138@tcp lock: ffff8cb080437e00/0xca7fc0c411f9377f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xca7fc0c411f93786 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797093.254321:0:8446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.138@tcp lock: ffff8cb080437e00/0xca7fc0c411f9377f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xca7fc0c411f93786 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797093.254332:0:8446:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788797093.254336:0:8446:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.138@tcp lock: ffff8cb041485a00/0xca7fc0c411f9323f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xca7fc0c411f93246 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797093.254341:0:8446:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb041485a00 already unused, calling callback (ffffffffc1adac20) 10000000:00010000:2.0:1788797093.254344:0:8446:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.138@tcp lock: ffff8cb041485a00/0xca7fc0c411f9323f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xca7fc0c411f93246 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797093.254350:0:8446:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.138@tcp lock: ffff8cb041485a00/0xca7fc0c411f9323f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xca7fc0c411f93246 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788797093.254356:0:8446:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.138@tcp lock: ffff8cb041485a00/0xca7fc0c411f9323f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xca7fc0c411f93246 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788797093.254361:0:8446:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:2.0:1788797093.254363:0:8446:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:2.0:1788797093.254365:0:8446:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:2.0:1788797093.254375:0:8446:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.138@tcp lock: ffff8cb041485a00/0xca7fc0c411f9323f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xca7fc0c411f93246 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797093.254380:0:8446:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788797093.254385:0:8446:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.138@tcp lock: ffff8cb041485a00/0xca7fc0c411f9323f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xca7fc0c411f93246 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797093.254397:0:8446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.138@tcp lock: ffff8cb041485a00/0xca7fc0c411f9323f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xca7fc0c411f93246 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797093.254408:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788797093.254410:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788797093.254412:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788797093.254437:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb0795da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:3301:1875689374565888:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788797093.254518:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788797093.254586:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374565888 00000100:00100000:2.0:1788797093.254594:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374565888 00000100:00100000:2.0:1788797093.254640:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788797093.254648:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0484c4050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+18:3301:x1875689374565888:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788797093.254663:0:5811:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788797093.254677:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cb079b80800/0xca7fc0c411f93492 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xca7fc0c411f9348b expref: 18 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797093.254690:0:5811:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788797093.254723:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0484c4050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+17:3301:x1875689374565888:12345-0@lo:103:ldlm_bl.0 Request processed in 74us (204us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797093.254729:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788797093.254765:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb0795da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:3301:1875689374565888:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788797093.254785:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788797093.254799:0:5815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788797093.255124:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8cb0812cc800 for lustre-MDT0000 00000100:00080000:1.0:1788797093.255399:0:12913:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1788797093.255403:0:12913:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 3 00000004:00080000:1.0:1788797093.255420:0:12913:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1788797093.255495:0:12913:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:1.0:1788797093.255512:0:12913:0:(import.c:65:import_set_state_nolock()) ffff8cb0812ce000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:1.0:1788797093.255526:0:12913:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1788797093.255528:0:12913:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 3 00000004:00080000:1.0:1788797093.255546:0:12913:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788797093.255630:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb0795c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3299:1875689374566272:0@lo:9:umount.0 00000100:00100000:1.0:1788797093.255670:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788797093.255707:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374566272 00000100:00100000:1.0:1788797093.255711:0:6683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374566272 00000100:00100000:1.0:1788797093.255891:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788797093.255902:0:6683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0795c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3299:x1875689374566272:12345-0@lo:9:umount.0 00000020:00000080:1.0:1788797093.255941:0:6683:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xca7fc0c411f933d5 00000100:00080000:1.0:1788797093.256368:0:6683:0:(import.c:65:import_set_state_nolock()) ffff8cb06f611000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788797093.256416:0:6683:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:1.0:1788797093.256900:0:6683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0795c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+2:3299:x1875689374566272:12345-0@lo:9:umount.0 Request processed in 999us (1227us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797093.256910:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:1.0:1788797093.256976:0:3299:0:(import.c:65:import_set_state_nolock()) ffff8cb0812ce000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1788797093.256988:0:3299:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1788797093.256990:0:3299:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788797093.256994:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb0795c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3299:1875689374566272:0@lo:9:umount.0 00000100:00080000:1.0:1788797093.257055:0:12913:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:1.0:1788797093.257075:0:12913:0:(import.c:65:import_set_state_nolock()) ffff8caf419b3800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1788797093.257100:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb0795c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3299:1875689374566400:0@lo:9:umount.0 00000100:00100000:1.0:1788797093.257134:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788797093.257312:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:1.0:1788797093.257540:0:12913:0:(genops.c:1557:class_disconnect_exports()) OBD device 5 (ffff8cb0457019c0) has no exports 00000100:00100000:2.0:1788797093.257662:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374566400 00000100:00100000:2.0:1788797093.257670:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374566400 00000100:00100000:2.0:1788797093.257741:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788797093.257750:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0795c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3299:x1875689374566400:12345-0@lo:9:umount.0 00000020:00000080:2.0:1788797093.257776:0:6681:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xca7fc0c411f934bc 00000100:00080000:2.0:1788797093.257783:0:6681:0:(import.c:65:import_set_state_nolock()) ffff8cb077ecb000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788797093.257817:0:6681:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:2.0:1788797093.258489:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0795c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2:3299:x1875689374566400:12345-0@lo:9:umount.0 Request processed in 738us (1352us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797093.258498:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00010000:00010000:2.0:1788797093.258520:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788797093.258865:0:3299:0:(import.c:65:import_set_state_nolock()) ffff8caf419b3800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1788797093.258875:0:3299:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1788797093.258877:0:3299:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788797093.258881:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb0795c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3299:1875689374566400:0@lo:9:umount.0 00000100:00100000:2.0:1788797093.260258:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb0795dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:3302:1875689374566016:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788797093.260341:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788797093.260417:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788797093.260425:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb0795d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:3302:1875689374566144:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788797093.260448:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788797093.260480:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374566016 00000100:00100000:2.0:1788797093.260487:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374566016 00000100:00100000:2.0:1788797093.260587:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374566144 00000100:00100000:2.0:1788797093.260591:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374566144 00000100:00100000:2.0:1788797093.260618:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788797093.260626:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0795da300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+18:3302:x1875689374566016:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788797093.260641:0:5811:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788797093.260662:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cb042ea2e00/0xca7fc0c411f93786 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xca7fc0c411f9377f expref: 18 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797093.260679:0:5811:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788797093.260717:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0795da300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+17:3302:x1875689374566016:12345-0@lo:103:ldlm_bl.0 Request processed in 92us (377us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797093.260724:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788797093.260759:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788797093.260764:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0795d8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+16:3302:x1875689374566144:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788797093.260773:0:5811:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788797093.260781:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cb0821f1600/0xca7fc0c411f93246 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xca7fc0c411f9323f expref: 16 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797093.260795:0:5811:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788797093.260818:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0795d8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+15:3302:x1875689374566144:12345-0@lo:103:ldlm_bl.0 Request processed in 54us (369us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797093.260824:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788797093.260864:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb0795d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:3302:1875689374566144:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788797093.260872:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb0795dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:3302:1875689374566016:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788797093.263565:0:11663:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb06f57ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e4fd12db-0bbb-441b-b6f0-f6d480305cb0+14:3303:x1875689374565632:12345-0@lo:103:ldlm_bl.0 Request processed in 16578us (25385us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797093.263580:0:11663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:3.0:1788797093.264520:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788797093.264527:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788797093.265832:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb0795d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:3303:1875689374565632:0@lo:103:ldlm_bl.0 00000020:00080000:3.0:1788797093.282063:0:12913:0:(genops.c:1557:class_disconnect_exports()) OBD device 5 (ffff8cb0457019c0) has no exports 00000020:00000080:3.0:1788797093.354826:0:12913:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xca7fc0c411f9329a 00000020:00000080:3.0:1788797093.354855:0:12913:0:(genops.c:885:class_export_put()) final put ffff8cb0812e2800/lustre-QMT0000_UUID 00000020:01000000:3.0:1788797093.357257:0:12913:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:2.0:1788797093.357913:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8cb0812e2800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:2.0:1788797093.357951:0:12913:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788797093.357961:0:12913:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1788797093.357966:0:12913:0:(genops.c:1557:class_disconnect_exports()) OBD device 7 (ffff8cb0812d4d40) has no exports 00000020:00000080:2.0:1788797093.358414:0:12913:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xca7fc0c411f93293 00000020:00000080:2.0:1788797093.358423:0:12913:0:(genops.c:885:class_export_put()) final put ffff8cb0812c8000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788797093.358498:0:12913:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788797093.358505:0:12913:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1788797093.358509:0:12913:0:(genops.c:885:class_export_put()) final put ffff8cb0812cd800/lustre-QMT0000_UUID 00000020:00000080:2.0:1788797093.358511:0:12913:0:(genops.c:844:class_export_destroy()) destroying export ffff8cb0812cd800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:2.0:1788797093.358515:0:12913:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:00000080:3.0:1788797093.358668:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8cb0812c8000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:2.0:1788797093.358716:0:12913:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8cb0499ab7e0 - data ffff8caf41661438/ffff8cb07915a400 00000020:01000000:2.0:1788797093.358867:0:12913:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8cb0585918a0 - data ffff8cb072f14d80/ffff8cb0812c6000 00000001:00000004:2.0:1788797093.374173:0:12913:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00000100:00080000:2.0:1788797093.522089:0:12913:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1788797093.522101:0:12913:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 4 00000004:00080000:2.0:1788797093.522149:0:12913:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788797093.522152:0:12913:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1788797093.522747:0:6701:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1788797093.522755:0:6701:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 8 count 1 00000040:00080000:1.0:1788797093.522775:0:6701:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:2.0:1788797093.524072:0:12913:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1788797093.524080:0:12913:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 4 00000004:00080000:2.0:1788797093.524101:0:12913:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788797093.524104:0:12913:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1788797093.524870:0:7994:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1788797093.524876:0:7994:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 5 count 1 00000040:00080000:1.0:1788797093.524887:0:7994:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:1.0:1788797093.624647:0:12913:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xca7fc0c411f93262 00000020:00000080:1.0:1788797093.624673:0:12913:0:(genops.c:885:class_export_put()) final put ffff8cb0697eb800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788797093.628152:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8cb0697eb800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1788797093.632755:0:12913:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xca7fc0c411f93277 00000020:00000080:0.0:1788797093.632783:0:12913:0:(genops.c:885:class_export_put()) final put ffff8cb06f615000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1788797093.632809:0:12913:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:0.0:1788797093.632820:0:12913:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788797093.632835:0:12913:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788797093.632842:0:12913:0:(genops.c:1557:class_disconnect_exports()) OBD device 4 (ffff8cb045700000) has no exports 00000004:01000000:0.0:1788797093.633138:0:12913:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:0.0:1788797093.633148:0:12913:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xca7fc0c411f934b5 00000020:00000080:0.0:1788797093.633152:0:12913:0:(genops.c:885:class_export_put()) final put ffff8cb042fd4000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1788797093.633156:0:12913:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:0.0:1788797093.633160:0:12913:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788797093.633166:0:12913:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1788797093.633168:0:12913:0:(genops.c:1557:class_disconnect_exports()) OBD device 17 (ffff8cb049934d40) has no exports 00000020:00000080:0.0:1788797093.633175:0:12913:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xca7fc0c411f934ae 00000020:00000080:0.0:1788797093.633178:0:12913:0:(genops.c:885:class_export_put()) final put ffff8caf419b6800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788797093.633940:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8cb06f615000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00000080:2.0:1788797093.633954:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8cb042fd4000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:2.0:1788797093.633959:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8caf419b6800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:0.0:1788797093.641493:0:12913:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:0.0:1788797093.641503:0:12913:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1788797093.641507:0:12913:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 5 00000004:00080000:0.0:1788797093.641516:0:12913:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788797093.641518:0:12913:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788797093.641612:0:12913:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788797093.641629:0:12913:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788797093.641640:0:12913:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xca7fc0c411f93342 00000020:00000080:0.0:1788797093.641650:0:12913:0:(genops.c:885:class_export_put()) final put ffff8caf41990000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788797093.643746:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8caf419b3800 for lustre-OST0001-osc-MDT0000 00000020:00000080:2.0:1788797093.643767:0:8:0:(genops.c:885:class_export_put()) final put ffff8cb042fd0000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788797093.643771:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8cb042fd0000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:2.0:1788797093.643780:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1788797093.644601:0:12913:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:2.0:1788797093.644743:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8caf41990000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1788797093.644777:0:12913:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788797093.644791:0:12913:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1788797093.644970:0:12913:0:(genops.c:1557:class_disconnect_exports()) OBD device 11 (ffff8cb0812d3380) has no exports 00000020:00000080:1.0:1788797093.644990:0:12913:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xca7fc0c411f9333b 00000020:00000080:1.0:1788797093.645007:0:12913:0:(genops.c:885:class_export_put()) final put ffff8cb0812cf000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788797093.646714:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8cb0812cf000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:0.0:1788797093.649952:0:12913:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:0.0:1788797093.649962:0:12913:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1788797093.649966:0:12913:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 5 00000004:00080000:0.0:1788797093.649975:0:12913:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788797093.649977:0:12913:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788797093.650100:0:12913:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788797093.650120:0:12913:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788797093.650160:0:12913:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788797093.650178:0:12913:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788797093.650184:0:12913:0:(genops.c:885:class_export_put()) final put ffff8cb049539000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788797093.650188:0:12913:0:(genops.c:844:class_export_destroy()) destroying export ffff8cb049539000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:0.0:1788797093.650196:0:12913:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788797093.650499:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8cb0812ce000 for lustre-OST0000-osc-MDT0000 00000020:00000080:2.0:1788797093.650511:0:8:0:(genops.c:885:class_export_put()) final put ffff8cb048ff9000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788797093.650513:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8cb048ff9000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:2.0:1788797093.650524:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788797093.650689:0:12913:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xca7fc0c411f9327e 00000020:00000080:0.0:1788797093.650703:0:12913:0:(genops.c:885:class_export_put()) final put ffff8cb06f612800/lustre-MDD0000_UUID 00000020:01000000:0.0:1788797093.650728:0:12913:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:0.0:1788797093.650733:0:12913:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788797093.650739:0:12913:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788797093.650743:0:12913:0:(genops.c:1557:class_disconnect_exports()) OBD device 6 (ffff8cb045704d40) has no exports 00000020:00000080:0.0:1788797093.650766:0:12913:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788797093.650770:0:12913:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:0.0:1788797093.650774:0:12913:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xca7fc0c411f93285 00000020:00000080:0.0:1788797093.650778:0:12913:0:(genops.c:885:class_export_put()) final put ffff8cb06f610000/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1788797093.650788:0:12913:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8cb042f0b000 from lustre-MDT0000, refs=3 00000020:01000004:0.0:1788797093.650792:0:12913:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8cb042f0b000 3 00000020:01000004:0.0:1788797093.650798:0:12913:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8cb042f0b000 from lustre-MDT0000 00000020:00000080:0.0:1788797093.650848:0:12913:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788797093.650854:0:12913:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:0.0:1788797093.650859:0:12913:0:(genops.c:885:class_export_put()) final put ffff8cb0697e9800/lustre-MDT0000_UUID 00000020:00000080:0.0:1788797093.650863:0:12913:0:(genops.c:844:class_export_destroy()) destroying export ffff8cb0697e9800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:0.0:1788797093.650878:0:12913:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:0.0:1788797093.650936:0:12913:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000004:0.0:1788797093.650942:0:12913:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:0.0:1788797093.650946:0:12913:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:0.0:1788797093.650949:0:12913:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788797093.650952:0:12913:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788797093.650960:0:12913:0:(genops.c:1818:print_export_data()) MGS: ACTIVE ffff8cb049a87000 e4fd12db-0bbb-441b-b6f0-f6d480305cb0 0@lo 13 (0 0 8) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788797093.650966:0:12913:0:(genops.c:1552:class_disconnect_exports()) OBD device 1 (ffff8cb049933380) has exports, disconnecting them 00000020:00080000:0.0:1788797093.650970:0:12913:0:(genops.c:1527:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff8cb049a87000), last request at 1788796854 00000020:00000080:0.0:1788797093.650988:0:12913:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xca7fc0c411f93223 00000020:00010000:0.0:1788797093.651002:0:12913:0:(genops.c:1920:obd_stale_export_put()) Put export ffff8cb049a87000: total 2 00000100:00080000:0.0:1788797093.651015:0:12913:0:(import.c:65:import_set_state_nolock()) ffff8cb049a82000 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1788797093.651059:0:12913:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8cb049a87000): rc 0 00000020:00080000:0.0:1788797093.651068:0:12913:0:(genops.c:1557:class_disconnect_exports()) OBD device 1 (ffff8cb049933380) has no exports 00000020:00000080:2.0:1788797093.652682:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8cb06f612800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:2.0:1788797093.652697:0:8:0:(genops.c:885:class_export_put()) final put ffff8cb06f616000/lustre-MDD0000_UUID 00000020:00000080:2.0:1788797093.652701:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8cb06f616000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:2.0:1788797093.652712:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:2.0:1788797093.653011:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8cb06f610000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00010000:2.0:1788797093.653056:0:5815:0:(genops.c:1906:obd_stale_export_get()) Get export ffff8cb049a87000: total 0 00010000:00010000:2.0:1788797093.653095:0:5815:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8cb049a87000, canceled 0 locks, left on hash table 8. 00010000:00010000:2.0:1788797093.653143:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cb041484200/0xca7fc0c411f93533 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xca7fc0c411f9352c expref: 9 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797093.653171:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cb079b80600/0xca7fc0c411f93541 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xca7fc0c411f9353a expref: 8 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797093.653182:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cb079b81600/0xca7fc0c411f9354f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xca7fc0c411f93548 expref: 7 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797093.653194:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cb080436400/0xca7fc0c411f93778 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xca7fc0c411f93771 expref: 6 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797093.653210:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cb0821f1a00/0xca7fc0c411f9336c lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xca7fc0c411f93365 expref: 5 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797093.653233:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cb080437600/0xca7fc0c411f9376a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xca7fc0c411f93763 expref: 4 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797093.653273:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cb080436800/0xca7fc0c411f93579 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xca7fc0c411f93572 expref: 3 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797093.653290:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cb079b81c00/0xca7fc0c411f93525 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xca7fc0c411f9351e expref: 2 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797093.653315:0:5815:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8cb049a87000, canceled 8 locks, left on hash table 0. 00000020:00000080:2.0:1788797093.653331:0:5815:0:(genops.c:885:class_export_put()) final put ffff8cb049a87000/e4fd12db-0bbb-441b-b6f0-f6d480305cb0 00010000:00010000:2.0:1788797093.653350:0:5815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788797093.653352:0:5815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788797093.653354:0:5815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788797093.653360:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8cb049a87000/e4fd12db-0bbb-441b-b6f0-f6d480305cb0 for MGS 00000020:00000080:2.0:1788797093.653388:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8cb049a82000 for MGS 00000100:00100000:0.0:1788797093.654072:0:5820:0:(service.c:3188:ptlrpc_main()) ll_mgs_0002: service thread [ffff8cb042e56e00:5820] 2 exiting: rc = 0 00000100:00100000:1.0:1788797093.654520:0:5818:0:(service.c:3188:ptlrpc_main()) ll_mgs_0000: service thread [ffff8cb050fcd600:5818] 0 exiting: rc = 1 00000100:00100000:1.0:1788797093.654601:0:5819:0:(service.c:3188:ptlrpc_main()) ll_mgs_0001: service thread [ffff8cb042e57e00:5819] 1 exiting: rc = 0 00000100:00100000:0.0:1788797093.655233:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788797093.655416:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788797093.655423:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788797093.655429:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788797093.655435:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788797093.655443:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788797093.655449:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788797093.655458:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788797093.655464:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788797093.655475:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788797093.655486:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788797093.655496:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788797093.655506:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788797093.655513:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788797093.655519:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788797093.655525:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788797093.655530:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788797093.655535:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788797093.655540:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788797093.655546:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788797093.655553:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788797093.655559:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788797093.655565:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788797093.655570:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788797093.655576:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788797093.655582:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788797093.655587:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788797093.655593:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788797093.655598:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788797093.655603:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788797093.655622:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788797093.655627:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788797093.655632:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788797093.655638:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788797093.655644:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788797093.655649:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788797093.655655:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788797093.655661:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788797093.655667:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788797093.655673:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788797093.655677:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788797093.655682:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788797093.655688:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788797093.655694:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788797093.655699:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788797093.655705:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788797093.655709:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788797093.655714:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788797093.655720:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788797093.655726:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788797093.655731:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788797093.655739:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788797093.655744:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788797093.655749:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788797093.655754:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788797093.655760:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788797093.655766:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788797093.655772:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788797093.655779:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788797093.655784:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788797093.655790:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788797093.656218:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788797093.656410:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788797093.656431:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 20000000:01000000:1.0:1788797093.657797:0:12913:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1788797093.657808:0:12913:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 00000020:01000000:1.0:1788797093.665598:0:12913:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8cb046b12360 - data ffff8cb07fc15bd0/ffff8cb06f0d9400 00000020:01000000:1.0:1788797093.665759:0:12913:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8cb043766f00 - data ffff8cb072fe3e58/ffff8cb06ccfd000 00000020:00000080:1.0:1788797093.666685:0:12913:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xca7fc0c411f93207 00000020:00000080:1.0:1788797093.666698:0:12913:0:(genops.c:885:class_export_put()) final put ffff8cb0501aa800/lustre-MDT0000-osd_UUID 00000020:01000004:1.0:1788797093.666954:0:12913:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8cb042f0b000 from MGS, refs=2 00000020:01000004:1.0:1788797093.666958:0:12913:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8cb042f0b000 2 00000020:01000004:1.0:1788797093.666962:0:12913:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8cb042f0b000 from MGS 00000020:00000080:1.0:1788797093.666986:0:12913:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788797093.667001:0:12913:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:1.0:1788797093.667004:0:12913:0:(genops.c:885:class_export_put()) final put ffff8cb0501ac000/MGS 00000020:00000080:1.0:1788797093.667007:0:12913:0:(genops.c:844:class_export_destroy()) destroying export ffff8cb0501ac000/MGS for MGS 00000020:01000000:1.0:1788797093.667061:0:12913:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:1.0:1788797093.667173:0:12913:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:1.0:1788797093.667177:0:12913:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788797093.667183:0:12913:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1788797093.667190:0:12913:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff8cb042f34800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788797093.667197:0:12913:0:(genops.c:1552:class_disconnect_exports()) OBD device 8 (ffff8cb048f74d40) has exports, disconnecting them 00000020:00080000:1.0:1788797093.667205:0:12913:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff8cb042f34800), last request at 1788796855 00000020:00000080:1.0:1788797093.667213:0:12913:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xca7fc0c411f932d2 00000020:00080000:1.0:1788797093.667235:0:12913:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8cb042f34800): rc 0 00000020:00000080:1.0:1788797093.667241:0:12913:0:(genops.c:885:class_export_put()) final put ffff8cb042f34800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:2.0:1788797093.673530:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8cb0501aa800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1788797093.677382:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8cb042f34800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:0.0:1788797093.678077:0:12913:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:0.0:1788797093.678099:0:12913:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788797093.678103:0:12913:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1788797093.678115:0:12913:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788797093.678247:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8cb042f33800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1788797093.678478:0:12913:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788797093.678487:0:12913:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:0.0:1788797093.678493:0:12913:0:(genops.c:885:class_export_put()) final put ffff8cb06f613000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:0.0:1788797093.678497:0:12913:0:(genops.c:844:class_export_destroy()) destroying export ffff8cb06f613000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:0.0:1788797093.678506:0:12913:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:0.0:1788797093.678569:0:12913:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8cb042f0b000 1 00000020:00000080:0.0:1788797093.678575:0:12913:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xca7fc0c411f931f9 00000020:00000080:0.0:1788797093.678581:0:12913:0:(genops.c:885:class_export_put()) final put ffff8cb0501af000/lustre-MDT0000-osd_UUID 00000020:01000000:0.0:1788797093.678640:0:12913:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:0.0:1788797093.678645:0:12913:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788797093.678650:0:12913:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788797093.678654:0:12913:0:(genops.c:1557:class_disconnect_exports()) OBD device 0 (ffff8cb045703380) has no exports 00000020:00000080:2.0:1788797093.680456:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8cb0501af000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1788797093.834746:0:12913:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788797093.834765:0:12913:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:0.0:1788797093.834772:0:12913:0:(genops.c:885:class_export_put()) final put ffff8cb0450fd000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1788797093.834778:0:12913:0:(genops.c:844:class_export_destroy()) destroying export ffff8cb0450fd000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:0.0:1788797093.834791:0:12913:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:0.0:1788797093.835401:0:12913:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8cb042f0d000 00000020:01000000:0.0:1788797093.835429:0:12913:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:0.0:1788797093.835434:0:12913:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788797093.835439:0:12913:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1788797093.835444:0:12913:0:(genops.c:1557:class_disconnect_exports()) OBD device 3 (ffff8cb0494f19c0) has no exports 00000100:00100000:2.0:1788797093.840289:0:5826:0:(service.c:3188:ptlrpc_main()) mdt00_001: service thread [ffff8cb042e56000:5826] 1 exiting: rc = 0 00000100:00100000:3.0:1788797093.842154:0:5825:0:(service.c:3188:ptlrpc_main()) mdt00_000: service thread [ffff8cb0464c6600:5825] 0 exiting: rc = 1 00000100:00100000:0.0:1788797093.843670:0:5827:0:(service.c:3188:ptlrpc_main()) mdt00_002: service thread [ffff8cb042e57c00:5827] 2 exiting: rc = 0 00000100:00100000:0.0:1788797093.843779:0:7636:0:(service.c:3188:ptlrpc_main()) mdt00_003: service thread [ffff8cb06f0b3a00:7636] 3 exiting: rc = 0 00000100:00100000:2.0:1788797093.843982:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.844000:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.844007:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.844012:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.844017:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.844097:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.844106:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.844112:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.844117:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.844123:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.844130:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.844136:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.844142:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.844147:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.844153:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.844159:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.844165:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.844171:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.844176:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.844183:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.844189:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.844195:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.844201:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.844208:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.844214:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.844220:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.844228:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.844233:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.844250:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.844273:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.844280:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.844286:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.844292:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.844298:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.844317:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.844323:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.844328:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.844335:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.844342:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.844347:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.844353:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.844358:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.844364:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.844371:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.844377:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.844383:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.844388:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.844394:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.844400:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.844405:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.844411:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.844417:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.844423:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.844429:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.844435:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.844441:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.844448:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.844456:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.844461:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.844467:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.844473:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.844478:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.844484:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.844490:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.852713:0:5829:0:(service.c:3188:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff8cb0464c7800:5829] 1 exiting: rc = 0 00000100:00100000:1.0:1788797093.853440:0:5828:0:(service.c:3188:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff8cb050679200:5828] 0 exiting: rc = 1 00000100:00100000:2.0:1788797093.858643:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.858655:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.858661:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.858668:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.858675:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.858681:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.858687:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.858692:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.858698:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.858704:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.858709:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.858714:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.858720:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.858724:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.858729:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.858734:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.858739:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.858744:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.858749:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.858754:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.858759:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.858764:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.858769:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.858774:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.858779:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.858784:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.858790:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.858794:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.858800:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.858805:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.858811:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.858816:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.858823:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.858829:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.858849:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.858855:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.858861:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.858865:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.858870:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.858874:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.858879:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.858884:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.858890:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.858896:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.858901:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.858907:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.858912:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.858918:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.858924:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.858929:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.858934:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.858938:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.858944:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.858951:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.858956:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.858961:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.858966:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.858972:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.858977:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.858983:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.858999:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.859006:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.859011:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.859016:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788797093.859848:0:5830:0:(service.c:3188:ptlrpc_main()) mdt_out00_000: service thread [ffff8cb042e97200:5830] 0 exiting: rc = 1 00000100:00100000:2.0:1788797093.860531:0:5831:0:(service.c:3188:ptlrpc_main()) mdt_out00_001: service thread [ffff8cb042e97600:5831] 1 exiting: rc = 0 00000100:00100000:0.0:1788797093.860710:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788797093.860724:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788797093.860735:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788797093.860755:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788797093.860764:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788797093.860778:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788797093.860786:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788797093.860793:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788797093.860799:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788797093.860806:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788797093.860812:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788797093.860818:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788797093.860825:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788797093.860831:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788797093.860837:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788797093.860844:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788797093.860849:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788797093.860870:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788797093.860879:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788797093.860885:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788797093.860891:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788797093.860898:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788797093.860903:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788797093.860910:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788797093.860915:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788797093.860921:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788797093.860928:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788797093.860935:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788797093.860941:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788797093.860960:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788797093.860968:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788797093.860976:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788797093.860985:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788797093.861007:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788797093.861014:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788797093.861021:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788797093.861234:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788797093.861391:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788797093.861405:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788797093.861411:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788797093.861418:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788797093.861439:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788797093.861445:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788797093.861451:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788797093.861457:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788797093.861462:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788797093.861468:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788797093.861476:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788797093.861484:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788797093.861490:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788797093.861495:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788797093.861503:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788797093.861508:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788797093.861528:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788797093.861535:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788797093.861541:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788797093.861547:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788797093.861554:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788797093.861560:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788797093.861566:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788797093.861573:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788797093.861579:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788797093.861585:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788797093.861593:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788797093.879861:0:5833:0:(service.c:3188:ptlrpc_main()) mdt_seqs_0001: service thread [ffff8cb050fce200:5833] 1 exiting: rc = 0 00000100:00100000:0.0:1788797093.879896:0:5832:0:(service.c:3188:ptlrpc_main()) mdt_seqs_0000: service thread [ffff8cb050fce000:5832] 0 exiting: rc = 1 00000100:00100000:2.0:1788797093.880009:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.880017:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.880023:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.880047:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.880078:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.880084:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.880090:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.880097:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.880102:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.880107:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.880113:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.880120:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.880126:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.880131:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.880137:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.880142:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.880148:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.880153:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.880159:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.880165:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.880171:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.880177:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.880182:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.880188:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.880194:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.880199:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.880204:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.880210:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.880215:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.880221:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.880227:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.880233:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.880239:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.880244:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.880252:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.880258:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.880263:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.880269:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.880275:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.880287:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.880293:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.880432:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.880441:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.880447:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.880453:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.880458:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.880464:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.880470:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.880487:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.880493:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.880498:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.880504:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.880509:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.880515:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.880520:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.880525:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.880530:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.880536:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.880541:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.880546:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.880552:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.880557:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.880563:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.880568:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.881258:0:5835:0:(service.c:3188:ptlrpc_main()) mdt_seqm_0001: service thread [ffff8cb050fcf000:5835] 1 exiting: rc = 0 00000100:00100000:2.0:1788797093.881419:0:5834:0:(service.c:3188:ptlrpc_main()) mdt_seqm_0000: service thread [ffff8cb050fcf800:5834] 0 exiting: rc = 1 00000100:00100000:2.0:1788797093.881473:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.881481:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.881486:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.881492:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.881499:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.881504:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.881511:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.881517:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.881540:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.881545:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.881550:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.881556:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.881561:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.881566:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.881573:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.881579:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.881585:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.881592:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.881689:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.881696:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.881701:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.881707:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.881713:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.881720:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.881726:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.881733:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.881738:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.881745:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.881751:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.881757:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.881762:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.881767:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.881772:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.881777:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.881783:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.881789:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.881794:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.881800:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.881806:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.881811:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.881817:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.881822:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.881827:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.881844:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.881849:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.881854:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.881860:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.881866:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.881872:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.881878:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.881883:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.881888:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.881894:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.881899:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.881904:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.881908:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.881913:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.881918:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.881925:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.881930:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.881934:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.881939:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.881944:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.881950:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788797093.883914:0:5837:0:(service.c:3188:ptlrpc_main()) mdt_fld_0001: service thread [ffff8cb0498d0000:5837] 1 exiting: rc = 0 00000100:00100000:1.0:1788797093.884657:0:5836:0:(service.c:3188:ptlrpc_main()) mdt_fld_0000: service thread [ffff8cb050fcf600:5836] 0 exiting: rc = 1 00000100:00100000:2.0:1788797093.884903:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.884912:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.884917:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.884922:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.884928:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.884933:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.884938:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.884943:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.884949:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.884954:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.884959:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.884965:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.884970:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.884975:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.885007:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.885011:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.885016:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.885022:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.885161:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.885170:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.885175:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.885180:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.885185:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.885190:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.885206:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.885213:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.885218:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.885223:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.885228:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.885233:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.885238:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.885243:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.885247:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.885251:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.885257:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.885263:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.885268:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.885274:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.885279:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.885283:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.885288:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.885294:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.885365:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.885372:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.885378:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.885383:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.885389:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.885394:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.885399:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.885412:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.885418:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.885423:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.885429:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.885435:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.885441:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.885446:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.885452:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.885458:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.885463:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.885469:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.885474:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.885479:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.885486:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.885491:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788797093.887538:0:5839:0:(service.c:3188:ptlrpc_main()) mdt_io00_001: service thread [ffff8cb050128200:5839] 1 exiting: rc = 0 00000100:00100000:0.0:1788797093.889481:0:5840:0:(service.c:3188:ptlrpc_main()) mdt_io00_002: service thread [ffff8cb0774d1e00:5840] 2 exiting: rc = 0 00000100:00100000:0.0:1788797093.897107:0:5838:0:(service.c:3188:ptlrpc_main()) mdt_io00_000: service thread [ffff8cb050128000:5838] 0 exiting: rc = 1 00000100:00100000:2.0:1788797093.897293:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.897366:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.897373:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.897379:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.897385:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.897392:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.897399:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.897431:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.897439:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.897445:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.897450:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.897456:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.897462:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.897467:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.897473:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.897479:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.897485:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.897491:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.897497:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.897502:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.897523:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.897529:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.897535:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.897541:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.897546:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.897551:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.897557:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.897563:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.897568:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.897574:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.897579:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.897608:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.897616:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.897622:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.897627:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.897634:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.897640:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.897645:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.897652:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.897657:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.897662:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.897667:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.897673:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.897679:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.897685:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.897691:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.897697:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.897702:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.897707:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.897713:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.897718:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.897724:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.897730:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.897735:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.897741:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.897766:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.897773:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.897779:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.897785:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.897790:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.897795:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.897801:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.897806:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797093.897813:0:12913:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:2.0:1788797093.904778:0:12913:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788797093.904792:0:12913:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:2.0:1788797093.904798:0:12913:0:(genops.c:885:class_export_put()) final put ffff8cb048e7d000/MDS_uuid 00000020:00000080:2.0:1788797093.904803:0:12913:0:(genops.c:844:class_export_destroy()) destroying export ffff8cb048e7d000/MDS_uuid for MDS 00000020:01000000:2.0:1788797093.904808:0:12913:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:2.0:1788797093.904953:0:12913:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:2.0:1788797093.994916:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788797094.452218:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb06f57e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:3300:1875689374566528:0@lo:400:kworker.0 00000400:00000100:0.0:1788797094.452300:0:3300:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875689374566528 offset 0 length 224: 4 00000100:00100000:0.0:1788797094.452364:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788797094.452370:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb06f57d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3300:1875689374566656:0@lo:400:kworker.0 00000400:00000100:0.0:1788797094.452391:0:3300:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875689374566656 offset 0 length 224: 4 00000100:00100000:0.0:1788797094.452417:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb06f57fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3302:1875689374566784:0@lo:400:kworker.0 00000400:00000100:0.0:1788797094.452433:0:3302:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875689374566784 offset 0 length 224: 4 00010000:00010000:3.0:1788797095.031183:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788797095.149991:0:7640:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788797095.150002:0:7640:0:(genops.c:885:class_export_put()) final put ffff8cb077ecd800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788797095.150074:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8cb077ecd800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:1.0:1788797095.150137:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8cb077ecb000 for lustre-OST0001 00010000:00010000:1.0:1788797096.051338:0:5815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788797097.074256:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788797097.878319:0:13066:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:1.0:1788797097.893625:0:13066:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-OST0000 00010000:00010000:1.0:1788797097.893674:0:13066:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.138@tcp lock: ffff8cb080437200/0xca7fc0c411f9353a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xca7fc0c411f93541 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797097.893691:0:13066:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.138@tcp lock: ffff8cb080437200/0xca7fc0c411f9353a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xca7fc0c411f93541 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797097.893699:0:13066:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.138@tcp lock: ffff8cb080437200/0xca7fc0c411f9353a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xca7fc0c411f93541 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797097.893706:0:13066:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.138@tcp lock: ffff8cb080437200/0xca7fc0c411f9353a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xca7fc0c411f93541 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797097.893772:0:13066:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1788797097.893778:0:13066:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1788797097.893803:0:13066:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788797097.893815:0:13066:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8cb06f57d880 x1875689374566656/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788797110 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788797097.893836:0:13066:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1788797097.893843:0:13066:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1788797097.893872:0:13066:0:(import.c:65:import_set_state_nolock()) ffff8cb06f613800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1788797097.893960:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb0795c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3299:1875689374566912:0@lo:39:umount.0 00000400:00000100:0.0:1788797097.894066:0:3299:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875689374566912 offset 0 length 224: 4 00000100:00100000:2.0:1788797097.894303:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb06f57d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3300:1875689374566656:0@lo:400:kworker.0 00010000:00010000:3.0:1788797097.894733:0:5814:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788797097.894742:0:5814:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.138@tcp lock: ffff8cb080437200/0xca7fc0c411f9353a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xca7fc0c411f93541 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797097.894750:0:5814:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb080437200 already unused, calling callback (ffffffffc1adac20) 10000000:00010000:3.0:1788797097.894754:0:5814:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.138@tcp lock: ffff8cb080437200/0xca7fc0c411f9353a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xca7fc0c411f93541 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797097.894810:0:5814:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.138@tcp lock: ffff8cb080437200/0xca7fc0c411f9353a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0xca7fc0c411f93541 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788797097.894817:0:5814:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.138@tcp lock: ffff8cb080437200/0xca7fc0c411f9353a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0xca7fc0c411f93541 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788797097.894823:0:5814:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788797097.894825:0:5814:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1788797097.894828:0:5814:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1788797097.894939:0:5814:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.138@tcp lock: ffff8cb080437200/0xca7fc0c411f9353a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xca7fc0c411f93541 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797097.894946:0:5814:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1788797097.894993:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb0795db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:3303:1875689374567040:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788797097.895073:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788797097.895243:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374567040 00000100:00100000:1.0:1788797097.895251:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374567040 00000100:00100000:1.0:1788797097.895314:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788797097.895322:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb06f57f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3303:x1875689374567040:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1788797097.895329:0:5811:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788797097 with bad export cookie 14591593266051363363 00010000:00010000:2.0:1788797097.902759:0:5814:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.138@tcp lock: ffff8cb080437200/0xca7fc0c411f9353a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xca7fc0c411f93541 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797097.902778:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.138@tcp lock: ffff8cb080437200/0xca7fc0c411f9353a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xca7fc0c411f93541 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797097.902800:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788797097.902802:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788797097.902805:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788797097.909023:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb06f57f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3303:x1875689374567040:12345-0@lo:103:ldlm_bl.0 Request processed in 13693us (13942us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788797097.909074:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:0.0:1788797097.909349:0:3303:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.204.138@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1788797097.909355:0:3303:0:(import.c:65:import_set_state_nolock()) ffff8cb048e7a000 MGS: changing import state from FULL to DISCONN 00000100:02020000:0.0:1788797097.909359:0:3303:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.204.138@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:0.0:1788797097.915991:0:3303:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.204.138@tcp not replayable, auto-deactivating 00000100:00080000:0.0:1788797097.915998:0:3303:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:0.0:1788797097.916010:0:3303:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8cb06f57e300 x1875689374566528/t0(0) o400->MGC192.168.204.138@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788797110 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788797097.916347:0:3303:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8cb0795db100 x1875689374567040/t0(0) o103->MGC192.168.204.138@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788797113 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:0.0:1788797097.916359:0:3303:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:0.0:1788797097.916361:0:3303:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:0.0:1788797097.916363:0:3303:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:0.0:1788797097.916367:0:3303:0:(import.c:65:import_set_state_nolock()) ffff8cb048e7a000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788797097.916373:0:3303:0:(import.c:545:import_select_connection()) MGC192.168.204.138@tcp: connect to NID 0@lo last attempt 143 00000100:00080000:0.0:1788797097.916412:0:3303:0:(import.c:666:import_select_connection()) MGC192.168.204.138@tcp: import ffff8cb048e7a000 using connection 192.168.204.138@tcp/0@lo 00000100:00100000:0.0:1788797097.916443:0:3303:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cb06f57d880 x1875689374567168/t0(0) o250->MGC192.168.204.138@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788797097.916478:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb0795db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:3303:1875689374567040:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788797097.916771:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb06f57d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:3299:1875689374567168:0@lo:250:ptlrpcd_00_03.0 00000400:00000100:3.0:1788797097.916826:0:3299:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875689374567168 offset 0 length 520: 4 00000100:00100000:2.0:1788797097.916961:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb06f57e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:3300:1875689374566528:0@lo:400:kworker.0 00010000:00010000:3.0:1788797098.099113:0:5815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788797098.108931:0:6713:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788797098.108944:0:6713:0:(genops.c:885:class_export_put()) final put ffff8cb06f610800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788797098.109690:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8cb06f610800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:2.0:1788797098.109789:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8cb06f611000 for lustre-OST0000 00010000:00010000:0.0:1788797099.127811:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788797099.570376:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) e4fd12db-0bbb-441b-b6f0-f6d480305cb0->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788797099.570387:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) e4fd12db-0bbb-441b-b6f0-f6d480305cb0->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788797099.570501:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb0795c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3300:1875689374567296:0@lo:400:kworker.0 00000400:00000100:2.0:1788797099.570555:0:3300:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875689374567296 offset 0 length 224: 4 00010000:00010000:2.0:1788797100.146627:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788797101.170261:0:5815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788797102.195726:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788797102.578910:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) e4fd12db-0bbb-441b-b6f0-f6d480305cb0->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788797102.578921:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) e4fd12db-0bbb-441b-b6f0-f6d480305cb0->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788797102.579162:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788797102.579189:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb06f57f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3300:1875689374567424:0@lo:400:kworker.0 00000400:00000100:1.0:1788797102.579266:0:3300:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875689374567424 offset 0 length 224: 4 00010000:00010000:2.0:1788797103.218347:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788797104.242209:0:5815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788797105.266269:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788797106.291617:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788797107.250303:0:3299:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788797097/real 1788797097] req@ffff8cb06f57d880 x1875689374567168/t0(0) o250->MGC192.168.204.138@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788797107 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_03.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788797107.250346:0:3299:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8cb06f57d880 x1875689374567168/t0(0) o250->MGC192.168.204.138@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788797107 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_03.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788797107.250357:0:3299:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788797097/real 1788797097] req@ffff8cb0795c4e00 x1875689374566912/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788797107 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788797107.250368:0:3299:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8cb0795c4e00 x1875689374566912/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788797107 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788797107.250396:0:3299:0:(import.c:65:import_set_state_nolock()) ffff8cb048e7a000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788797107.250423:0:3299:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:3.0:1788797107.250427:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb06f57d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:3299:1875689374567168:0@lo:250:ptlrpcd_00_03.0 00000100:00080000:3.0:1788797107.250434:0:3299:0:(import.c:65:import_set_state_nolock()) ffff8cb06f613800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1788797107.250452:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb0795c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3299:1875689374566912:0@lo:39:umount.0 00000100:00080000:1.0:1788797107.250568:0:13066:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788797107.250573:0:13066:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1788797107.250578:0:13066:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:2.0:1788797107.250594:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) e4fd12db-0bbb-441b-b6f0-f6d480305cb0->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788797107.250599:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1788797107.250601:0:36:0:(import.c:65:import_set_state_nolock()) ffff8cb048e7a000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788797107.250606:0:36:0:(import.c:545:import_select_connection()) MGC192.168.204.138@tcp: connect to NID 0@lo last attempt 386 00000100:00080000:2.0:1788797107.250611:0:36:0:(import.c:630:import_select_connection()) MGC192.168.204.138@tcp: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788797107.250622:0:36:0:(import.c:666:import_select_connection()) MGC192.168.204.138@tcp: import ffff8cb048e7a000 using connection 192.168.204.138@tcp/0@lo 00000100:00100000:2.0:1788797107.250651:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cb0795dad80 x1875689374567552/t0(0) o250->MGC192.168.204.138@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788797107.250783:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb0795d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3302:1875689374567680:0@lo:400:kworker.0 00000400:00000100:0.0:1788797107.250837:0:3302:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875689374567680 offset 0 length 224: 4 00000100:00100000:3.0:1788797107.251137:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb0795dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:3299:1875689374567552:0@lo:250:kworker.0 00000400:00000100:3.0:1788797107.251159:0:3299:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875689374567552 offset 0 length 520: 4 00010000:00010000:1.0:1788797107.251694:0:13066:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.138@tcp lock: ffff8cb080437000/0xca7fc0c411f93548 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xca7fc0c411f9354f expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797107.251708:0:13066:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.138@tcp lock: ffff8cb080437000/0xca7fc0c411f93548 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xca7fc0c411f9354f expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797107.251716:0:13066:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.138@tcp lock: ffff8cb080437000/0xca7fc0c411f93548 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xca7fc0c411f9354f expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797107.251724:0:13066:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.138@tcp lock: ffff8cb080437000/0xca7fc0c411f93548 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xca7fc0c411f9354f expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797107.251763:0:13066:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788797107.251772:0:13066:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.138@tcp lock: ffff8cb0821f0600/0xca7fc0c411f93771 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xca7fc0c411f93778 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797107.251779:0:13066:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.138@tcp lock: ffff8cb0821f0600/0xca7fc0c411f93771 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xca7fc0c411f93778 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797107.251803:0:13066:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.138@tcp lock: ffff8cb0821f0600/0xca7fc0c411f93771 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xca7fc0c411f93778 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797107.251809:0:13066:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.138@tcp lock: ffff8cb0821f0600/0xca7fc0c411f93771 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xca7fc0c411f93778 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797107.251827:0:13066:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:1.0:1788797107.251833:0:13066:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:1.0:1788797107.251868:0:13066:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-OST0000 00000020:01000000:1.0:1788797107.251872:0:13066:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:1.0:1788797107.251878:0:13066:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788797107.251884:0:13066:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1788797107.251889:0:13066:0:(genops.c:1557:class_disconnect_exports()) OBD device 12 (ffff8cb048f73380) has no exports 00000020:00080000:1.0:1788797107.251919:0:13066:0:(genops.c:1557:class_disconnect_exports()) OBD device 12 (ffff8cb048f73380) has no exports 00010000:00010000:3.0:1788797107.253530:0:5815:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788797107.253542:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.138@tcp lock: ffff8cb080437000/0xca7fc0c411f93548 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xca7fc0c411f9354f expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797107.253554:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb080437000 already unused, calling callback (ffffffffc1adac20) 10000000:00010000:3.0:1788797107.253576:0:5815:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.138@tcp lock: ffff8cb080437000/0xca7fc0c411f93548 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xca7fc0c411f9354f expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797107.253587:0:5815:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.138@tcp lock: ffff8cb080437000/0xca7fc0c411f93548 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xca7fc0c411f9354f expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788797107.253595:0:5815:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.138@tcp lock: ffff8cb080437000/0xca7fc0c411f93548 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xca7fc0c411f9354f expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788797107.253602:0:5815:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788797107.253605:0:5815:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:3.0:1788797107.253607:0:5815:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:3.0:1788797107.253627:0:5815:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8cb048e7a000 00010000:00010000:3.0:1788797107.253632:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.138@tcp lock: ffff8cb080437000/0xca7fc0c411f93548 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xca7fc0c411f9354f expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797107.253640:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.138@tcp lock: ffff8cb080437000/0xca7fc0c411f93548 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xca7fc0c411f9354f expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797107.253659:0:5815:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788797107.253663:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.138@tcp lock: ffff8cb0821f0600/0xca7fc0c411f93771 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xca7fc0c411f93778 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797107.253670:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb0821f0600 already unused, calling callback (ffffffffc1adac20) 10000000:00010000:3.0:1788797107.253673:0:5815:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.138@tcp lock: ffff8cb0821f0600/0xca7fc0c411f93771 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xca7fc0c411f93778 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797107.253681:0:5815:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.138@tcp lock: ffff8cb0821f0600/0xca7fc0c411f93771 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xca7fc0c411f93778 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788797107.253688:0:5815:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.138@tcp lock: ffff8cb0821f0600/0xca7fc0c411f93771 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xca7fc0c411f93778 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788797107.253700:0:5815:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1788797107.253703:0:5815:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1788797107.253705:0:5815:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1788797107.253712:0:5815:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8cb048e7a000 00010000:00010000:3.0:1788797107.253715:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.138@tcp lock: ffff8cb0821f0600/0xca7fc0c411f93771 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xca7fc0c411f93778 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797107.253722:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.138@tcp lock: ffff8cb0821f0600/0xca7fc0c411f93771 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xca7fc0c411f93778 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797107.253745:0:5815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788797107.253748:0:5815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788797107.253750:0:5815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788797107.256859:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:1.0:1788797107.261322:0:13066:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8cb048e2f540 - data ffff8cb071056798/ffff8cb08044e000 00000020:01000000:1.0:1788797107.261492:0:13066:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8cb042e33480 - data ffff8cb0710566c0/ffff8caf41d19400 00100000:10000000:1.0:1788797107.269070:0:13066:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00010000:00010000:0.0:1788797107.317905:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788797107.330834:0:13066:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xca7fc0c411f93396 00000020:00000080:3.0:1788797107.330845:0:13066:0:(genops.c:885:class_export_put()) final put ffff8caf41991800/lustre-OST0000-osd_UUID 00000020:01000004:3.0:1788797107.330902:0:13066:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8cb042fda000 from lustre-OST0000, refs=2 00000020:01000004:3.0:1788797107.330906:0:13066:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8cb042fda000 2 00000020:01000004:3.0:1788797107.330909:0:13066:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8cb042fda000 from lustre-OST0000 00000020:00000080:3.0:1788797107.330933:0:13066:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788797107.330943:0:13066:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:3.0:1788797107.330946:0:13066:0:(genops.c:885:class_export_put()) final put ffff8caf41996000/lustre-OST0000_UUID 00000020:00000080:3.0:1788797107.330950:0:13066:0:(genops.c:844:class_export_destroy()) destroying export ffff8caf41996000/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:3.0:1788797107.330959:0:13066:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:3.0:1788797107.330998:0:13066:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:3.0:1788797107.331003:0:13066:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:3.0:1788797107.331006:0:13066:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788797107.331011:0:13066:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1788797107.331017:0:13066:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff8cb04550a800 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788797107.331022:0:13066:0:(genops.c:1552:class_disconnect_exports()) OBD device 13 (ffff8cb0812d0000) has exports, disconnecting them 00000020:00080000:3.0:1788797107.331076:0:13066:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff8cb04550a800), last request at 1788796873 00000020:00000080:3.0:1788797107.331080:0:13066:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xca7fc0c411f933c0 00000020:00080000:3.0:1788797107.331089:0:13066:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8cb04550a800): rc 0 00000020:00000080:3.0:1788797107.331094:0:13066:0:(genops.c:885:class_export_put()) final put ffff8cb04550a800/lustre-MDT0000-lwp-OST0000 00000020:00000080:0.0:1788797107.338134:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8caf41991800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:0.0:1788797107.339972:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8cb04550a800/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:0.0:1788797107.340247:0:13066:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:0.0:1788797107.340252:0:13066:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788797107.340257:0:13066:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1788797107.340262:0:13066:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788797107.340281:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8cb06f613800 for lustre-MDT0000-lwp-OST0000 00000020:00000080:0.0:1788797107.340418:0:13066:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788797107.340428:0:13066:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:0.0:1788797107.340433:0:13066:0:(genops.c:885:class_export_put()) final put ffff8caf41a4b800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:0.0:1788797107.340436:0:13066:0:(genops.c:844:class_export_destroy()) destroying export ffff8caf41a4b800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:0.0:1788797107.340440:0:13066:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000004:0.0:1788797107.340503:0:13066:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8cb042fda000 1 00000020:00000080:0.0:1788797107.340519:0:13066:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xca7fc0c411f93303 00000020:00000080:0.0:1788797107.340527:0:13066:0:(genops.c:885:class_export_put()) final put ffff8cb042f36000/lustre-OST0000-osd_UUID 00000020:01000000:0.0:1788797107.340535:0:13066:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:0.0:1788797107.340542:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8cb042f36000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:0.0:1788797107.340550:0:13066:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788797107.340555:0:13066:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1788797107.340559:0:13066:0:(genops.c:1557:class_disconnect_exports()) OBD device 9 (ffff8cb0494f4d40) has no exports 00000020:00000080:1.0:1788797107.365748:0:13066:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788797107.365769:0:13066:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:1.0:1788797107.365775:0:13066:0:(genops.c:885:class_export_put()) final put ffff8cb042fd8000/lustre-OST0000-osd_UUID 00000020:00000080:1.0:1788797107.365781:0:13066:0:(genops.c:844:class_export_destroy()) destroying export ffff8cb042fd8000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:1.0:1788797107.365794:0:13066:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:1.0:1788797107.365949:0:13066:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8cb042fda800 00000020:02000400:1.0:1788797107.366001:0:13066:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:3.0:1788797108.338308:0:5815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788797109.363173:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000400:2.0:1788797110.328609:0:3302:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788797094/real 1788797094] req@ffff8cb06f57fb80 x1875689374566784/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788797110 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788797110.357504:0:3302:0:(client.c:2548:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff8cb06f57fb80 x1875689374566784/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788797110 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788797110.357519:0:3302:0:(import.c:65:import_set_state_nolock()) ffff8cb0585a9000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1788797110.357522:0:3302:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00010000:00010000:3.0:1788797110.387131:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788797110.387153:0:3302:0:(import.c:418:ptlrpc_pinger_force()) lustre-MDT0000_UUID: waking up pinger s:DISCONN 00000100:00080000:3.0:1788797110.387198:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) e4fd12db-0bbb-441b-b6f0-f6d480305cb0->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788797110.387204:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) e4fd12db-0bbb-441b-b6f0-f6d480305cb0->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788797110.387207:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788797110.387210:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788797110.387214:0:8:0:(import.c:65:import_set_state_nolock()) ffff8cb0585a9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788797110.387221:0:8:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 181 00000100:00080000:3.0:1788797110.387236:0:8:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8cb0585a9000 using connection 192.168.204.138@tcp/0@lo 00000100:00100000:3.0:1788797110.387272:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cb0778ddc00 x1875689374567808/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788797110.387682:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb0778ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3299:1875689374567808:0@lo:38:kworker.0 00000100:00100000:0.0:1788797110.387725:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb06f57fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3302:1875689374566784:0@lo:400:kworker.0 00000400:00000100:1.0:1788797110.387735:0:3299:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875689374567808 offset 0 length 520: 4 00000020:01000004:1.0:1788797110.487522:0:13219:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:2.0:1788797110.501763:0:13219:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-OST0001 00010000:00010000:2.0:1788797110.501849:0:13219:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.138@tcp lock: ffff8cb041484e00/0xca7fc0c411f9351e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xca7fc0c411f93525 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797110.501883:0:13219:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.138@tcp lock: ffff8cb041484e00/0xca7fc0c411f9351e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xca7fc0c411f93525 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797110.501890:0:13219:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.138@tcp lock: ffff8cb041484e00/0xca7fc0c411f9351e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xca7fc0c411f93525 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797110.501897:0:13219:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.138@tcp lock: ffff8cb041484e00/0xca7fc0c411f9351e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xca7fc0c411f93525 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797110.506213:0:13219:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788797110.506228:0:13219:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00010000:00010000:0.0:1788797110.506551:0:5815:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788797110.506561:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.138@tcp lock: ffff8cb041484e00/0xca7fc0c411f9351e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xca7fc0c411f93525 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797110.506573:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb041484e00 already unused, calling callback (ffffffffc1adac20) 10000000:00010000:0.0:1788797110.506577:0:5815:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.138@tcp lock: ffff8cb041484e00/0xca7fc0c411f9351e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xca7fc0c411f93525 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797110.506587:0:5815:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.138@tcp lock: ffff8cb041484e00/0xca7fc0c411f9351e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xca7fc0c411f93525 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788797110.506595:0:5815:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.138@tcp lock: ffff8cb041484e00/0xca7fc0c411f9351e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xca7fc0c411f93525 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788797110.506601:0:5815:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788797110.506604:0:5815:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1788797110.506606:0:5815:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1788797110.506621:0:5815:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8cb048e7a000 00010000:00010000:0.0:1788797110.506625:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.138@tcp lock: ffff8cb041484e00/0xca7fc0c411f9351e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xca7fc0c411f93525 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797110.506632:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.138@tcp lock: ffff8cb041484e00/0xca7fc0c411f9351e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xca7fc0c411f93525 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797110.506687:0:5815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788797110.506689:0:5815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788797110.506691:0:5815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788797110.507110:0:13219:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788797110.507124:0:13219:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8cb0795c4000 x1875689374567296/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788797115 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788797110.507206:0:13219:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8cb06f57f100 x1875689374567424/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788797118 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788797110.507215:0:13219:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8cb0795d9880 x1875689374567680/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788797123 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788797110.507230:0:13219:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8cb0778ddc00 x1875689374567808/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788797120 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788797110.507246:0:13219:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:3.0:1788797110.507252:0:13219:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1788797110.507266:0:13219:0:(import.c:65:import_set_state_nolock()) ffff8cb0585a9000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:3.0:1788797110.507271:0:13219:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788797110.507276:0:13219:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8cb0795c4000 x1875689374567296/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788797115 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788797110.507375:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb0795d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3302:1875689374567680:0@lo:400:kworker.0 00000100:00100000:1.0:1788797110.507956:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb0795c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3300:1875689374567296:0@lo:400:kworker.0 00000100:00100000:3.0:1788797110.507999:0:13219:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8cb06f57f100 x1875689374567424/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788797118 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788797110.508008:0:13219:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8cb0795d9880 x1875689374567680/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788797123 ref 1 fl Complete:ENQU/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788797110.508015:0:13219:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8cb0778ddc00 x1875689374567808/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788797120 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788797110.508021:0:13219:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:1.0:1788797110.508379:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb06f57f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3300:1875689374567424:0@lo:400:kworker.0 00000100:00100000:1.0:1788797110.508410:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb0778ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3299:1875689374567808:0@lo:38:kworker.0 00000100:00100000:3.0:1788797110.508516:0:13219:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1788797110.510674:0:13219:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.138@tcp lock: ffff8cb079b81200/0xca7fc0c411f9352c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xca7fc0c411f93533 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797110.510694:0:13219:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.138@tcp lock: ffff8cb079b81200/0xca7fc0c411f9352c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xca7fc0c411f93533 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797110.510767:0:13219:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.138@tcp lock: ffff8cb079b81200/0xca7fc0c411f9352c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xca7fc0c411f93533 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797110.510775:0:13219:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.138@tcp lock: ffff8cb079b81200/0xca7fc0c411f9352c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xca7fc0c411f93533 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797110.510901:0:13219:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788797110.510911:0:13219:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.138@tcp lock: ffff8cb041484600/0xca7fc0c411f93763 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xca7fc0c411f9376a expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797110.510919:0:13219:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.138@tcp lock: ffff8cb041484600/0xca7fc0c411f93763 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xca7fc0c411f9376a expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797110.511078:0:13219:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.138@tcp lock: ffff8cb041484600/0xca7fc0c411f93763 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xca7fc0c411f9376a expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797110.511087:0:13219:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.138@tcp lock: ffff8cb041484600/0xca7fc0c411f93763 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xca7fc0c411f9376a expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797110.511187:0:8446:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788797110.511195:0:8446:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.138@tcp lock: ffff8cb079b81200/0xca7fc0c411f9352c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xca7fc0c411f93533 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797110.511202:0:8446:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb079b81200 already unused, calling callback (ffffffffc1adac20) 10000000:00010000:0.0:1788797110.511206:0:8446:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.138@tcp lock: ffff8cb079b81200/0xca7fc0c411f9352c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xca7fc0c411f93533 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797110.511215:0:8446:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.138@tcp lock: ffff8cb079b81200/0xca7fc0c411f9352c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xca7fc0c411f93533 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788797110.511222:0:8446:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.138@tcp lock: ffff8cb079b81200/0xca7fc0c411f9352c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xca7fc0c411f93533 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788797110.511228:0:8446:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788797110.511230:0:8446:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 00010000:00010000:0.0:1788797110.511241:0:8446:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8cb048e7a000 00010000:00010000:0.0:1788797110.511246:0:8446:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.138@tcp lock: ffff8cb079b81200/0xca7fc0c411f9352c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xca7fc0c411f93533 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797110.511253:0:8446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.138@tcp lock: ffff8cb079b81200/0xca7fc0c411f9352c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xca7fc0c411f93533 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797110.511266:0:8446:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788797110.511276:0:8446:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.138@tcp lock: ffff8cb041484600/0xca7fc0c411f93763 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xca7fc0c411f9376a expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797110.511282:0:8446:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb041484600 already unused, calling callback (ffffffffc1adac20) 00010000:00010000:2.0:1788797110.511418:0:13219:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 10000000:01000000:2.0:1788797110.511425:0:13219:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 10000000:01000000:2.0:1788797110.511429:0:13219:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:2.0:1788797110.511519:0:13219:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-OST0001 00000020:01000000:2.0:1788797110.511524:0:13219:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:2.0:1788797110.511529:0:13219:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788797110.511534:0:13219:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1788797110.511538:0:13219:0:(genops.c:1557:class_disconnect_exports()) OBD device 15 (ffff8cb0494f3380) has no exports 00000020:00080000:2.0:1788797110.511562:0:13219:0:(genops.c:1557:class_disconnect_exports()) OBD device 15 (ffff8cb0494f3380) has no exports 10000000:00010000:0.0:1788797110.512927:0:8446:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.138@tcp lock: ffff8cb041484600/0xca7fc0c411f93763 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xca7fc0c411f9376a expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797110.512945:0:8446:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.138@tcp lock: ffff8cb041484600/0xca7fc0c411f93763 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xca7fc0c411f9376a expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788797110.512953:0:8446:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.138@tcp lock: ffff8cb041484600/0xca7fc0c411f93763 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xca7fc0c411f9376a expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788797110.512959:0:8446:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1788797110.512961:0:8446:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1788797110.512965:0:8446:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1788797110.512990:0:8446:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8cb048e7a000 00010000:00010000:0.0:1788797110.512995:0:8446:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.138@tcp lock: ffff8cb041484600/0xca7fc0c411f93763 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xca7fc0c411f9376a expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797110.513001:0:8446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.138@tcp lock: ffff8cb041484600/0xca7fc0c411f93763 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xca7fc0c411f9376a expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797110.513021:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788797110.513023:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:2.0:1788797110.514610:0:13219:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8cb048e2f120 - data ffff8cb0710171b0/ffff8cb079aca800 00010000:00010000:3.0:1788797110.514791:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:2.0:1788797110.515179:0:13219:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8cb079b8b660 - data ffff8cb07fd76af8/ffff8cb06f568000 00010000:00010000:0.0:1788797110.515625:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:1.0:1788797110.532705:0:13219:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:2.0:1788797110.557158:0:13219:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xca7fc0c411f93422 00000020:00000080:2.0:1788797110.557169:0:13219:0:(genops.c:885:class_export_put()) final put ffff8cb04632e000/lustre-OST0001-osd_UUID 00000020:01000004:2.0:1788797110.557244:0:13219:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8cb042fd2800 from lustre-OST0001, refs=2 00000020:01000004:2.0:1788797110.557248:0:13219:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8cb042fd2800 2 00000020:01000004:2.0:1788797110.557253:0:13219:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8cb042fd2800 from lustre-OST0001 00000020:00000080:2.0:1788797110.557278:0:13219:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788797110.557292:0:13219:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:2.0:1788797110.557296:0:13219:0:(genops.c:885:class_export_put()) final put ffff8cb0585ac000/lustre-OST0001_UUID 00000020:00000080:2.0:1788797110.557300:0:13219:0:(genops.c:844:class_export_destroy()) destroying export ffff8cb0585ac000/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:2.0:1788797110.557310:0:13219:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:2.0:1788797110.557410:0:13219:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import e4fd12db-0bbb-441b-b6f0-f6d480305cb0->MGS 00010000:00010000:2.0:1788797110.557428:0:13219:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.138@tcp lock: ffff8cb082045000/0xca7fc0c411f93365 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xca7fc0c411f9336c expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788797110.557658:0:13219:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.138@tcp lock: ffff8cb082045000/0xca7fc0c411f93365 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xca7fc0c411f9336c expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788797110.557676:0:13219:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:2.0:1788797110.557678:0:13219:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:2.0:1788797110.557682:0:13219:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:2.0:1788797110.557697:0:13219:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8cb048e7a000 00010000:00010000:2.0:1788797110.557701:0:13219:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.138@tcp lock: ffff8cb082045000/0xca7fc0c411f93365 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xca7fc0c411f9336c expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797110.557720:0:13219:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.138@tcp lock: ffff8cb079b80a00/0xca7fc0c411f93572 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xca7fc0c411f93579 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788797110.557729:0:13219:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.138@tcp lock: ffff8cb079b80a00/0xca7fc0c411f93572 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xca7fc0c411f93579 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788797110.557734:0:13219:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788797110.557737:0:13219:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:2.0:1788797110.557739:0:13219:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:2.0:1788797110.557750:0:13219:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8cb048e7a000 00010000:00010000:2.0:1788797110.557753:0:13219:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.138@tcp lock: ffff8cb079b80a00/0xca7fc0c411f93572 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xca7fc0c411f93579 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1788797110.557770:0:13219:0:(import.c:65:import_set_state_nolock()) ffff8cb048e7a000 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:2.0:1788797110.557775:0:13219:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:2.0:1788797110.557778:0:13219:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:2.0:1788797110.557779:0:13219:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:2.0:1788797110.557784:0:13219:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:2.0:1788797110.557797:0:13219:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8cb0795dad80 x1875689374567552/t0(0) o250->MGC192.168.204.138@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1788797122 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:2.0:1788797110.557827:0:13219:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:2.0:1788797110.557830:0:13219:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 16s for inflight to error out 00000100:00100000:1.0:1788797110.557917:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb0795dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e4fd12db-0bbb-441b-b6f0-f6d480305cb0:3299:1875689374567552:0@lo:250:kworker.0 10000000:01000000:2.0:1788797110.557995:0:13219:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:2.0:1788797110.558003:0:13219:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xca7fc0c411f93215 00000020:00000080:2.0:1788797110.558008:0:13219:0:(genops.c:885:class_export_put()) final put ffff8cb048e7e800/e4fd12db-0bbb-441b-b6f0-f6d480305cb0 00000020:00000080:3.0:1788797110.558209:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8cb04632e000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:2.0:1788797110.558473:0:13219:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.204.138@tcp (flags='') 00000020:00000080:2.0:1788797110.558480:0:13219:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788797110.558485:0:13219:0:(obd_config.c:956:class_cleanup()) MGC192.168.204.138@tcp: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1788797110.558489:0:13219:0:(genops.c:1557:class_disconnect_exports()) OBD device 2 (ffff8cb0494f0000) has no exports 10000000:01000000:1.0:1788797110.558706:0:5822:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:2.0:1788797110.558798:0:13219:0:(obd_class.h:670:obd_cleanup_client_import()) MGC192.168.204.138@tcp: client import never connected 00000100:00080000:2.0:1788797110.558802:0:13219:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:2.0:1788797110.558804:0:13219:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:2.0:1788797110.558807:0:13219:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:2.0:1788797110.558809:0:13219:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:3.0:1788797110.558856:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8cb048e7e800/e4fd12db-0bbb-441b-b6f0-f6d480305cb0 for MGC192.168.204.138@tcp 00000020:00000080:2.0:1788797110.558950:0:13219:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788797110.558956:0:13219:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.204.138@tcp (uuid e4fd12db-0bbb-441b-b6f0-f6d480305cb0) 00000020:01000000:2.0:1788797110.558963:0:13219:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:2.0:1788797110.558966:0:13219:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788797110.559104:0:13219:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1788797110.559109:0:13219:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff8caf41997800 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788797110.559115:0:13219:0:(genops.c:1552:class_disconnect_exports()) OBD device 16 (ffff8cb06f094d40) has exports, disconnecting them 00000020:00080000:2.0:1788797110.559120:0:13219:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff8caf41997800), last request at 1788796892 00000020:00000080:2.0:1788797110.559125:0:13219:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xca7fc0c411f9344c 00000020:00080000:2.0:1788797110.559137:0:13219:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8caf41997800): rc 0 00000020:00000080:2.0:1788797110.559141:0:13219:0:(genops.c:885:class_export_put()) final put ffff8caf41997800/lustre-MDT0000-lwp-OST0001 00000020:00000080:3.0:1788797110.559211:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8cb048e7a000 for MGC192.168.204.138@tcp 00000020:00000080:3.0:1788797110.559217:0:8:0:(genops.c:885:class_export_put()) final put ffff8cb048e7a800/e4fd12db-0bbb-441b-b6f0-f6d480305cb0 00000020:00000080:3.0:1788797110.559219:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8cb048e7a800/e4fd12db-0bbb-441b-b6f0-f6d480305cb0 for MGC192.168.204.138@tcp 00000020:01000000:3.0:1788797110.559225:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.204.138@tcp (e4fd12db-0bbb-441b-b6f0-f6d480305cb0) 00000020:00000080:3.0:1788797110.560563:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8caf41997800/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:3.0:1788797110.561092:0:13219:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:3.0:1788797110.561097:0:13219:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788797110.561101:0:13219:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:3.0:1788797110.561107:0:13219:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788797110.561197:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8cb0585a9000 for lustre-MDT0000-lwp-OST0001 00010000:00010000:2.0:1788797110.571180:0:5815:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:1.0:1788797110.571392:0:5814:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:2.0:1788797110.571604:0:8446:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00000100:00100000:3.0:1788797110.571806:0:5809:0:(service.c:3188:ptlrpc_main()) ldlm_cb00_000: service thread [ffff8cb042e55a00:5809] 0 exiting: rc = 1 00000100:00100000:2.0:1788797110.571898:0:6697:0:(service.c:3188:ptlrpc_main()) ldlm_cb00_002: service thread [ffff8cb06f21d400:6697] 2 exiting: rc = 0 00000100:00100000:1.0:1788797110.572204:0:5810:0:(service.c:3188:ptlrpc_main()) ldlm_cb00_001: service thread [ffff8cb042e43000:5810] 1 exiting: rc = 0 00000100:00100000:3.0:1788797110.572310:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797110.572623:0:5813:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_002: service thread [ffff8cb042a9b200:5813] 2 exiting: rc = 0 00000100:00100000:2.0:1788797110.572755:0:11663:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_004: service thread [ffff8cb0792e8200:11663] 4 exiting: rc = 0 00000100:00100000:1.0:1788797110.572955:0:5812:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_001: service thread [ffff8cb042e55000:5812] 1 exiting: rc = 0 00000100:00100000:1.0:1788797110.573203:0:5811:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_000: service thread [ffff8cb042e55800:5811] 0 exiting: rc = 1 00000100:00100000:0.0:1788797110.573333:0:6698:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_003: service thread [ffff8cb06f225600:6698] 3 exiting: rc = 0 00000100:00100000:3.0:1788797110.573603:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797110.573611:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797110.573618:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797110.573624:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797110.573631:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797110.573637:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797110.573644:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797110.573650:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797110.573656:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797110.573673:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797110.573680:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797110.573689:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797110.573695:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797110.573702:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797110.573708:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797110.573715:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797110.573721:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797110.573726:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797110.573732:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797110.573737:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797110.573743:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797110.573748:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797110.573754:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797110.573760:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797110.573766:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797110.573771:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797110.573777:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797110.573783:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797110.573790:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797110.573795:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797110.573800:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797110.573805:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797110.573811:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797110.573816:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797110.573822:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797110.573838:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797110.573844:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797110.573850:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797110.573857:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797110.573862:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797110.573868:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797110.573874:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797110.573879:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797110.573884:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797110.573889:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797110.573894:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797110.573898:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797110.573903:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797110.573908:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797110.573912:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797110.573917:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797110.573922:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797110.573927:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797110.573933:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797110.573937:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797110.573941:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797110.573947:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797110.573952:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797110.573958:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797110.573964:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797110.573983:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797110.573988:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797110.573993:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797110.573997:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:3.0:1788797110.575372:0:13219:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788797110.575388:0:13219:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:3.0:1788797110.575394:0:13219:0:(genops.c:885:class_export_put()) final put ffff8cb04632c000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:3.0:1788797110.575399:0:13219:0:(genops.c:844:class_export_destroy()) destroying export ffff8cb04632c000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:3.0:1788797110.575407:0:13219:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000004:3.0:1788797110.575539:0:13219:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8cb042fd2800 1 00000020:00000080:3.0:1788797110.575546:0:13219:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xca7fc0c411f933f1 00000020:00000080:3.0:1788797110.575552:0:13219:0:(genops.c:885:class_export_put()) final put ffff8caf41995000/lustre-OST0001-osd_UUID 00000020:01000000:3.0:1788797110.575602:0:13219:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:3.0:1788797110.575607:0:13219:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788797110.575611:0:13219:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1788797110.575615:0:13219:0:(genops.c:1557:class_disconnect_exports()) OBD device 14 (ffff8cb0499319c0) has no exports 00000020:00000080:1.0:1788797110.577857:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8caf41995000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:2.0:1788797110.591472:0:13219:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788797110.591503:0:13219:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:2.0:1788797110.591509:0:13219:0:(genops.c:885:class_export_put()) final put ffff8cb042fd0800/lustre-OST0001-osd_UUID 00000020:00000080:2.0:1788797110.591515:0:13219:0:(genops.c:844:class_export_destroy()) destroying export ffff8cb042fd0800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:2.0:1788797110.591521:0:13219:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:2.0:1788797110.591735:0:13219:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8cb042fd1800 00000020:01000000:2.0:1788797110.591760:0:13219:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:2.0:1788797110.591763:0:13219:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788797110.591769:0:13219:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1788797110.591773:0:13219:0:(genops.c:1557:class_disconnect_exports()) OBD device 10 (ffff8cb049930000) has no exports 00000020:00000080:2.0:1788797110.591798:0:13219:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788797110.591805:0:13219:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:2.0:1788797110.591808:0:13219:0:(genops.c:885:class_export_put()) final put ffff8cb042f31800/OSS_uuid 00000020:00000080:2.0:1788797110.591811:0:13219:0:(genops.c:844:class_export_destroy()) destroying export ffff8cb042f31800/OSS_uuid for OSS 00000020:01000000:2.0:1788797110.591814:0:13219:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00100000:2.0:1788797110.592021:0:6681:0:(service.c:3188:ptlrpc_main()) ll_ost00_000: service thread [ffff8cb07903e200:6681] 0 exiting: rc = 1 00000100:00100000:2.0:1788797110.592154:0:10829:0:(service.c:3188:ptlrpc_main()) ll_ost00_003: service thread [ffff8cb0792e8c00:10829] 3 exiting: rc = 0 00000100:00100000:2.0:1788797110.592213:0:6683:0:(service.c:3188:ptlrpc_main()) ll_ost00_001: service thread [ffff8cb0457d1200:6683] 1 exiting: rc = 0 00000100:00100000:1.0:1788797110.595245:0:6684:0:(service.c:3188:ptlrpc_main()) ll_ost00_002: service thread [ffff8cb042fc1a00:6684] 2 exiting: rc = 0 00000100:00080000:3.0:1788797110.595598:0:5821:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:2.0:1788797110.595931:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797110.595949:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797110.595957:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797110.595979:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797110.595985:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797110.595990:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797110.595995:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797110.596000:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797110.596006:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797110.596011:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797110.596016:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797110.596022:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797110.596048:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797110.596055:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797110.596061:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797110.596066:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797110.596072:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797110.596093:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797110.596099:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797110.596104:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797110.596110:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797110.596115:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797110.596121:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797110.596126:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797110.596132:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797110.596144:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797110.596150:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797110.596155:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797110.596161:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797110.596166:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797110.596171:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797110.596177:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797110.596181:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797110.596186:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797110.596191:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797110.596196:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797110.596200:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797110.596205:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797110.596216:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797110.596223:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797110.596228:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797110.596234:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797110.596239:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797110.596243:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797110.596248:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797110.596254:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797110.596259:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797110.596263:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797110.596268:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797110.596273:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797110.596277:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797110.596285:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797110.596296:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797110.596301:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797110.596306:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797110.596311:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797110.596321:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797110.596326:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797110.596332:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797110.596337:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797110.596343:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797110.596348:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797110.596353:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797110.596357:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797110.597541:0:6685:0:(service.c:3188:ptlrpc_main()) ll_ost_create00_000: service thread [ffff8cb07903f400:6685] 0 exiting: rc = 1 00000100:00100000:0.0:1788797110.598290:0:6686:0:(service.c:3188:ptlrpc_main()) ll_ost_create00_001: service thread [ffff8cb07903e400:6686] 1 exiting: rc = 0 00000100:00100000:2.0:1788797110.598437:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797110.598460:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797110.598475:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797110.598481:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797110.598487:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797110.598492:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797110.598498:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797110.598502:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797110.598507:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797110.598511:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797110.598516:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797110.598520:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797110.598524:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797110.598528:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797110.598533:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797110.598538:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797110.598542:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797110.598547:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797110.598552:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797110.598557:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797110.598561:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797110.598565:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797110.598570:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797110.598586:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797110.598590:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797110.598596:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797110.598601:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797110.598606:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797110.598612:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797110.598617:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797110.598622:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797110.598626:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797110.598631:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797110.598636:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797110.598641:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797110.598646:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797110.598651:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797110.598655:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797110.598660:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797110.598676:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797110.598680:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797110.598685:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797110.598690:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797110.598694:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797110.598699:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797110.598703:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797110.598707:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797110.598713:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797110.598719:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797110.598724:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797110.598732:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797110.598739:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797110.598745:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797110.598750:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797110.598755:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797110.598761:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797110.598767:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797110.598773:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797110.598786:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797110.598791:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797110.598797:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797110.598802:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797110.598809:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797110.598820:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797110.599719:0:6688:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_001: service thread [ffff8cb0812c3000:6688] 1 exiting: rc = 0 00000100:00100000:2.0:1788797110.599932:0:6689:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_002: service thread [ffff8cb042fc1200:6689] 2 exiting: rc = 0 00000100:00100000:2.0:1788797110.600098:0:6687:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_000: service thread [ffff8cb0812c3200:6687] 0 exiting: rc = 1 00000100:00100000:2.0:1788797110.600152:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797110.600159:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797110.600165:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797110.600184:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797110.600191:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797110.600196:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797110.600201:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797110.600206:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797110.600212:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797110.600217:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797110.600222:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797110.600228:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797110.600235:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797110.600241:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797110.600247:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797110.600252:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797110.600258:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797110.600264:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797110.600269:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797110.600280:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797110.600300:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797110.600308:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797110.600316:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797110.600324:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797110.600331:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797110.600349:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797110.600356:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797110.600362:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797110.600367:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797110.600373:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797110.600378:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797110.600383:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797110.600388:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797110.600393:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797110.600402:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797110.600407:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797110.600414:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797110.600420:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797110.600426:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797110.600432:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797110.600438:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797110.600444:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797110.600449:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797110.600455:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797110.600478:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797110.600486:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797110.600493:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797110.600499:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797110.600506:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797110.600511:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797110.600516:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797110.600522:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797110.600528:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797110.600533:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797110.600539:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797110.600544:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797110.600551:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797110.600557:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797110.600564:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797110.600570:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797110.600585:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797110.600592:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797110.600599:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797110.600605:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797110.608212:0:6690:0:(service.c:3188:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff8cb04989e600:6690] 0 exiting: rc = 1 00000100:00100000:2.0:1788797110.608515:0:6691:0:(service.c:3188:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff8cb04989e400:6691] 1 exiting: rc = 0 00000100:00100000:2.0:1788797110.608578:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797110.608586:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797110.608591:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797110.608596:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797110.608601:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797110.608606:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797110.608611:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797110.608617:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797110.608682:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797110.608688:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797110.608694:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797110.608698:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797110.608703:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797110.608707:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797110.608711:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797110.608716:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797110.608720:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797110.608725:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797110.608729:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797110.608734:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797110.608738:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797110.608743:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797110.608748:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797110.608754:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797110.608774:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797110.608780:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797110.608787:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797110.608793:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797110.608799:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797110.608804:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797110.608825:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797110.608830:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797110.608835:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797110.608841:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797110.608847:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797110.608852:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797110.608857:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797110.608862:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797110.608867:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797110.608872:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797110.608877:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797110.608882:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797110.608887:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797110.608892:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797110.608897:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797110.608903:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797110.608910:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797110.608917:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797110.608923:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797110.608928:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797110.608933:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797110.608940:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797110.608948:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797110.608953:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797110.608959:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797110.608964:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797110.609290:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797110.609297:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797110.609302:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797110.609308:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797110.609313:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797110.609318:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797110.609323:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797110.609328:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797110.610702:0:6692:0:(service.c:3188:ptlrpc_main()) ll_ost_out00_000: service thread [ffff8cb04989fa00:6692] 0 exiting: rc = 1 00000100:00100000:2.0:1788797110.611172:0:6693:0:(service.c:3188:ptlrpc_main()) ll_ost_out00_001: service thread [ffff8cb04989ee00:6693] 1 exiting: rc = 0 00000100:00100000:2.0:1788797110.611250:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797110.611259:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797110.611266:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797110.611273:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797110.611280:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797110.611287:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797110.611313:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797110.611320:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797110.611327:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797110.611335:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797110.611342:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797110.611349:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797110.611357:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797110.611364:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797110.611371:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797110.611379:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797110.611384:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797110.611391:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797110.611413:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797110.611421:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797110.611427:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797110.611434:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797110.611441:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797110.611534:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797110.611542:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797110.611548:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797110.611558:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797110.611564:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797110.611571:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797110.611579:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797110.611601:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797110.611609:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797110.611615:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797110.611621:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797110.611627:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797110.611641:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797110.611646:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797110.611652:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797110.611660:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797110.611682:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797110.611688:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797110.611694:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797110.611716:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797110.611725:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797110.611731:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797110.611737:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797110.611743:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797110.611749:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797110.611755:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797110.611761:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797110.611767:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797110.611774:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797110.611780:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797110.611788:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797110.611810:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797110.611818:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797110.611824:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797110.611830:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797110.611837:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797110.611844:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797110.611850:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797110.611856:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797110.611862:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797110.611876:0:13219:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:3.0:1788797110.622620:0:13219:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:0.0:1788797131.261751:0:13831:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg438-server.virtnet: executing load_modules_local 00000020:01000004:0.0:1788797140.598993:0:14292:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1788797140.598998:0:14292:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:0.0:1788797140.599185:0:14292:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8cb07906b800 00000020:01000004:0.0:1788797140.599204:0:14292:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200005, mountfl=0 00000020:01000004:0.0:1788797140.599212:0:14292:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:0.0:1788797140.599225:0:14292:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff8cb0812d0000) 00000020:00000080:0.0:1788797140.599240:0:14292:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1788797140.632573:0:14292:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:0.0:1788797140.645770:0:14292:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x11:0x0] (8/32) 00100000:10000000:0.0:1788797140.646172:0:14292:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0000 under 173: rc = 0 00100000:10000000:0.0:1788797140.646355:0:14292:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:0.0:1788797140.646442:0:14292:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled nodemap under 173: rc = 0 00100000:10000000:0.0:1788797140.646587:0:14292:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-client under 173: rc = 0 00100000:10000000:0.0:1788797140.646737:0:14292:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled params under 173: rc = 0 00100000:10000000:0.0:1788797140.646817:0:14292:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0000 under 173: rc = 0 00100000:10000000:0.0:1788797140.646895:0:14292:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0001 under 173: rc = 0 00100000:10000000:0.0:1788797140.647155:0:14292:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre under 175: rc = 0 00100000:10000000:0.0:1788797140.655689:0:14292:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled dt-0x0 under 398: rc = 0 00100000:10000000:0.0:1788797140.655808:0:14292:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled md-0x0 under 398: rc = 0 00100000:10000000:0.0:1788797140.657640:0:14292:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000-MDT0000 under 545: rc = 0 00100000:10000000:0.0:1788797140.658526:0:14292:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 545: rc = 0 00100000:10000000:0.0:1788797140.658839:0:14292:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 545: rc = 0 00100000:10000000:0.0:1788797140.659365:0:14292:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000-MDT0000 under 545: rc = 0 00100000:10000000:0.0:1788797140.659934:0:14292:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000-MDT0000 under 545: rc = 0 00100000:10000000:2.0:1788797140.671192:0:14292:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 545: rc = 0 00100000:10000000:2.0:1788797140.672068:0:14292:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000-MDT0000 under 545: rc = 0 00100000:10000000:2.0:1788797140.672357:0:14292:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 545: rc = 0 00100000:10000000:2.0:1788797140.672624:0:14292:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000-MDT0000 under 545: rc = 0 00100000:10000000:2.0:1788797140.672920:0:14292:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 545: rc = 0 00100000:10000000:2.0:1788797140.673216:0:14292:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 545: rc = 0 00100000:10000000:2.0:1788797140.673462:0:14292:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000-MDT0000 under 545: rc = 0 00100000:10000000:2.0:1788797140.673890:0:14292:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_07 under 711: rc = 0 00100000:10000000:2.0:1788797140.674170:0:14292:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_07 under 711: rc = 0 00100000:10000000:2.0:1788797140.678841:0:14292:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_14 under 711: rc = 0 00100000:10000000:2.0:1788797140.679933:0:14292:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_14 under 711: rc = 0 00100000:10000000:2.0:1788797140.686196:0:14292:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_13 under 711: rc = 0 00100000:10000000:2.0:1788797140.688337:0:14292:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_13 under 711: rc = 0 00100000:10000000:2.0:1788797140.691515:0:14292:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_00 under 711: rc = 0 00100000:10000000:2.0:1788797140.691855:0:14292:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_00 under 711: rc = 0 00100000:10000000:2.0:1788797140.692384:0:14292:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_04 under 711: rc = 0 00100000:10000000:2.0:1788797140.693789:0:14292:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_04 under 711: rc = 0 00100000:10000000:2.0:1788797140.694345:0:14292:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_10 under 711: rc = 0 00100000:10000000:2.0:1788797140.694765:0:14292:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_10 under 711: rc = 0 00100000:10000000:2.0:1788797140.696576:0:14292:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_03 under 711: rc = 0 00100000:10000000:2.0:1788797140.697931:0:14292:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_09 under 711: rc = 0 00100000:10000000:2.0:1788797140.698615:0:14292:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_09 under 711: rc = 0 00100000:10000000:2.0:1788797140.698978:0:14292:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_03 under 711: rc = 0 00100000:10000000:2.0:1788797140.700675:0:14292:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_01 under 711: rc = 0 00100000:10000000:2.0:1788797140.701775:0:14292:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_01 under 711: rc = 0 00100000:10000000:2.0:1788797140.702637:0:14292:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_12 under 711: rc = 0 00100000:10000000:2.0:1788797140.702909:0:14292:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_12 under 711: rc = 0 00100000:10000000:2.0:1788797140.703233:0:14292:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_15 under 711: rc = 0 00100000:10000000:2.0:1788797140.703480:0:14292:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_15 under 711: rc = 0 00100000:10000000:2.0:1788797140.704896:0:14292:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_06 under 711: rc = 0 00100000:10000000:2.0:1788797140.705594:0:14292:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_06 under 711: rc = 0 00100000:10000000:2.0:1788797140.705980:0:14292:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_08 under 711: rc = 0 00100000:10000000:2.0:1788797140.706785:0:14292:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_02 under 711: rc = 0 00100000:10000000:2.0:1788797140.707114:0:14292:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_02 under 711: rc = 0 00100000:10000000:2.0:1788797140.707745:0:14292:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_08 under 711: rc = 0 00100000:10000000:2.0:1788797140.708022:0:14292:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_11 under 711: rc = 0 00100000:10000000:2.0:1788797140.708590:0:14292:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_11 under 711: rc = 0 00100000:10000000:2.0:1788797140.709019:0:14292:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_05 under 711: rc = 0 00100000:10000000:2.0:1788797140.709666:0:14292:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_05 under 711: rc = 0 00100000:10000000:2.0:1788797140.710639:0:14292:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000400:0x1:0x0] under 555: rc = 0 00100000:10000000:2.0:1788797140.712681:0:14292:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1020000:0x0] (8/32) 00100000:10000000:2.0:1788797140.713970:0:14292:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 697: rc = 0 00100000:10000000:2.0:1788797140.714899:0:14292:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x20000:0x0] (8/32) 00100000:10000000:2.0:1788797140.714988:0:14292:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 697: rc = 0 00100000:10000000:2.0:1788797140.717802:0:14292:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2020000:0x0] (8/32) 00100000:10000000:2.0:1788797140.717914:0:14292:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 697: rc = 0 00100000:10000000:2.0:1788797140.718575:0:14292:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x10000:0x0] (8/32) 00100000:10000000:2.0:1788797140.718648:0:14292:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 539: rc = 0 00100000:10000000:2.0:1788797140.718853:0:14292:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1010000:0x0] (8/32) 00100000:10000000:2.0:1788797140.718920:0:14292:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 539: rc = 0 00100000:10000000:2.0:1788797140.719162:0:14292:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2010000:0x0] (8/32) 00100000:10000000:2.0:1788797140.719217:0:14292:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 539: rc = 0 00000020:00000080:2.0:1788797140.720004:0:14292:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1788797140.720014:0:14292:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788797140.720113:0:14292:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xca7fc0c411f94508 00000020:01000004:2.0:1788797140.720123:0:14292:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:2.0:1788797140.720129:0:14292:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1788797140.720134:0:14292:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8cb07906b800 from MGS 00000020:01000004:2.0:1788797140.720148:0:14292:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1788797140.720159:0:14292:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff8cb06f093380) 00000020:00000080:2.0:1788797140.720171:0:14292:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1788797140.720291:0:14292:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8cb07906b800 from MGS, refs=2 00080000:01000000:2.0:1788797140.720296:0:14292:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788797140.720301:0:14292:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xca7fc0c411f94516 00000100:00100000:2.0:1788797140.720544:0:14292:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1788797140.720679:0:14292:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1788797140.720685:0:14292:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:0.0:1788797140.727328:0:14292:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:0.0:1788797140.727342:0:14292:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:0.0:1788797140.728334:0:14292:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788797140.728858:0:14292:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:0.0:1788797140.728865:0:14292:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:2.0:1788797140.730385:0:14292:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:2.0:1788797140.730411:0:14292:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:0.0:1788797140.731711:0:14292:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:0.0:1788797140.731723:0:14292:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:2.0:1788797140.737153:0:14298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788797140.737158:0:14298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788797140.737161:0:14298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788797140.737727:0:14299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788797140.737730:0:14299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788797140.737732:0:14299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788797140.743212:0:14292:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:2.0:1788797140.748189:0:14298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:1.0:1788797140.772151:0:14292:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:1.0:1788797140.772173:0:14292:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1788797140.772176:0:14292:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:3.0:1788797140.776513:0:14301:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:2.0:1788797140.776898:0:14292:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:2.0:1788797140.777047:0:14292:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1788797140.781532:0:14292:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1788797140.781940:0:14292:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788797140.782225:0:14292:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1788797140.782233:0:14292:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:0.0:1788797140.784049:0:14292:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:0.0:1788797140.784062:0:14292:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:0.0:1788797140.785132:0:14292:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:0.0:1788797140.785143:0:14292:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:0.0:1788797140.785845:0:14292:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:0.0:1788797140.785868:0:14292:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.204.138@tcp' 00000020:01000004:0.0:1788797140.785870:0:14292:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:0.0:1788797140.785902:0:14292:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.204.138@tcp (typ=mgc) 00000020:00000080:0.0:1788797140.785914:0:14292:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.204.138@tcp (ffff8cb0812d19c0) 00000020:00000080:0.0:1788797140.785933:0:14292:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:0.0:1788797140.786014:0:14292:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8cb061e44000@MGC192.168.204.138@tcp: add connection 192.168.204.138@tcp at head 00010000:00010000:0.0:1788797140.786248:0:14292:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.204.138@tcp-0 is initialized 00000040:01000000:0.0:1788797140.786255:0:14292:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.138@tcp ctxt 1 is initialized 00000100:00080000:1.0:1788797140.787196:0:14306:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:3.0:1788797140.793347:0:14307:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:1.0:1788797140.793478:0:14292:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.204.138@tcp (uuid 73f6407e-c8af-46fc-9cc4-279490305b80) 00000020:00000080:1.0:1788797140.793509:0:14292:0:(genops.c:1384:class_connect()) connect: client 73f6407e-c8af-46fc-9cc4-279490305b80, cookie 0xca7fc0c411f94524 00000100:00080000:1.0:1788797140.793523:0:14292:0:(import.c:545:import_select_connection()) MGC192.168.204.138@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788797140.793535:0:14292:0:(import.c:666:import_select_connection()) MGC192.168.204.138@tcp: import ffff8cb061e44000 using connection 192.168.204.138@tcp/0@lo 00000100:00100000:1.0:1788797140.793577:0:14292:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cb0795c4000 x1875689374567936/t0(0) o250->MGC192.168.204.138@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788797140.793681:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb0795c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73f6407e-c8af-46fc-9cc4-279490305b80:3299:1875689374567936:0@lo:250:mount.lustre.0 00000100:00100000:1.0:1788797140.793924:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788797140.794093:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374567936 00000100:00100000:2.0:1788797140.794101:0:14303:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374567936 00000100:00100000:2.0:1788797140.794135:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788797140.794143:0:14303:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb06e471c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3299:x1875689374567936:12345-0@lo:250:mount.lustre.0 00010000:00080000:2.0:1788797140.794166:0:14303:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from 73f6407e-c8af-46fc-9cc4-279490305b80@0@lo t0 exp 0000000000000000 cur 429 last 0 00000020:00000080:2.0:1788797140.794194:0:14303:0:(genops.c:1384:class_connect()) connect: client 73f6407e-c8af-46fc-9cc4-279490305b80, cookie 0xca7fc0c411f9452b 00000100:00080000:1.0:1788797140.794295:0:14292:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 73f6407e-c8af-46fc-9cc4-279490305b80->MGS 00000100:00080000:2.0:1788797140.794408:0:14303:0:(import.c:65:import_set_state_nolock()) ffff8cb05ca55800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788797140.794469:0:14303:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb06e471c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73f6407e-c8af-46fc-9cc4-279490305b80+5:3299:x1875689374567936:12345-0@lo:250:mount.lustre.0 Request processed in 325us (545us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797140.794478:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788797140.794526:0:3299:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.204.138@tcp: committing for last_committed 0 gen 1 00000100:00080000:2.0:1788797140.794535:0:3299:0:(import.c:1177:ptlrpc_connect_interpret()) MGC192.168.204.138@tcp: connect to target with instance 0 00000100:00080000:2.0:1788797140.794544:0:3299:0:(import.c:1001:ptlrpc_connect_set_flags()) MGC192.168.204.138@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:2.0:1788797140.794547:0:3299:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:2.0:1788797140.794558:0:3299:0:(import.c:65:import_set_state_nolock()) ffff8cb061e44000 MGS: changing import state from CONNECTING to FULL 10000000:01000000:2.0:1788797140.794561:0:3299:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000020:01000004:1.0:1788797140.794602:0:14292:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-MDT0000 00000100:00080000:2.0:1788797140.794620:0:3299:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:2.0:1788797140.794626:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb0795c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73f6407e-c8af-46fc-9cc4-279490305b80:3299:1875689374567936:0@lo:250:mount.lustre.0 00000020:01000004:1.0:1788797140.794628:0:14292:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:1.0:1788797140.794643:0:14292:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff8cb049933380) 00000020:00000080:1.0:1788797140.794654:0:14292:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:1.0:1788797140.811835:0:14292:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788797140.812408:0:14292:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:1.0:1788797140.812416:0:14292:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:1.0:1788797140.813188:0:14292:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:1.0:1788797140.813197:0:14292:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:0.0:1788797140.814511:0:14292:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:0.0:1788797140.814524:0:14292:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:1.0:1788797140.815354:0:14292:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788797140.815532:0:14292:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:1.0:1788797140.815537:0:14292:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:1.0:1788797140.815970:0:14292:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:1.0:1788797140.815978:0:14292:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:0.0:1788797140.852000:0:14292:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788797140.852392:0:14292:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:0.0:1788797140.852400:0:14292:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:1.0:1788797140.853636:0:14292:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:1.0:1788797140.853647:0:14292:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:1.0:1788797140.854451:0:14292:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788797140.854625:0:14292:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:1.0:1788797140.854631:0:14292:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:1.0:1788797140.855157:0:14292:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:1.0:1788797140.855164:0:14292:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:1.0:1788797140.856242:0:14292:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788797140.856504:0:14292:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:1.0:1788797140.856510:0:14292:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:1.0:1788797140.856986:0:14292:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:1.0:1788797140.856993:0:14292:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:1.0:1788797140.857789:0:14292:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788797140.857954:0:14292:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:1.0:1788797140.857960:0:14292:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:1.0:1788797140.858880:0:14292:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:1.0:1788797140.858889:0:14292:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:3.0:1788797140.891695:0:14292:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788797140.891939:0:14292:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1788797140.891946:0:14292:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:1.0:1788797140.897276:0:14292:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1788797140.897308:0:14292:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:1.0:1788797140.899382:0:14292:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1788797140.899400:0:14292:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:3.0:1788797140.912350:0:14292:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:3.0:1788797140.912416:0:14292:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:3.0:1788797140.912425:0:14292:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.138@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:3.0:1788797140.915143:0:14292:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.138@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788797140.915205:0:14292:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.204.138@tcp, index=0000, flags=0x20005 00000020:01000004:3.0:1788797140.915210:0:14292:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788797140.915213:0:14292:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788797140.915214:0:14292:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788797140.915216:0:14292:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788797140.915217:0:14292:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788797140.915218:0:14292:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788797140.915220:0:14292:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788797140.915221:0:14292:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788797140.915227:0:14292:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788797140.915228:0:14292:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788797140.915232:0:14292:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:3.0:1788797140.915234:0:14292:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788797140.915235:0:14292:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788797140.915236:0:14292:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788797140.915237:0:14292:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788797140.915238:0:14292:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788797140.915239:0:14292:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788797140.915240:0:14292:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788797140.915241:0:14292:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788797140.915242:0:14292:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788797140.915243:0:14292:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788797140.915275:0:14292:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1788797140.915301:0:14292:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb0778dd880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73f6407e-c8af-46fc-9cc4-279490305b80:14292:1875689374568064:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788797140.915399:0:14292:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788797140.915471:0:14292:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb042e41cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788797140.915543:0:14305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374568064 00000100:00100000:0.0:1788797140.915554:0:14305:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374568064 00000100:00100000:0.0:1788797140.915613:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788797140.915624:0:14305:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb06e473850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73f6407e-c8af-46fc-9cc4-279490305b80+5:14292:x1875689374568064:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788797140.915680:0:14305:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1788797140.915685:0:14305:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1788797140.915688:0:14305:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:1.0:1788797140.917000:0:14325:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:0.0:1788797140.917507:0:14305:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 5 20000000:01000000:1.0:1788797140.927873:0:14326:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:1.0:1788797140.927883:0:14326:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:1.0:1788797140.927887:0:14326:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:1.0:1788797140.927934:0:14326:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 20000000:01000000:0.0:1788797140.928309:0:14305:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1788797140.928321:0:14305:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:0.0:1788797140.939047:0:14305:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb06e473850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73f6407e-c8af-46fc-9cc4-279490305b80+5:14292:x1875689374568064:12345-0@lo:253:mount.lustre.0 Request processed in 23395us (23618us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797140.939064:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788797140.939221:0:14292:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb0778dd880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73f6407e-c8af-46fc-9cc4-279490305b80:14292:1875689374568064:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788797140.939247:0:14292:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1788797140.939250:0:14292:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788797140.939252:0:14292:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788797140.939254:0:14292:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788797140.939255:0:14292:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788797140.939257:0:14292:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788797140.939258:0:14292:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788797140.939260:0:14292:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788797140.939261:0:14292:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788797140.939262:0:14292:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788797140.939263:0:14292:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788797140.939281:0:14292:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8cb07906b800 from lustre-MDT0000 10000000:01000000:3.0:1788797140.939316:0:14292:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:3.0:1788797140.939318:0:14292:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1788797140.939323:0:14292:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff8cb0812d19c0 10000000:01000000:3.0:1788797140.939326:0:14292:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788797140.939334:0:14292:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8cb0812d19c0 from 1 10000000:01000000:3.0:1788797140.939337:0:14292:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1788797140.939376:0:14292:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.138@tcp lock: ffff8cb077c68a00/0xca7fc0c411f94539 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797140.939395:0:14292:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.138@tcp lock: ffff8cb077c68a00/0xca7fc0c411f94539 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797140.939406:0:14292:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.138@tcp lock: ffff8cb077c68a00/0xca7fc0c411f94539 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788797140.939425:0:14292:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb0778dd880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73f6407e-c8af-46fc-9cc4-279490305b80:14292:1875689374568192:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788797140.939456:0:14292:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788797140.939498:0:14292:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb042e41900 going to sleep for 11 seconds 00000100:00100000:2.0:1788797140.940069:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374568192 00000100:00100000:2.0:1788797140.940086:0:14303:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374568192 00000100:00100000:2.0:1788797140.940131:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788797140.940141:0:14303:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb06e471050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73f6407e-c8af-46fc-9cc4-279490305b80+5:14292:x1875689374568192:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788797140.940156:0:14303:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788797140.940173:0:14303:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cb040030c00/0xca7fc0c411f94540 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xca7fc0c411f94539 expref: -99 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797140.940200:0:14303:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cb040030c00/0xca7fc0c411f94540 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xca7fc0c411f94539 expref: 6 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797140.940211:0:14303:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cb040030c00/0xca7fc0c411f94540 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xca7fc0c411f94539 expref: 6 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797140.940220:0:14303:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb040030c00, rc 0) 00000100:00100000:2.0:1788797140.940282:0:14303:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb06e471050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73f6407e-c8af-46fc-9cc4-279490305b80+6:14292:x1875689374568192:12345-0@lo:101:mount.lustre.0 Request processed in 143us (825us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797140.940289:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788797140.940759:0:14292:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb0778dd880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73f6407e-c8af-46fc-9cc4-279490305b80:14292:1875689374568192:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788797140.940776:0:14292:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.138@tcp lock: ffff8cb077c68a00/0xca7fc0c411f94539 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xca7fc0c411f94540 expref: -99 pid: 14292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797140.940787:0:14292:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.138@tcp lock: ffff8cb077c68a00/0xca7fc0c411f94539 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xca7fc0c411f94540 expref: -99 pid: 14292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788797140.940855:0:14292:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb0778dd880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73f6407e-c8af-46fc-9cc4-279490305b80:14292:1875689374568320:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788797140.940885:0:14292:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788797140.940920:0:14292:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb042e41900 going to sleep for 11 seconds 00000100:00100000:0.0:1788797140.941650:0:14305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374568320 00000100:00100000:0.0:1788797140.941659:0:14305:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374568320 00000100:00100000:0.0:1788797140.941709:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788797140.941718:0:14305:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb06e471850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73f6407e-c8af-46fc-9cc4-279490305b80+6:14292:x1875689374568320:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788797140.941999:0:14305:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb06e471850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73f6407e-c8af-46fc-9cc4-279490305b80+6:14292:x1875689374568320:12345-0@lo:501:mount.lustre.0 Request processed in 281us (1112us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788797140.942009:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788797140.942247:0:14292:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb0778dd880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73f6407e-c8af-46fc-9cc4-279490305b80:14292:1875689374568320:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1788797140.942290:0:14292:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.138@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1788797140.942312:0:14292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.138@tcp lock: ffff8cb077c68a00/0xca7fc0c411f94539 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xca7fc0c411f94540 expref: -99 pid: 14292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797140.942322:0:14292:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.138@tcp lock: ffff8cb077c68a00/0xca7fc0c411f94539 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xca7fc0c411f94540 expref: -99 pid: 14292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788797140.942339:0:14292:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8cb07906b800 10000000:01000000:3.0:1788797140.942344:0:14292:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788797140.942348:0:14292:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8cb07906b800 10000000:01000000:3.0:1788797140.942350:0:14292:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1788797140.942353:0:14292:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8cb07906b800 from 1 10000000:01000000:3.0:1788797140.942356:0:14292:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1788797140.942380:0:14292:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.138@tcp lock: ffff8cb077c68c00/0xca7fc0c411f94547 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797140.942398:0:14292:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.138@tcp lock: ffff8cb077c68c00/0xca7fc0c411f94547 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797140.942408:0:14292:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.138@tcp lock: ffff8cb077c68c00/0xca7fc0c411f94547 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788797140.942426:0:14292:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb0778dd880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73f6407e-c8af-46fc-9cc4-279490305b80:14292:1875689374568448:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788797140.942457:0:14292:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788797140.942671:0:14292:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb042e41900 going to sleep for 11 seconds 00000100:00100000:2.0:1788797140.943082:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374568448 00000100:00100000:2.0:1788797140.943089:0:14303:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374568448 00000100:00100000:2.0:1788797140.943132:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788797140.943140:0:14303:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb06e473c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73f6407e-c8af-46fc-9cc4-279490305b80+6:14292:x1875689374568448:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788797140.943150:0:14303:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788797140.943164:0:14303:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cb040030800/0xca7fc0c411f9454e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xca7fc0c411f94547 expref: -99 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797140.943199:0:14303:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cb040030800/0xca7fc0c411f9454e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xca7fc0c411f94547 expref: 7 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797140.943209:0:14303:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cb040030800/0xca7fc0c411f9454e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xca7fc0c411f94547 expref: 7 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797140.943228:0:14303:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb040030800, rc 0) 00000100:00100000:2.0:1788797140.943274:0:14303:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb06e473c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73f6407e-c8af-46fc-9cc4-279490305b80+7:14292:x1875689374568448:12345-0@lo:101:mount.lustre.0 Request processed in 135us (817us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797140.943281:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788797140.943540:0:14292:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb0778dd880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73f6407e-c8af-46fc-9cc4-279490305b80:14292:1875689374568448:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788797140.943555:0:14292:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.138@tcp lock: ffff8cb077c68c00/0xca7fc0c411f94547 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xca7fc0c411f9454e expref: -99 pid: 14292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797140.943562:0:14292:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.138@tcp lock: ffff8cb077c68c00/0xca7fc0c411f94547 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xca7fc0c411f9454e expref: -99 pid: 14292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788797140.943575:0:14292:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.138@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1788797140.943592:0:14292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.138@tcp lock: ffff8cb077c68c00/0xca7fc0c411f94547 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xca7fc0c411f9454e expref: -99 pid: 14292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797140.943605:0:14292:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.138@tcp lock: ffff8cb077c68c00/0xca7fc0c411f94547 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xca7fc0c411f9454e expref: -99 pid: 14292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788797140.943612:0:14292:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1788797140.943616:0:14292:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788797140.943620:0:14292:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8cb07906b800 10000000:01000000:3.0:1788797140.943622:0:14292:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1788797140.943626:0:14292:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:3.0:1788797140.943628:0:14292:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1788797140.943647:0:14292:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.138@tcp lock: ffff8cb077c69200/0xca7fc0c411f94555 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797140.943654:0:14292:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.138@tcp lock: ffff8cb077c69200/0xca7fc0c411f94555 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797140.943661:0:14292:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.138@tcp lock: ffff8cb077c69200/0xca7fc0c411f94555 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788797140.943677:0:14292:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb0778dd880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73f6407e-c8af-46fc-9cc4-279490305b80:14292:1875689374568576:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788797140.943709:0:14292:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788797140.943741:0:14292:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb042e41900 going to sleep for 11 seconds 00000100:00100000:0.0:1788797140.943871:0:14305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374568576 00000100:00100000:0.0:1788797140.943876:0:14305:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374568576 00000100:00100000:0.0:1788797140.943911:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788797140.943919:0:14305:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb06e471450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73f6407e-c8af-46fc-9cc4-279490305b80+7:14292:x1875689374568576:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788797140.943926:0:14305:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788797140.943936:0:14305:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cb042ea3600/0xca7fc0c411f9455c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xca7fc0c411f94555 expref: -99 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797140.943962:0:14305:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cb042ea3600/0xca7fc0c411f9455c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xca7fc0c411f94555 expref: 8 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797140.943972:0:14305:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cb042ea3600/0xca7fc0c411f9455c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xca7fc0c411f94555 expref: 8 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797140.943979:0:14305:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb042ea3600, rc 0) 00000100:00100000:0.0:1788797140.944018:0:14305:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb06e471450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73f6407e-c8af-46fc-9cc4-279490305b80+8:14292:x1875689374568576:12345-0@lo:101:mount.lustre.0 Request processed in 100us (309us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797140.944024:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788797140.944319:0:14292:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb0778dd880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73f6407e-c8af-46fc-9cc4-279490305b80:14292:1875689374568576:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788797140.944331:0:14292:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.138@tcp lock: ffff8cb077c69200/0xca7fc0c411f94555 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xca7fc0c411f9455c expref: -99 pid: 14292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797140.944339:0:14292:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.138@tcp lock: ffff8cb077c69200/0xca7fc0c411f94555 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xca7fc0c411f9455c expref: -99 pid: 14292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788797140.944461:0:14292:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb0778dd880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73f6407e-c8af-46fc-9cc4-279490305b80:14292:1875689374568704:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788797140.944556:0:14292:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788797140.944589:0:14292:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb042e41900 going to sleep for 11 seconds 00000100:00100000:1.0:1788797140.944699:0:14304:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374568704 00000100:00100000:1.0:1788797140.944705:0:14304:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374568704 00000100:00100000:1.0:1788797140.955312:0:14304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788797140.955328:0:14304:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb077bed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73f6407e-c8af-46fc-9cc4-279490305b80+8:14292:x1875689374568704:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788797140.958371:0:14304:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb077bed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73f6407e-c8af-46fc-9cc4-279490305b80+9:14292:x1875689374568704:12345-0@lo:501:mount.lustre.0 Request processed in 3035us (13802us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797140.958389:0:14304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788797140.958445:0:14292:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb0778dd880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73f6407e-c8af-46fc-9cc4-279490305b80:14292:1875689374568704:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788797140.958524:0:14292:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb0778dd880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73f6407e-c8af-46fc-9cc4-279490305b80:14292:1875689374568832:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788797140.958571:0:14292:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788797140.958612:0:14292:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb042e41900 going to sleep for 11 seconds 00000100:00100000:2.0:1788797140.958794:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374568832 00000100:00100000:2.0:1788797140.958802:0:14303:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374568832 00000100:00100000:2.0:1788797140.958835:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788797140.958843:0:14303:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb077becc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73f6407e-c8af-46fc-9cc4-279490305b80+9:14292:x1875689374568832:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788797140.959222:0:14303:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb077becc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73f6407e-c8af-46fc-9cc4-279490305b80+9:14292:x1875689374568832:12345-0@lo:503:mount.lustre.0 Request processed in 379us (651us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797140.959230:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788797140.959874:0:14292:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb0778dd880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73f6407e-c8af-46fc-9cc4-279490305b80:14292:1875689374568832:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788797140.962653:0:14327:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb06f57fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:73f6407e-c8af-46fc-9cc4-279490305b80:14327:1875689374568960:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788797140.962734:0:14327:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788797140.962784:0:14327:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb0502f5900 going to sleep for 11 seconds 00000100:00100000:1.0:1788797140.963357:0:14304:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374568960 00000100:00100000:1.0:1788797140.963367:0:14304:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374568960 00000100:00100000:2.0:1788797140.963782:0:14304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788797140.963794:0:14304:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb077bef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73f6407e-c8af-46fc-9cc4-279490305b80+9:14327:x1875689374568960:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788797140.964247:0:14304:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb077bef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73f6407e-c8af-46fc-9cc4-279490305b80+9:14327:x1875689374568960:12345-0@lo:502:llog_process_th.0 Request processed in 448us (1504us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797140.964256:0:14304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788797140.964342:0:14327:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb06f57fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:73f6407e-c8af-46fc-9cc4-279490305b80:14327:1875689374568960:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788797140.964390:0:14327:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788797140.964403:0:14327:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788797140.964405:0:14327:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1788797140.964414:0:14327:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:1.0:1788797140.964417:0:14327:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788797140.964433:0:14327:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff8cb049930000) 00000020:00000080:1.0:1788797140.964450:0:14327:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:1.0:1788797140.964456:0:14327:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1788797140.964552:0:14327:0:(osd_handler.c:1574:osd_obd_connect()) connect #2 00000020:00000080:1.0:1788797140.964559:0:14327:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xca7fc0c411f9456a 00000020:00000080:1.0:1788797140.964759:0:14327:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1788797140.964763:0:14327:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788797140.964773:0:14327:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788797140.964775:0:14327:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1788797140.964779:0:14327:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788797140.964782:0:14327:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788797140.964784:0:14327:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:1.0:1788797140.964787:0:14327:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788797140.964794:0:14327:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff8cb0499319c0) 00000020:00000080:1.0:1788797140.964804:0:14327:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:1.0:1788797140.964807:0:14327:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1788797140.964809:0:14327:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:1.0:1788797140.964812:0:14327:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:1.0:1788797140.964818:0:14327:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788797140.964855:0:14327:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8cb07906b800 from lustre-MDT0000, refs=3 00000020:00000080:1.0:1788797140.964867:0:14327:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff8cb049934d40) 00000020:00000080:1.0:1788797140.964874:0:14327:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:1.0:1788797140.964917:0:14327:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1788797140.964925:0:14327:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xca7fc0c411f9457f 00000020:00000080:1.0:1788797140.965018:0:14327:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:1.0:1788797140.965023:0:14327:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1788797140.965052:0:14327:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xca7fc0c411f94586 00080000:01000000:1.0:1788797140.965059:0:14327:0:(osd_handler.c:1574:osd_obd_connect()) connect #3 00000020:00000080:1.0:1788797140.965063:0:14327:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xca7fc0c411f9458d 00010000:00010000:0.0:1788797141.088802:0:14327:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:0.0:1788797141.089653:0:14327:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967526 00000001:00080000:0.0:1788797141.089873:0:14327:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:0.0:1788797141.091112:0:14327:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff8cb0812d3380) 00000020:00000080:0.0:1788797141.091137:0:14327:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:0.0:1788797141.091225:0:14327:0:(osd_handler.c:1574:osd_obd_connect()) connect #4 00000020:00000080:0.0:1788797141.091234:0:14327:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xca7fc0c411f9459b 00000020:00000080:1.0:1788797141.091968:0:14327:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:1.0:1788797141.100461:0:14327:0:(genops.c:1384:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xca7fc0c411f945a2 00000020:00000080:2.0:1788797141.101669:0:14327:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:2.0:1788797141.101681:0:14327:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788797141.101687:0:14327:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788797141.101689:0:14327:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:2.0:1788797141.101699:0:14327:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788797141.101702:0:14327:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #8 00000020:01000000:2.0:1788797141.101704:0:14327:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788797141.101705:0:14327:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788797141.101707:0:14327:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788797141.101709:0:14327:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788797141.101710:0:14327:0:(obd_config.c:1563:class_process_config()) marker 8 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788797141.101713:0:14327:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788797141.101717:0:14327:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788797141.101718:0:14327:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:2.0:1788797141.101722:0:14327:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1788797141.101761:0:14327:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:2.0:1788797141.101773:0:14327:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788797141.101775:0:14327:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788797141.101776:0:14327:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:2.0:1788797141.101779:0:14327:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788797141.101782:0:14327:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:2.0:1788797141.101784:0:14327:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788797141.101786:0:14327:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1788797141.101789:0:14327:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788797141.101794:0:14327:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.138@tcp to nid 0x20000c0a8cc8a (192.168.204.138@tcp) 00000020:01000000:2.0:1788797141.101831:0:14327:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1788797141.101835:0:14327:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788797141.101849:0:14327:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff8cb06f090000) 00000020:00000080:2.0:1788797141.101863:0:14327:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:2.0:1788797141.101867:0:14327:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788797141.101914:0:14327:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:2.0:1788797141.101919:0:14327:0:(osd_handler.c:1574:osd_obd_connect()) connect #5 00000020:00000080:2.0:1788797141.101924:0:14327:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xca7fc0c411f945b0 00010000:00080000:2.0:1788797141.101957:0:14327:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8cb0779d6000@lustre-OST0000-osc-MDT0000: add connection 192.168.204.138@tcp at head 00010000:00010000:2.0:1788797141.102201:0:14327:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-1 is initialized 00000040:01000000:2.0:1788797141.102777:0:14327:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1788797141.102826:0:14327:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1788797141.110469:0:14327:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788797141.112243:0:14327:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:2.0:1788797141.112351:0:14327:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:2.0:1788797141.113864:0:14330:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1788797141.113871:0:14330:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1788797141.114784:0:14327:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788797141.114797:0:14327:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1788797141.114831:0:14327:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1788797141.114849:0:14327:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xca7fc0c411f945b7 00000100:00080000:2.0:1788797141.114859:0:14327:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788797141.114872:0:14327:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8cb0779d6000 using connection 192.168.204.138@tcp/0@lo 00000100:00100000:2.0:1788797141.114910:0:14327:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cb0795d9f80 x1875689374569088/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788797141.114939:0:14327:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00100000:3.0:1788797141.115003:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb0795d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3299:1875689374569088:0@lo:8:llog_process_th.0 00000400:00000100:3.0:1788797141.115101:0:3299:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875689374569088 offset 0 length 520: 4 00000020:01000000:2.0:1788797141.119307:0:14327:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788797141.119318:0:14327:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788797141.119320:0:14327:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1788797141.119324:0:14327:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788797141.119327:0:14327:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:2.0:1788797141.119328:0:14327:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788797141.119330:0:14327:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788797141.119331:0:14327:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788797141.119333:0:14327:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788797141.119335:0:14327:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788797141.119337:0:14327:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788797141.119342:0:14327:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:2.0:1788797141.119345:0:14327:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788797141.119347:0:14327:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1788797141.119350:0:14327:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788797141.119354:0:14327:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.138@tcp to nid 0x20000c0a8cc8a (192.168.204.138@tcp) 00000020:01000000:2.0:1788797141.119589:0:14327:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1788797141.119608:0:14327:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788797141.119633:0:14327:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff8cb06f0919c0) 00000020:00000080:2.0:1788797141.119662:0:14327:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:2.0:1788797141.119668:0:14327:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788797141.119771:0:14327:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:2.0:1788797141.119778:0:14327:0:(osd_handler.c:1574:osd_obd_connect()) connect #6 00000020:00000080:2.0:1788797141.119784:0:14327:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xca7fc0c411f945c5 00010000:00080000:2.0:1788797141.119819:0:14327:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8cb05ca5a000@lustre-OST0001-osc-MDT0000: add connection 192.168.204.138@tcp at head 00010000:00010000:2.0:1788797141.120149:0:14327:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-2 is initialized 00000040:01000000:2.0:1788797141.123348:0:14327:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1788797141.123375:0:14327:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000100:00100000:0.0:1788797141.125363:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb0795c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:73f6407e-c8af-46fc-9cc4-279490305b80:3303:1875689374569216:0@lo:400:kworker.0 00000100:00100000:0.0:1788797141.125453:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788797141.125743:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374569216 00000100:00100000:1.0:1788797141.125753:0:14303:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374569216 00000100:00100000:1.0:1788797141.125805:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788797141.125815:0:14303:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb077beec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73f6407e-c8af-46fc-9cc4-279490305b80+9:3303:x1875689374569216:12345-0@lo:400:kworker.0 00000040:00080000:2.0:1788797141.126056:0:14327:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788797141.126173:0:14327:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:2.0:1788797141.126258:0:14327:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:2.0:1788797141.128689:0:14333:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1788797141.128696:0:14333:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000100:00100000:1.0:1788797141.130080:0:14303:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb077beec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73f6407e-c8af-46fc-9cc4-279490305b80+9:3303:x1875689374569216:12345-0@lo:400:kworker.0 Request processed in 4091us (4450us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797141.130101:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788797141.130193:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb0795c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:73f6407e-c8af-46fc-9cc4-279490305b80:3303:1875689374569216:0@lo:400:kworker.0 00000020:00000080:2.0:1788797141.131772:0:14327:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788797141.131793:0:14327:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1788797141.131839:0:14327:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1788797141.131860:0:14327:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xca7fc0c411f945cc 00000100:00080000:2.0:1788797141.131871:0:14327:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788797141.131882:0:14327:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8cb05ca5a000 using connection 192.168.204.138@tcp/0@lo 00000100:00100000:2.0:1788797141.131929:0:14327:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cb0795d9500 x1875689374569344/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788797141.132080:0:14327:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:2.0:1788797141.132186:0:14327:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788797141.132191:0:14327:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788797141.132193:0:14327:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1788797141.132196:0:14327:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788797141.132199:0:14327:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788797141.132223:0:14327:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788797141.132229:0:14327:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788797141.132231:0:14327:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1788797141.132233:0:14327:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788797141.132235:0:14327:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788797141.132236:0:14327:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000020:01000000:2.0:1788797141.132238:0:14327:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788797141.132241:0:14327:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788797141.132242:0:14327:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1788797141.132245:0:14327:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1788797141.132278:0:14327:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb0795daa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:73f6407e-c8af-46fc-9cc4-279490305b80:14327:1875689374569472:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788797141.132371:0:14327:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788797141.132416:0:14304:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374569472 00000100:00100000:2.0:1788797141.132423:0:14304:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374569472 00000100:00100000:2.0:1788797141.132460:0:14304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788797141.132469:0:14304:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb077bed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73f6407e-c8af-46fc-9cc4-279490305b80+9:14327:x1875689374569472:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788797141.132736:0:14304:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb077bed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73f6407e-c8af-46fc-9cc4-279490305b80+9:14327:x1875689374569472:12345-0@lo:502:llog_process_th.0 Request processed in 267us (365us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797141.132744:0:14304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788797141.132801:0:14327:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb043604180 going to sleep for 11 seconds 00000100:00100000:2.0:1788797141.132836:0:14327:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb0795daa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:73f6407e-c8af-46fc-9cc4-279490305b80:14327:1875689374569472:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788797141.132863:0:14327:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788797141.132867:0:14327:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788797141.132868:0:14327:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788797141.132872:0:14327:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000100:00100000:3.0:1788797141.133161:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb0795d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3299:1875689374569344:0@lo:8:llog_process_th.0 00000400:00000100:3.0:1788797141.133196:0:3299:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875689374569344 offset 0 length 520: 4 00000020:01000000:3.0:1788797141.133275:0:14292:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-36 (rc=0) 10000000:01000000:3.0:1788797141.133298:0:14292:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.138@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1788797141.133324:0:14292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.138@tcp lock: ffff8cb077c69200/0xca7fc0c411f94555 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xca7fc0c411f9455c expref: -99 pid: 14292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797141.133336:0:14292:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.138@tcp lock: ffff8cb077c69200/0xca7fc0c411f94555 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xca7fc0c411f9455c expref: -99 pid: 14292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788797141.133346:0:14292:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8cb07906b800 from 1 10000000:01000000:3.0:1788797141.133349:0:14292:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788797141.133401:0:14292:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.138@tcp lock: ffff8cb077c69800/0xca7fc0c411f945d3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797141.133420:0:14292:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.138@tcp lock: ffff8cb077c69800/0xca7fc0c411f945d3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797141.133432:0:14292:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.138@tcp lock: ffff8cb077c69800/0xca7fc0c411f945d3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788797141.133454:0:14292:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb0778dd880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73f6407e-c8af-46fc-9cc4-279490305b80:14292:1875689374569600:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788797141.133496:0:14292:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788797141.133519:0:14292:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb042e41180 going to sleep for 11 seconds 00000100:00100000:2.0:1788797141.133945:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374569600 00000100:00100000:2.0:1788797141.133954:0:14303:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374569600 00000100:00100000:2.0:1788797141.134061:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788797141.134084:0:14303:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb077bec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73f6407e-c8af-46fc-9cc4-279490305b80+9:14292:x1875689374569600:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788797141.134106:0:14303:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788797141.134119:0:14303:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cb040030200/0xca7fc0c411f945da lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xca7fc0c411f945d3 expref: -99 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797141.134144:0:14303:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cb040030200/0xca7fc0c411f945da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xca7fc0c411f945d3 expref: 10 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797141.134155:0:14303:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cb040030200/0xca7fc0c411f945da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xca7fc0c411f945d3 expref: 10 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797141.134164:0:14303:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb040030200, rc 0) 00000100:00100000:2.0:1788797141.134221:0:14303:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb077bec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73f6407e-c8af-46fc-9cc4-279490305b80+10:14292:x1875689374569600:12345-0@lo:101:mount.lustre.0 Request processed in 144us (717us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797141.134228:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788797141.134742:0:14292:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb0778dd880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73f6407e-c8af-46fc-9cc4-279490305b80:14292:1875689374569600:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788797141.134761:0:14292:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.138@tcp lock: ffff8cb077c69800/0xca7fc0c411f945d3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xca7fc0c411f945da expref: -99 pid: 14292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797141.134772:0:14292:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.138@tcp lock: ffff8cb077c69800/0xca7fc0c411f945d3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xca7fc0c411f945da expref: -99 pid: 14292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788797141.135463:0:14292:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb0778dd880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73f6407e-c8af-46fc-9cc4-279490305b80:14292:1875689374569728:0@lo:256:mount.lustre.0 00000100:00100000:3.0:1788797141.135602:0:14292:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788797141.135651:0:14292:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb042e41180 going to sleep for 11 seconds 00000100:00100000:0.0:1788797141.136295:0:14305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374569728 00000100:00100000:0.0:1788797141.136304:0:14305:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374569728 00000100:00100000:0.0:1788797141.136355:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788797141.136364:0:14305:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb077befc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73f6407e-c8af-46fc-9cc4-279490305b80+10:14292:x1875689374569728:12345-0@lo:256:mount.lustre.0 20000000:01000000:0.0:1788797141.136770:0:14305:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1788797141.136783:0:14305:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:0.0:1788797141.136900:0:14305:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb077befc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73f6407e-c8af-46fc-9cc4-279490305b80+10:14292:x1875689374569728:12345-0@lo:256:mount.lustre.0 Request processed in 537us (1297us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797141.136909:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788797141.137326:0:14292:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb0778dd880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73f6407e-c8af-46fc-9cc4-279490305b80:14292:1875689374569728:0@lo:256:mount.lustre.0 10000000:01000000:3.0:1788797141.138006:0:14292:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.138@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788797141.138208:0:14292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.138@tcp lock: ffff8cb077c69800/0xca7fc0c411f945d3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xca7fc0c411f945da expref: -99 pid: 14292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797141.138786:0:14292:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.138@tcp lock: ffff8cb077c69800/0xca7fc0c411f945d3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xca7fc0c411f945da expref: -99 pid: 14292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788797141.138815:0:14292:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8cb07906b800 from 1 10000000:01000000:3.0:1788797141.138818:0:14292:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788797141.138857:0:14292:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.138@tcp lock: ffff8cb077c68600/0xca7fc0c411f945e1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797141.138865:0:14292:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.138@tcp lock: ffff8cb077c68600/0xca7fc0c411f945e1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797141.138876:0:14292:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.138@tcp lock: ffff8cb077c68600/0xca7fc0c411f945e1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788797141.138899:0:14292:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb0778dd880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73f6407e-c8af-46fc-9cc4-279490305b80:14292:1875689374569856:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788797141.138954:0:14292:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788797141.139058:0:14292:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb042e41180 going to sleep for 11 seconds 00000100:00100000:0.0:1788797141.139886:0:14305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374569856 00000100:00100000:0.0:1788797141.139896:0:14305:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374569856 00000100:00100000:0.0:1788797141.139951:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788797141.139960:0:14305:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb077bec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73f6407e-c8af-46fc-9cc4-279490305b80+10:14292:x1875689374569856:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788797141.139973:0:14305:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788797141.139989:0:14305:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cb042ea3800/0xca7fc0c411f945e8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xca7fc0c411f945e1 expref: -99 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797141.140012:0:14305:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cb042ea3800/0xca7fc0c411f945e8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xca7fc0c411f945e1 expref: 11 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797141.140110:0:14305:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cb042ea3800/0xca7fc0c411f945e8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xca7fc0c411f945e1 expref: 11 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797141.140120:0:14305:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb042ea3800, rc 0) 00000100:00100000:0.0:1788797141.140183:0:14305:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb077bec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73f6407e-c8af-46fc-9cc4-279490305b80+11:14292:x1875689374569856:12345-0@lo:101:mount.lustre.0 Request processed in 224us (1227us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797141.140190:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788797141.140280:0:14292:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb0778dd880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73f6407e-c8af-46fc-9cc4-279490305b80:14292:1875689374569856:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788797141.140295:0:14292:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.138@tcp lock: ffff8cb077c68600/0xca7fc0c411f945e1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xca7fc0c411f945e8 expref: -99 pid: 14292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797141.140304:0:14292:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.138@tcp lock: ffff8cb077c68600/0xca7fc0c411f945e1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xca7fc0c411f945e8 expref: -99 pid: 14292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788797141.140366:0:14292:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb0778dd880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73f6407e-c8af-46fc-9cc4-279490305b80:14292:1875689374569984:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788797141.140416:0:14292:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788797141.140447:0:14292:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb042e41180 going to sleep for 11 seconds 00000100:00100000:2.0:1788797141.140603:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374569984 00000100:00100000:2.0:1788797141.140609:0:14303:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374569984 00000100:00100000:2.0:1788797141.140643:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788797141.140651:0:14303:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb077bedc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73f6407e-c8af-46fc-9cc4-279490305b80+11:14292:x1875689374569984:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788797141.141341:0:14303:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb077bedc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73f6407e-c8af-46fc-9cc4-279490305b80+11:14292:x1875689374569984:12345-0@lo:501:mount.lustre.0 Request processed in 689us (922us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797141.141350:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788797141.141725:0:14292:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb0778dd880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73f6407e-c8af-46fc-9cc4-279490305b80:14292:1875689374569984:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788797141.141769:0:14292:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb0778dd880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73f6407e-c8af-46fc-9cc4-279490305b80:14292:1875689374570112:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788797141.141821:0:14292:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788797141.141905:0:14292:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb042e41180 going to sleep for 11 seconds 00000100:00100000:0.0:1788797141.141949:0:14305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374570112 00000100:00100000:0.0:1788797141.141957:0:14305:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374570112 00000100:00100000:0.0:1788797141.142184:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788797141.142193:0:14305:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb077bed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73f6407e-c8af-46fc-9cc4-279490305b80+11:14292:x1875689374570112:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788797141.142439:0:14305:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb077bed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73f6407e-c8af-46fc-9cc4-279490305b80+11:14292:x1875689374570112:12345-0@lo:503:mount.lustre.0 Request processed in 247us (617us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797141.142446:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788797141.142755:0:14292:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb0778dd880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73f6407e-c8af-46fc-9cc4-279490305b80:14292:1875689374570112:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788797141.143335:0:14335:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb06f57c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:73f6407e-c8af-46fc-9cc4-279490305b80:14335:1875689374570240:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788797141.143384:0:14335:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788797141.143419:0:14335:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb0484c06c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788797141.143461:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374570240 00000100:00100000:2.0:1788797141.143476:0:14303:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374570240 00000100:00100000:2.0:1788797141.143517:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788797141.143525:0:14303:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb077bef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73f6407e-c8af-46fc-9cc4-279490305b80+11:14335:x1875689374570240:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788797141.143871:0:14303:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb077bef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73f6407e-c8af-46fc-9cc4-279490305b80+11:14335:x1875689374570240:12345-0@lo:502:llog_process_th.0 Request processed in 345us (485us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797141.143890:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788797141.144327:0:14335:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb06f57c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:73f6407e-c8af-46fc-9cc4-279490305b80:14335:1875689374570240:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788797141.144358:0:14335:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788797141.144368:0:14335:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788797141.144370:0:14335:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788797141.144377:0:14335:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8cb07906b800 00000020:00000080:0.0:1788797141.144379:0:14335:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788797141.144387:0:14335:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788797141.144389:0:14335:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788797141.144391:0:14335:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1788797141.144400:0:14335:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788797141.144403:0:14335:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788797141.144404:0:14335:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1788797141.144407:0:14335:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8cb07906b800 00000020:00000080:0.0:1788797141.144409:0:14335:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788797141.144473:0:14335:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788797141.144477:0:14335:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788797141.144478:0:14335:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1788797141.144480:0:14335:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788797141.144483:0:14335:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788797141.144484:0:14335:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788797141.144488:0:14335:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8cb07906b800 00000020:00000080:0.0:1788797141.144489:0:14335:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788797141.144605:0:14335:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb06f57c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:73f6407e-c8af-46fc-9cc4-279490305b80:14335:1875689374570368:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788797141.144650:0:14335:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788797141.144686:0:14335:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb0484c06c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788797141.144742:0:14305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374570368 00000100:00100000:1.0:1788797141.144748:0:14305:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374570368 00000100:00100000:1.0:1788797141.145181:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788797141.145191:0:14305:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb077bee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73f6407e-c8af-46fc-9cc4-279490305b80+11:14335:x1875689374570368:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788797141.145533:0:14305:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb077bee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73f6407e-c8af-46fc-9cc4-279490305b80+11:14335:x1875689374570368:12345-0@lo:502:llog_process_th.0 Request processed in 343us (882us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797141.145543:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788797141.145676:0:14335:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb06f57c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:73f6407e-c8af-46fc-9cc4-279490305b80:14335:1875689374570368:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788797141.145700:0:14335:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788797141.145705:0:14335:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788797141.145707:0:14335:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1788797141.145711:0:14335:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:3.0:1788797141.145952:0:14292:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:3.0:1788797141.145973:0:14292:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.138@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788797141.146051:0:14292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.138@tcp lock: ffff8cb077c68600/0xca7fc0c411f945e1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xca7fc0c411f945e8 expref: -99 pid: 14292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797141.146064:0:14292:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.138@tcp lock: ffff8cb077c68600/0xca7fc0c411f945e1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xca7fc0c411f945e8 expref: -99 pid: 14292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788797141.146121:0:14292:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1788797141.146124:0:14292:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8cb07906b800 10000000:01000000:3.0:1788797141.146127:0:14292:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8cb07906b800 10000000:01000000:3.0:1788797141.146131:0:14292:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788797141.146136:0:14292:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8cb07906b800 from 1 10000000:01000000:3.0:1788797141.146139:0:14292:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788797141.146166:0:14292:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.138@tcp lock: ffff8cb077c69c00/0xca7fc0c411f945ef lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797141.146176:0:14292:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.138@tcp lock: ffff8cb077c69c00/0xca7fc0c411f945ef lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797141.146185:0:14292:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.138@tcp lock: ffff8cb077c69c00/0xca7fc0c411f945ef lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788797141.146201:0:14292:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb0778dd880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73f6407e-c8af-46fc-9cc4-279490305b80:14292:1875689374570496:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788797141.146417:0:14292:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788797141.146457:0:14292:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb042e41180 going to sleep for 11 seconds 00000100:00100000:0.0:1788797141.146522:0:14304:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374570496 00000100:00100000:0.0:1788797141.146529:0:14304:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374570496 00000100:00100000:0.0:1788797141.146570:0:14304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788797141.146578:0:14304:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb077bee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73f6407e-c8af-46fc-9cc4-279490305b80+11:14292:x1875689374570496:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788797141.146591:0:14304:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788797141.146603:0:14304:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cb042ea2c00/0xca7fc0c411f945f6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xca7fc0c411f945ef expref: -99 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797141.146629:0:14304:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cb042ea2c00/0xca7fc0c411f945f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xca7fc0c411f945ef expref: 12 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797141.146646:0:14304:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cb042ea2c00/0xca7fc0c411f945f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xca7fc0c411f945ef expref: 12 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797141.146656:0:14304:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb042ea2c00, rc 0) 00000100:00100000:0.0:1788797141.146694:0:14304:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb077bee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73f6407e-c8af-46fc-9cc4-279490305b80+12:14292:x1875689374570496:12345-0@lo:101:mount.lustre.0 Request processed in 117us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797141.146701:0:14304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788797141.146860:0:14292:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb0778dd880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73f6407e-c8af-46fc-9cc4-279490305b80:14292:1875689374570496:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788797141.146874:0:14292:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.138@tcp lock: ffff8cb077c69c00/0xca7fc0c411f945ef lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xca7fc0c411f945f6 expref: -99 pid: 14292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797141.146884:0:14292:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.138@tcp lock: ffff8cb077c69c00/0xca7fc0c411f945ef lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xca7fc0c411f945f6 expref: -99 pid: 14292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788797141.146933:0:14292:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb0778dd880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73f6407e-c8af-46fc-9cc4-279490305b80:14292:1875689374570624:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788797141.146958:0:14292:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788797141.146973:0:14292:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb042e41180 going to sleep for 11 seconds 00000100:00100000:1.0:1788797141.147113:0:14305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374570624 00000100:00100000:1.0:1788797141.147117:0:14305:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374570624 00000100:00100000:1.0:1788797141.147190:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788797141.147198:0:14305:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb077bee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73f6407e-c8af-46fc-9cc4-279490305b80+12:14292:x1875689374570624:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788797141.147462:0:14305:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb077bee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73f6407e-c8af-46fc-9cc4-279490305b80+12:14292:x1875689374570624:12345-0@lo:501:mount.lustre.0 Request processed in 264us (502us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797141.147469:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788797141.148139:0:14292:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb0778dd880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73f6407e-c8af-46fc-9cc4-279490305b80:14292:1875689374570624:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788797141.148187:0:14292:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb0778dd880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73f6407e-c8af-46fc-9cc4-279490305b80:14292:1875689374570752:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788797141.148600:0:14292:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788797141.148686:0:14292:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb042e41180 going to sleep for 11 seconds 00000100:00100000:1.0:1788797141.148732:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374570752 00000100:00100000:1.0:1788797141.148739:0:14303:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374570752 00000100:00100000:1.0:1788797141.148880:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788797141.148889:0:14303:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb079e28850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73f6407e-c8af-46fc-9cc4-279490305b80+12:14292:x1875689374570752:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788797141.149094:0:14303:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb079e28850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73f6407e-c8af-46fc-9cc4-279490305b80+12:14292:x1875689374570752:12345-0@lo:503:mount.lustre.0 Request processed in 206us (494us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797141.149101:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788797141.149191:0:14292:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb0778dd880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73f6407e-c8af-46fc-9cc4-279490305b80:14292:1875689374570752:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788797141.149648:0:14337:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb0778dd880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:73f6407e-c8af-46fc-9cc4-279490305b80:14337:1875689374570880:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788797141.149688:0:14337:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788797141.149766:0:14337:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb042e413c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788797141.149803:0:14305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374570880 00000100:00100000:1.0:1788797141.149878:0:14305:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374570880 00000100:00100000:1.0:1788797141.149942:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788797141.149950:0:14305:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb079e2bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73f6407e-c8af-46fc-9cc4-279490305b80+12:14337:x1875689374570880:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788797141.150192:0:14305:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb079e2bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73f6407e-c8af-46fc-9cc4-279490305b80+12:14337:x1875689374570880:12345-0@lo:502:llog_process_th.0 Request processed in 242us (502us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797141.150205:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788797141.150404:0:14337:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb0778dd880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:73f6407e-c8af-46fc-9cc4-279490305b80:14337:1875689374570880:0@lo:502:llog_process_th.0 00000020:01000004:3.0:1788797141.150465:0:14337:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:3.0:1788797141.150484:0:14337:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff8cb048f73380) 00000020:00000080:3.0:1788797141.150506:0:14337:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lwp with refcount 2 00000020:01000004:3.0:1788797141.150675:0:14337:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8cb07906b800 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1788797141.150680:0:14337:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8cb07906b800 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1788797141.150683:0:14337:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8cb07906b800 4 00010000:00080000:3.0:1788797141.150725:0:14337:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8cb061de2000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.204.138@tcp at head 00010000:00010000:3.0:1788797141.157722:0:14337:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-3 is initialized 00000020:00000080:3.0:1788797141.161379:0:14337:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:3.0:1788797141.161424:0:14337:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788797141.161439:0:14337:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xca7fc0c411f94604 00000100:00080000:3.0:1788797141.161450:0:14337:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788797141.161461:0:14337:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff8cb061de2000 using connection 192.168.204.138@tcp/0@lo 00000100:00100000:3.0:1788797141.161499:0:14337:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cb0778dd880 x1875689374571008/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788797141.161611:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb0778dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3299:1875689374571008:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788797141.161673:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788797141.161750:0:14309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374571008 00000100:00100000:3.0:1788797141.161757:0:14309:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374571008 00000100:00100000:3.0:1788797141.162328:0:14309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788797141.162337:0:14309:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0778ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3299:x1875689374571008:12345-0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788797141.162394:0:14309:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0778ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3299:x1875689374571008:12345-0@lo:38:llog_process_th.0 Request processed in 57us (720us total) trans 0 rc -11/-11 00000100:00100000:3.0:1788797141.162401:0:14309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788797141.162437:0:3299:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788797141.162445:0:3299:0:(import.c:65:import_set_state_nolock()) ffff8cb061de2000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788797141.162460:0:3299:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1788797141.162464:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb0778dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3299:1875689374571008:0@lo:38:llog_process_th.0 00000100:00080000:3.0:1788797141.162495:0:14337:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1788797141.172458:0:14337:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb0778dd880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:73f6407e-c8af-46fc-9cc4-279490305b80:14337:1875689374571136:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788797141.172621:0:14337:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788797141.172773:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374571136 00000100:00100000:1.0:1788797141.172782:0:14303:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374571136 00000100:00100000:1.0:1788797141.172842:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788797141.172852:0:14303:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb079e2a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73f6407e-c8af-46fc-9cc4-279490305b80+12:14337:x1875689374571136:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788797141.173584:0:14337:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb042e41d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788797141.173870:0:14303:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb079e2a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73f6407e-c8af-46fc-9cc4-279490305b80+12:14337:x1875689374571136:12345-0@lo:502:llog_process_th.0 Request processed in 1018us (1247us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797141.173880:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788797141.173967:0:14337:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb0778dd880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:73f6407e-c8af-46fc-9cc4-279490305b80:14337:1875689374571136:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1788797141.174000:0:14337:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:3.0:1788797141.174484:0:14292:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:3.0:1788797141.174505:0:14292:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.138@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788797141.174625:0:14292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.138@tcp lock: ffff8cb077c69c00/0xca7fc0c411f945ef lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xca7fc0c411f945f6 expref: -99 pid: 14292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797141.174638:0:14292:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.138@tcp lock: ffff8cb077c69c00/0xca7fc0c411f945ef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xca7fc0c411f945f6 expref: -99 pid: 14292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1788797141.174685:0:14292:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1788797141.174699:0:14292:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788797141.174701:0:14292:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788797141.174702:0:14292:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788797141.174703:0:14292:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788797141.174705:0:14292:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788797141.174706:0:14292:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788797141.174708:0:14292:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788797141.174709:0:14292:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788797141.174711:0:14292:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788797141.174715:0:14292:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:3.0:1788797141.174717:0:14292:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788797141.174719:0:14292:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788797141.174720:0:14292:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788797141.174721:0:14292:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788797141.174722:0:14292:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788797141.174723:0:14292:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788797141.174724:0:14292:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788797141.174725:0:14292:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788797141.174726:0:14292:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788797141.174727:0:14292:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788797141.174749:0:14292:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1788797141.174767:0:14292:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb0778dd880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73f6407e-c8af-46fc-9cc4-279490305b80:14292:1875689374571264:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788797141.174828:0:14292:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788797141.174864:0:14292:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb042e41cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788797141.174980:0:14305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374571264 00000100:00100000:1.0:1788797141.174989:0:14305:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374571264 00000100:00100000:1.0:1788797141.175053:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788797141.175065:0:14305:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb079e2b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73f6407e-c8af-46fc-9cc4-279490305b80+12:14292:x1875689374571264:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788797141.175101:0:14305:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1788797141.175114:0:14305:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1788797141.215852:0:14305:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788797141.215873:0:14305:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:2.0:1788797141.215938:0:14325:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788797141.215942:0:14325:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788797141.215964:0:14325:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cb040031400/0xca7fc0c411f9460b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797141.215982:0:14325:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cb040030200/0xca7fc0c411f945da lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xca7fc0c411f945d3 expref: 12 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797141.215990:0:14325:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8cb040031400/0xca7fc0c411f9460b lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797141.216056:0:14325:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cb040030200/0xca7fc0c411f945da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xca7fc0c411f945d3 expref: 12 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797141.216080:0:14325:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8cb040030200/0xca7fc0c411f945da lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xca7fc0c411f945d3 expref: 12 pid: 14303 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788797141.216095:0:14325:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb0795daa00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14325:1875689374571392:0@lo:104: 00000100:00100000:2.0:1788797141.216158:0:14325:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788797141.216207:0:14325:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb04887e240 going to sleep for 11 seconds 00000100:00100000:3.0:1788797141.216332:0:14293:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374571392 00000100:00100000:3.0:1788797141.216340:0:14293:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374571392 00000100:00100000:3.0:1788797141.216395:0:14293:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788797141.216403:0:14293:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0795d8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:73f6407e-c8af-46fc-9cc4-279490305b80+3:14325:x1875689374571392:12345-0@lo:104: 00010000:00010000:3.0:1788797141.216417:0:14293:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.138@tcp lock: ffff8cb077c69800/0xca7fc0c411f945d3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xca7fc0c411f945da expref: -99 pid: 14292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797141.216471:0:14293:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788797141.216477:0:14293:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0795d8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:73f6407e-c8af-46fc-9cc4-279490305b80+3:14325:x1875689374571392:12345-0@lo:104: Request processed in 76us (320us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797141.216483:0:14293:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788797141.216518:0:14325:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb0795daa00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14325:1875689374571392:0@lo:104: 00010000:00010000:3.0:1788797141.216535:0:14325:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8cb040031400/0xca7fc0c411f9460b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797141.216552:0:14299:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788797141.216557:0:14299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.138@tcp lock: ffff8cb077c69800/0xca7fc0c411f945d3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xca7fc0c411f945da expref: -99 pid: 14292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797141.216564:0:14299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb077c69800 already unused, calling callback (ffffffffc1adac20) 10000000:00010000:3.0:1788797141.216569:0:14299:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.138@tcp lock: ffff8cb077c69800/0xca7fc0c411f945d3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xca7fc0c411f945da expref: -99 pid: 14292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797141.216577:0:14299:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.138@tcp lock: ffff8cb077c69800/0xca7fc0c411f945d3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xca7fc0c411f945da expref: -99 pid: 14292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788797141.216583:0:14299:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.138@tcp lock: ffff8cb077c69800/0xca7fc0c411f945d3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xca7fc0c411f945da expref: -99 pid: 14292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788797141.216603:0:14299:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788797141.216634:0:14299:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.138@tcp lock: ffff8cb077c69800/0xca7fc0c411f945d3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca7fc0c411f945da expref: -99 pid: 14292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797141.216641:0:14299:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788797141.216663:0:14299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.138@tcp lock: ffff8cb077c69800/0xca7fc0c411f945d3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca7fc0c411f945da expref: -99 pid: 14292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797141.216670:0:14299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.138@tcp lock: ffff8cb077c69800/0xca7fc0c411f945d3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca7fc0c411f945da expref: -99 pid: 14292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797141.216686:0:14299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788797141.216688:0:14299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788797141.216689:0:14299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788797141.216727:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb0778df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:73f6407e-c8af-46fc-9cc4-279490305b80:3300:1875689374571520:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788797141.216756:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788797141.221143:0:14295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374571520 00000100:00100000:1.0:1788797141.221160:0:14295:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374571520 00010000:00010000:1.0:1788797141.221199:0:14295:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cb040030200/0xca7fc0c411f945da lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xca7fc0c411f945d3 expref: 13 pid: 14303 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788797141.221236:0:14295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788797141.221245:0:14295:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0778df800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:73f6407e-c8af-46fc-9cc4-279490305b80+13:3300:x1875689374571520:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788797141.221258:0:14295:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788797141.221264:0:14295:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cb040030200/0xca7fc0c411f945da lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xca7fc0c411f945d3 expref: 13 pid: 14303 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797141.221277:0:14295:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cb040030200/0xca7fc0c411f945da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xca7fc0c411f945d3 expref: 13 pid: 14303 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797141.221309:0:14295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cb040030200/0xca7fc0c411f945da lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xca7fc0c411f945d3 expref: 13 pid: 14303 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797141.221330:0:14295:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8cb040031400/0xca7fc0c411f9460b lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797141.221339:0:14295:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cb040031400/0xca7fc0c411f9460b lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788797141.221356:0:14295:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.005413833s 00010000:00010000:1.0:1788797141.221361:0:14295:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cb040031400/0xca7fc0c411f9460b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797141.221369:0:14295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cb040031400/0xca7fc0c411f9460b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797141.221375:0:14295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cb040031400/0xca7fc0c411f9460b lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797141.221389:0:14295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cb040031400/0xca7fc0c411f9460b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797141.221396:0:14295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb040031400 already unused, calling callback (ffffffffc14d98b0) 00010000:00010000:1.0:1788797141.221401:0:14295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cb040031400/0xca7fc0c411f9460b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797141.221409:0:14295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cb040031400/0xca7fc0c411f9460b lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797141.221423:0:14295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cb040031400/0xca7fc0c411f9460b lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797141.221443:0:14295:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788797141.221523:0:14295:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0778df800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:73f6407e-c8af-46fc-9cc4-279490305b80+12:3300:x1875689374571520:12345-0@lo:103:ldlm_bl.0 Request processed in 279us (4765us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797141.221532:0:14295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:3.0:1788797141.221681:0:14325:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8cb040031400/0xca7fc0c411f9460b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797141.221692:0:14325:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cb040031400/0xca7fc0c411f9460b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797141.221698:0:14325:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cb040031400/0xca7fc0c411f9460b lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788797141.221743:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb0778df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:73f6407e-c8af-46fc-9cc4-279490305b80:3300:1875689374571520:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788797141.222360:0:14305:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb079e2b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73f6407e-c8af-46fc-9cc4-279490305b80+11:14292:x1875689374571264:12345-0@lo:253:mount.lustre.0 Request processed in 47295us (47529us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797141.222396:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788797141.222498:0:14292:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb0778dd880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73f6407e-c8af-46fc-9cc4-279490305b80:14292:1875689374571264:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788797141.222512:0:14292:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1788797141.222517:0:14292:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788797141.222518:0:14292:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788797141.222521:0:14292:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788797141.222522:0:14292:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788797141.222523:0:14292:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788797141.222524:0:14292:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788797141.222526:0:14292:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788797141.222527:0:14292:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788797141.222529:0:14292:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788797141.222531:0:14292:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1788797141.222547:0:14292:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1788797141.228173:0:14292:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:0.0:1788797141.228342:0:14292:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1788797141.228604:0:14292:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:0.0:1788797141.228754:0:14292:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1788797141.229010:0:14292:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:0.0:1788797141.229202:0:14292:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:3.0:1788797141.232276:0:14292:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:3.0:1788797141.232599:0:14292:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:3.0:1788797141.232866:0:14292:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:3.0:1788797141.236426:0:14292:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:3.0:1788797141.236834:0:14292:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:3.0:1788797141.236965:0:14292:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000020:00080000:2.0:1788797141.266287:0:14292:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:0.0:1788797141.266872:0:14292:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:2.0:1788797141.266989:0:14347:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:2.0:1788797141.266993:0:14347:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:01000000:2.0:1788797141.267128:0:14348:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:00080000:2.0:1788797141.267209:0:14348:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:0.0:1788797141.270274:0:14292:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:0.0:1788797141.270409:0:14292:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:0.0:1788797141.270806:0:14292:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1788797141.270814:0:14292:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:0.0:1788797141.270952:0:14292:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788797141.272268:0:14348:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1788797141.272372:0:14348:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:2.0:1788797141.272377:0:14348:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000040:00080000:0.0:1788797141.273822:0:14292:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:0.0:1788797141.274662:0:14292:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1788797141.274710:0:14292:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00080000:10000000:0.0:1788797141.276572:0:14292:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/8/4) registered 00000001:00000004:1.0:1788797141.281807:0:14292:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:2.0:1788797141.327548:0:14292:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1788797141.327605:0:14292:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffac66c1c67988 00100000:10000000:2.0:1788797141.327614:0:14292:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:2.0:1788797141.328498:0:14292:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1788797141.328517:0:14292:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.138@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1788797141.328542:0:14292:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=46 00000080:00000004:2.0:1788797141.328570:0:14292:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:2.0:1788797141.811445:0:14298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788797142.195829:0:14343:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 10000000:01000000:3.0:1788797142.578125:0:14307:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788797142.578135:0:14307:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8cb07906b800 from 6 10000000:01000000:3.0:1788797142.578140:0:14307:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788797142.578190:0:14307:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.138@tcp lock: ffff8cb077c69a00/0xca7fc0c411f94612 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797142.578204:0:14307:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.138@tcp lock: ffff8cb077c69a00/0xca7fc0c411f94612 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797142.578214:0:14307:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.138@tcp lock: ffff8cb077c69a00/0xca7fc0c411f94612 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788797142.578243:0:14307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb0778df100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73f6407e-c8af-46fc-9cc4-279490305b80:14307:1875689374571648:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788797142.578316:0:14307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788797142.578388:0:14307:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb0412eda80 going to sleep for 11 seconds 00000100:00100000:1.0:1788797142.578454:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374571648 00000100:00100000:1.0:1788797142.578463:0:14303:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374571648 00000100:00100000:1.0:1788797142.578518:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788797142.578528:0:14303:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb079e29850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73f6407e-c8af-46fc-9cc4-279490305b80+11:14307:x1875689374571648:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788797142.578542:0:14303:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788797142.578664:0:14303:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cb082044200/0xca7fc0c411f94619 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xca7fc0c411f94612 expref: -99 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797142.578699:0:14303:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cb082044200/0xca7fc0c411f94619 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xca7fc0c411f94612 expref: 12 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797142.578739:0:14303:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cb082044200/0xca7fc0c411f94619 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xca7fc0c411f94612 expref: 12 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797142.578747:0:14303:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb082044200, rc 0) 00000100:00100000:1.0:1788797142.578856:0:14303:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb079e29850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73f6407e-c8af-46fc-9cc4-279490305b80+12:14307:x1875689374571648:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 328us (538us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797142.578864:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788797142.579655:0:14307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb0778df100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73f6407e-c8af-46fc-9cc4-279490305b80:14307:1875689374571648:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788797142.579678:0:14307:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.138@tcp lock: ffff8cb077c69a00/0xca7fc0c411f94612 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xca7fc0c411f94619 expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797142.579691:0:14307:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.138@tcp lock: ffff8cb077c69a00/0xca7fc0c411f94612 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xca7fc0c411f94619 expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788797142.585543:0:14307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb0778df100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73f6407e-c8af-46fc-9cc4-279490305b80:14307:1875689374571776:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1788797142.585632:0:14307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788797142.585704:0:14307:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb0412eda80 going to sleep for 11 seconds 00000100:00100000:1.0:1788797142.585928:0:14305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374571776 00000100:00100000:1.0:1788797142.585939:0:14305:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374571776 00000100:00100000:1.0:1788797142.586013:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788797142.586025:0:14305:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb079e29050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73f6407e-c8af-46fc-9cc4-279490305b80+12:14307:x1875689374571776:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1788797142.586093:0:14305:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788797142.586113:0:14305:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788797142.586117:0:14305:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:1.0:1788797142.586239:0:14305:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb079e29050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73f6407e-c8af-46fc-9cc4-279490305b80+12:14307:x1875689374571776:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 216us (605us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797142.586247:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788797142.587118:0:14307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb0778df100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73f6407e-c8af-46fc-9cc4-279490305b80:14307:1875689374571776:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1788797142.587182:0:14307:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.138@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788797142.587193:0:14307:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.138@tcp lock: ffff8cb077c69a00/0xca7fc0c411f94612 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xca7fc0c411f94619 expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797142.587204:0:14307:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.138@tcp lock: ffff8cb077c69a00/0xca7fc0c411f94612 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xca7fc0c411f94619 expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797142.839129:0:14299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788797143.220195:0:14343:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788797143.861386:0:14298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788797144.883007:0:14299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788797145.909202:0:14298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788797146.674384:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788797146.674391:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788797146.674395:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788797146.674398:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788797146.674409:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788797146.674413:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788797146.674417:0:36:0:(import.c:65:import_set_state_nolock()) ffff8cb061de2000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788797146.674433:0:36:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff8cb061de2000 using connection 192.168.204.138@tcp/0@lo 00000100:00100000:0.0:1788797146.674458:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cb06f57c700 x1875689374572032/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788797146.674495:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb06f57c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3299:1875689374572032:0@lo:38:kworker.0 00000100:00100000:0.0:1788797146.674583:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788797146.674692:0:14311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374572032 00000100:00100000:0.0:1788797146.674699:0:14311:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374572032 00000100:00100000:0.0:1788797146.674735:0:14311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788797146.674743:0:14311:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb06f57c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3299:x1875689374572032:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1788797146.674775:0:14311:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 435 last 0 00000020:00000080:0.0:1788797146.674820:0:14311:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xca7fc0c411f94620 00000004:00100000:0.0:1788797146.674836:0:14311:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788797146.674993:0:14311:0:(import.c:65:import_set_state_nolock()) ffff8cb077ecc800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788797146.675089:0:14311:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb06f57c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1875689374572032:12345-0@lo:38:kworker.0 Request processed in 345us (505us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797146.675096:0:14311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1788797146.675410:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8cb06f57c700 x1875689374572032/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788797156 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788797146.675424:0:3299:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1788797146.675431:0:3299:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1788797146.675436:0:3299:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788797146.675438:0:3299:0:(import.c:65:import_set_state_nolock()) ffff8cb061de2000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788797146.675453:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb06f57c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3299:1875689374572032:0@lo:38:kworker.0 00000100:00100000:2.0:1788797146.675600:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788797146.675613:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb06f57c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:73f6407e-c8af-46fc-9cc4-279490305b80:3300:1875689374571904:0@lo:400:kworker.0 00000100:00100000:2.0:1788797146.675665:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788797146.676634:0:14304:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374571904 00000100:00100000:0.0:1788797146.676643:0:14304:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374571904 00000100:00100000:0.0:1788797146.676706:0:14304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788797146.676715:0:14304:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb079e2b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73f6407e-c8af-46fc-9cc4-279490305b80+12:3300:x1875689374571904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788797146.676778:0:14304:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb079e2b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73f6407e-c8af-46fc-9cc4-279490305b80+12:3300:x1875689374571904:12345-0@lo:400:kworker.0 Request processed in 64us (1112us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797146.676785:0:14304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788797146.676833:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb06f57c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:73f6407e-c8af-46fc-9cc4-279490305b80:3300:1875689374571904:0@lo:400:kworker.0 00010000:00010000:2.0:1788797146.932934:0:14299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788797147.000782:0:14592:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg438-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1788797147.954882:0:14298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788797148.978799:0:14299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788797150.003192:0:14298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788797150.445979:0:14742:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe14873870 20000000:00000080:1.0:1788797150.445998:0:14742:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8cb07903d800 uarg=0000000000000000 20000000:01000000:1.0:1788797150.446074:0:14742:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:1.0:1788797150.446083:0:14742:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:1.0:1788797150.446090:0:14742:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:3.0:1788797150.447639:0:14743:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 10 20000000:00000400:1.0:1788797150.447856:0:14742:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:1.0:1788797150.456009:0:14742:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1788797150.456195:0:14742:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cb082044600/0xca7fc0c411f94627 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797150.456448:0:14742:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cb042ea3800/0xca7fc0c411f945e8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xca7fc0c411f945e1 expref: 11 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797150.456458:0:14742:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8cb082044600/0xca7fc0c411f94627 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797150.456502:0:14742:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cb042ea3800/0xca7fc0c411f945e8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xca7fc0c411f945e1 expref: 11 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797150.456516:0:14742:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8cb042ea3800/0xca7fc0c411f945e8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xca7fc0c411f945e1 expref: 11 pid: 14305 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788797150.456531:0:14742:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb0795c7480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14742:1875689374572160:0@lo:104: 00000100:00100000:1.0:1788797150.459251:0:14742:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788797150.459336:0:14742:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb06f48fcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788797150.461547:0:14294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374572160 00000100:00100000:0.0:1788797150.461570:0:14294:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374572160 00000100:00100000:0.0:1788797150.461635:0:14294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788797150.461646:0:14294:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0795c4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:73f6407e-c8af-46fc-9cc4-279490305b80+3:14742:x1875689374572160:12345-0@lo:104: 00010000:00010000:0.0:1788797150.461664:0:14294:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.138@tcp lock: ffff8cb077c68600/0xca7fc0c411f945e1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xca7fc0c411f945e8 expref: -99 pid: 14292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797150.461759:0:14294:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788797150.461765:0:14294:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0795c4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:73f6407e-c8af-46fc-9cc4-279490305b80+3:14742:x1875689374572160:12345-0@lo:104: Request processed in 123us (2520us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797150.461772:0:14294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:0.0:1788797150.461795:0:14299:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788797150.461801:0:14299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.138@tcp lock: ffff8cb077c68600/0xca7fc0c411f945e1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xca7fc0c411f945e8 expref: -99 pid: 14292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797150.461809:0:14299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb077c68600 already unused, calling callback (ffffffffc1adac20) 10000000:00010000:0.0:1788797150.461814:0:14299:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.138@tcp lock: ffff8cb077c68600/0xca7fc0c411f945e1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xca7fc0c411f945e8 expref: -99 pid: 14292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797150.461860:0:14299:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.138@tcp lock: ffff8cb077c68600/0xca7fc0c411f945e1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xca7fc0c411f945e8 expref: -99 pid: 14292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788797150.461867:0:14299:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.138@tcp lock: ffff8cb077c68600/0xca7fc0c411f945e1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xca7fc0c411f945e8 expref: -99 pid: 14292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788797150.461873:0:14299:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788797150.461918:0:14299:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.138@tcp lock: ffff8cb077c68600/0xca7fc0c411f945e1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca7fc0c411f945e8 expref: -99 pid: 14292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797150.461924:0:14299:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788797150.461946:0:14299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.138@tcp lock: ffff8cb077c68600/0xca7fc0c411f945e1 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca7fc0c411f945e8 expref: -99 pid: 14292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797150.461954:0:14299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.138@tcp lock: ffff8cb077c68600/0xca7fc0c411f945e1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca7fc0c411f945e8 expref: -99 pid: 14292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797150.461975:0:14299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788797150.461977:0:14299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788797150.461979:0:14299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788797150.461995:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb06f57c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:73f6407e-c8af-46fc-9cc4-279490305b80:3302:1875689374572288:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788797150.462061:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788797150.462123:0:14295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374572288 00000100:00100000:0.0:1788797150.462128:0:14295:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374572288 00010000:00010000:0.0:1788797150.462150:0:14295:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cb042ea3800/0xca7fc0c411f945e8 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xca7fc0c411f945e1 expref: 12 pid: 14305 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788797150.462177:0:14295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788797150.462184:0:14295:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb06f57c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:73f6407e-c8af-46fc-9cc4-279490305b80+12:3302:x1875689374572288:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788797150.462212:0:14295:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788797150.462218:0:14295:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cb042ea3800/0xca7fc0c411f945e8 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xca7fc0c411f945e1 expref: 12 pid: 14305 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788797150.463059:0:14742:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb0795c7480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14742:1875689374572160:0@lo:104: 00010000:00010000:1.0:1788797150.463084:0:14742:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8cb082044600/0xca7fc0c411f94627 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797150.463152:0:14295:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cb042ea3800/0xca7fc0c411f945e8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xca7fc0c411f945e1 expref: 12 pid: 14305 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797150.463169:0:14295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cb042ea3800/0xca7fc0c411f945e8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xca7fc0c411f945e1 expref: 12 pid: 14305 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797150.463186:0:14295:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8cb082044600/0xca7fc0c411f94627 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797150.463308:0:14295:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cb082044600/0xca7fc0c411f94627 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797150.463328:0:14295:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cb082044600/0xca7fc0c411f94627 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797150.463336:0:14295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cb082044600/0xca7fc0c411f94627 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797150.463342:0:14295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cb082044600/0xca7fc0c411f94627 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797150.463409:0:14295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cb082044600/0xca7fc0c411f94627 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797150.463415:0:14295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb082044600 already unused, calling callback (ffffffffc14d98b0) 00010000:00010000:0.0:1788797150.463419:0:14295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cb082044600/0xca7fc0c411f94627 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797150.463442:0:14295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cb082044600/0xca7fc0c411f94627 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797150.468156:0:14295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cb082044600/0xca7fc0c411f94627 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797150.468187:0:14295:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788797150.468304:0:14295:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb06f57c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:73f6407e-c8af-46fc-9cc4-279490305b80+11:3302:x1875689374572288:12345-0@lo:103:ldlm_bl.0 Request processed in 6117us (6239us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797150.468319:0:14295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:1.0:1788797150.468981:0:14742:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8cb082044600/0xca7fc0c411f94627 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797150.468994:0:14742:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cb082044600/0xca7fc0c411f94627 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797150.469000:0:14742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cb082044600/0xca7fc0c411f94627 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788797150.470546:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb06f57c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:73f6407e-c8af-46fc-9cc4-279490305b80:3302:1875689374572288:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788797151.029149:0:14298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788797151.798454:0:3299:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788797141/real 1788797141] req@ffff8cb0795d9500 x1875689374569344/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788797151 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788797151.798493:0:3299:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8cb0795d9500 x1875689374569344/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788797151 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788797151.798505:0:3299:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788797141/real 1788797141] req@ffff8cb0795d9f80 x1875689374569088/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788797151 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788797151.798517:0:3299:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8cb0795d9f80 x1875689374569088/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788797151 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788797151.798538:0:3299:0:(import.c:65:import_set_state_nolock()) ffff8cb05ca5a000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788797151.798546:0:3299:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788797151.798549:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb0795d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3299:1875689374569344:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1788797151.798554:0:3299:0:(import.c:65:import_set_state_nolock()) ffff8cb0779d6000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788797151.798558:0:3299:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788797151.798560:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb0795d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3299:1875689374569088:0@lo:8:llog_process_th.0 00000100:00080000:3.0:1788797151.798850:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788797151.798855:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1788797151.798858:0:37:0:(import.c:65:import_set_state_nolock()) ffff8cb0779d6000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788797151.798872:0:37:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 430 00000100:00080000:3.0:1788797151.798878:0:37:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788797151.798890:0:37:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8cb0779d6000 using connection 192.168.204.138@tcp/0@lo 00000100:00100000:3.0:1788797151.798912:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cb0778dea00 x1875689374572544/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788797151.798930:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788797151.798933:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788797151.798934:0:37:0:(import.c:65:import_set_state_nolock()) ffff8cb05ca5a000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788797151.798937:0:37:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 430 00000100:00080000:3.0:1788797151.798940:0:37:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788797151.798945:0:37:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8cb05ca5a000 using connection 192.168.204.138@tcp/0@lo 00000100:00100000:3.0:1788797151.798957:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cb0778dd180 x1875689374572672/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788797151.798999:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788797151.799065:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb0778dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3301:1875689374572800:0@lo:400:kworker.0 00000100:00100000:3.0:1788797151.799160:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788797151.800309:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb0778dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:73f6407e-c8af-46fc-9cc4-279490305b80:3303:1875689374572416:0@lo:400:kworker.0 00000100:00100000:0.0:1788797151.800374:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788797151.800551:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374572416 00000100:00100000:0.0:1788797151.800558:0:14303:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374572416 00000100:00100000:0.0:1788797151.803176:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788797151.803776:0:14303:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb079e29c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73f6407e-c8af-46fc-9cc4-279490305b80+11:3303:x1875689374572416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788797151.803895:0:14303:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb079e29c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73f6407e-c8af-46fc-9cc4-279490305b80+11:3303:x1875689374572416:12345-0@lo:400:kworker.0 Request processed in 707us (3520us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797151.803904:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788797151.803980:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb0778dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3299:1875689374572544:0@lo:8:kworker.0 00000100:00100000:3.0:1788797151.804990:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb0778dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:73f6407e-c8af-46fc-9cc4-279490305b80:3303:1875689374572416:0@lo:400:kworker.0 00000400:00000100:0.0:1788797151.806183:0:3299:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875689374572544 offset 0 length 520: 4 00000100:00100000:0.0:1788797151.807850:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb0778dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3299:1875689374572672:0@lo:8:kworker.0 00000400:00000100:0.0:1788797151.807922:0:3299:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875689374572672 offset 0 length 520: 4 00000100:00100000:0.0:1788797151.814418:0:14310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374572800 00000100:00100000:0.0:1788797151.814436:0:14310:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374572800 00000100:00100000:0.0:1788797151.814495:0:14310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788797151.814506:0:14310:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0778dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1875689374572800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788797151.816556:0:14310:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0778dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1875689374572800:12345-0@lo:400:kworker.0 Request processed in 2039us (17383us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797151.816575:0:14310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1788797151.816988:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8cb0778dca80 x1875689374572800/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788797167 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788797151.817605:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb0778dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3301:1875689374572800:0@lo:400:kworker.0 00010000:00010000:1.0:1788797152.053189:0:14299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788797152.178173:0:14307:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788797152.178183:0:14307:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8cb07906b800 from 10 10000000:01000000:2.0:1788797152.178221:0:14307:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788797152.178284:0:14307:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.138@tcp lock: ffff8cb040031a00/0xca7fc0c411f9462e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797152.178297:0:14307:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.138@tcp lock: ffff8cb040031a00/0xca7fc0c411f9462e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797152.178310:0:14307:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.138@tcp lock: ffff8cb040031a00/0xca7fc0c411f9462e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788797152.178336:0:14307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb0795d9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73f6407e-c8af-46fc-9cc4-279490305b80:14307:1875689374572928:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788797152.178414:0:14307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788797152.178600:0:14307:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb046b360c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788797152.180017:0:14305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374572928 00000100:00100000:0.0:1788797152.180056:0:14305:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374572928 00000100:00100000:0.0:1788797152.180117:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788797152.180127:0:14305:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb079e2b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73f6407e-c8af-46fc-9cc4-279490305b80+11:14307:x1875689374572928:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788797152.180144:0:14305:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788797152.180165:0:14305:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cb042ea3800/0xca7fc0c411f94635 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xca7fc0c411f9462e expref: -99 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797152.180196:0:14305:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cb042ea3800/0xca7fc0c411f94635 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xca7fc0c411f9462e expref: 12 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797152.180208:0:14305:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cb042ea3800/0xca7fc0c411f94635 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xca7fc0c411f9462e expref: 12 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797152.180229:0:14305:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb042ea3800, rc 0) 00000100:00100000:0.0:1788797152.180315:0:14305:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb079e2b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73f6407e-c8af-46fc-9cc4-279490305b80+12:14307:x1875689374572928:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 189us (1900us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797152.180322:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788797152.180665:0:14307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb0795d9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73f6407e-c8af-46fc-9cc4-279490305b80:14307:1875689374572928:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788797152.180689:0:14307:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.138@tcp lock: ffff8cb040031a00/0xca7fc0c411f9462e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xca7fc0c411f94635 expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797152.180700:0:14307:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.138@tcp lock: ffff8cb040031a00/0xca7fc0c411f9462e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xca7fc0c411f94635 expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788797152.180788:0:14307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb0795d9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73f6407e-c8af-46fc-9cc4-279490305b80:14307:1875689374573056:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788797152.180829:0:14307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788797152.180887:0:14307:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb046b360c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788797152.180949:0:14304:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374573056 00000100:00100000:0.0:1788797152.180955:0:14304:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374573056 00000100:00100000:0.0:1788797152.180986:0:14304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788797152.180994:0:14304:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb079e28050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73f6407e-c8af-46fc-9cc4-279490305b80+12:14307:x1875689374573056:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788797152.181990:0:14304:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb079e28050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73f6407e-c8af-46fc-9cc4-279490305b80+12:14307:x1875689374573056:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 991us (1155us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797152.182003:0:14304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788797152.182540:0:14307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb0795d9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73f6407e-c8af-46fc-9cc4-279490305b80:14307:1875689374573056:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788797152.182588:0:14307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb0795d9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73f6407e-c8af-46fc-9cc4-279490305b80:14307:1875689374573184:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788797152.182641:0:14307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788797152.182770:0:14307:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb046b360c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788797152.182823:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374573184 00000100:00100000:3.0:1788797152.182830:0:14303:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374573184 00000100:00100000:3.0:1788797152.182923:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788797152.182933:0:14303:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb079e2a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73f6407e-c8af-46fc-9cc4-279490305b80+12:14307:x1875689374573184:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788797152.183139:0:14303:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb079e2a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73f6407e-c8af-46fc-9cc4-279490305b80+12:14307:x1875689374573184:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 207us (498us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797152.183147:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788797152.183228:0:14307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb0795d9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73f6407e-c8af-46fc-9cc4-279490305b80:14307:1875689374573184:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788797152.184731:0:14805:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:0.0:1788797152.184962:0:14307:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:0.0:1788797152.184980:0:14307:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.138@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788797152.184991:0:14307:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.138@tcp lock: ffff8cb040031a00/0xca7fc0c411f9462e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xca7fc0c411f94635 expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797152.185019:0:14307:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.138@tcp lock: ffff8cb040031a00/0xca7fc0c411f9462e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xca7fc0c411f94635 expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797153.074333:0:14298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788797153.458895:0:14343:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788797154.103320:0:14299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788797155.128144:0:14298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788797156.146269:0:14299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788797156.443089:0:14992:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788797156.443103:0:14992:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:2.0:1788797156.443260:0:14992:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8cb05ca63800 00000020:01000004:2.0:1788797156.443282:0:14992:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1788797156.443296:0:14992:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1788797156.443315:0:14992:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff8cb06f094d40) 00000020:00000080:2.0:1788797156.443332:0:14992:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osd-zfs with refcount 2 00100000:10000000:1.0:1788797156.491267:0:14992:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:1.0:1788797156.491707:0:14992:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1788797156.499232:0:14992:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1788797156.499515:0:14992:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:2.0:1788797156.499796:0:14992:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:2.0:1788797156.500260:0:14992:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-client under 457: rc = 0 00100000:10000000:2.0:1788797156.500342:0:14992:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled params under 457: rc = 0 00100000:10000000:2.0:1788797156.500421:0:14992:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-OST0000 under 457: rc = 0 00100000:10000000:2.0:1788797156.500873:0:14992:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000 under 15: rc = 0 00100000:10000000:2.0:1788797156.501145:0:14992:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000 under 15: rc = 0 00100000:10000000:2.0:1788797156.501463:0:14992:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000-OST0000 under 15: rc = 0 00100000:10000000:2.0:1788797156.501699:0:14992:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000 under 15: rc = 0 00100000:10000000:0.0:1788797156.511539:0:14992:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000-OST0000 under 15: rc = 0 00100000:10000000:0.0:1788797156.513232:0:14992:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000-OST0000 under 15: rc = 0 00000020:00000080:0.0:1788797156.514709:0:14992:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:0.0:1788797156.514726:0:14992:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:0.0:1788797156.514741:0:14992:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xca7fc0c411f94643 00000020:01000004:0.0:1788797156.514752:0:14992:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:0.0:1788797156.514796:0:14992:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.138@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1788797156.514801:0:14992:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.138@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1788797156.514808:0:14992:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0000 00000020:01000004:0.0:1788797156.514813:0:14992:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:0.0:1788797156.514962:0:14992:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff8cb0812d4d40) 00000020:00000080:0.0:1788797156.514977:0:14992:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type ost with refcount 2 00000100:00100000:0.0:1788797156.520181:0:14992:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788797156.520450:0:14992:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:0.0:1788797156.520458:0:14992:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:0.0:1788797156.528114:0:14992:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:0.0:1788797156.528137:0:14992:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:1.0:1788797156.528630:0:14992:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:1.0:1788797156.528640:0:14992:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:0.0:1788797156.531514:0:14992:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788797156.531724:0:14992:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:0.0:1788797156.531731:0:14992:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:0.0:1788797156.537022:0:14992:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:0.0:1788797156.537052:0:14992:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:2.0:1788797156.571883:0:14992:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788797156.572181:0:14992:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1788797156.572189:0:14992:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:0.0:1788797156.583458:0:14992:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1788797156.583482:0:14992:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:0.0:1788797156.594841:0:14992:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1788797156.594857:0:14992:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:0.0:1788797156.601076:0:14992:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788797156.601302:0:14992:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:0.0:1788797156.601312:0:14992:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:0.0:1788797156.625750:0:14992:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:0.0:1788797156.625764:0:14992:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:3.0:1788797156.690357:0:14992:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788797156.690608:0:14992:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:3.0:1788797156.690615:0:14992:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:2.0:1788797156.693314:0:14992:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:2.0:1788797156.693330:0:14992:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:2.0:1788797156.698186:0:14992:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:2.0:1788797156.698262:0:14992:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:2.0:1788797156.698271:0:14992:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.138@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:3.0:1788797156.712455:0:14992:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.138@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788797156.712504:0:14992:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.204.138@tcp, index=0000, flags=0x20002 00000020:01000004:3.0:1788797156.712509:0:14992:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788797156.712511:0:14992:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788797156.712512:0:14992:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788797156.712513:0:14992:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788797156.712515:0:14992:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788797156.712516:0:14992:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788797156.712518:0:14992:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788797156.712519:0:14992:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788797156.712521:0:14992:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788797156.712526:0:14992:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:3.0:1788797156.712528:0:14992:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788797156.712529:0:14992:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788797156.712530:0:14992:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788797156.712531:0:14992:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788797156.712532:0:14992:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788797156.712533:0:14992:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788797156.712535:0:14992:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788797156.712536:0:14992:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788797156.712537:0:14992:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788797156.712582:0:14992:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1788797156.712611:0:14992:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb0778dd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73f6407e-c8af-46fc-9cc4-279490305b80:14992:1875689374573312:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788797156.712707:0:14992:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788797156.712901:0:14992:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb077d10b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788797156.712959:0:14304:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374573312 00000100:00100000:0.0:1788797156.712968:0:14304:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374573312 00000100:00100000:0.0:1788797156.713166:0:14304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788797156.713179:0:14304:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb079e2a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73f6407e-c8af-46fc-9cc4-279490305b80+12:14992:x1875689374573312:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788797156.713238:0:14304:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1788797156.713241:0:14304:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:0.0:1788797156.713247:0:14304:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:0.0:1788797156.746101:0:14304:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb079e2a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73f6407e-c8af-46fc-9cc4-279490305b80+12:14992:x1875689374573312:12345-0@lo:253:mount.lustre.0 Request processed in 32912us (33382us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797156.746121:0:14304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788797156.749428:0:14992:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb0778dd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73f6407e-c8af-46fc-9cc4-279490305b80:14992:1875689374573312:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788797156.749450:0:14992:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1788797156.749453:0:14992:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788797156.749456:0:14992:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788797156.749457:0:14992:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788797156.749458:0:14992:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788797156.749459:0:14992:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788797156.749460:0:14992:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788797156.749462:0:14992:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788797156.749463:0:14992:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788797156.749464:0:14992:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788797156.749490:0:14992:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8cb05ca63800 from lustre-OST0000 10000000:01000000:3.0:1788797156.749519:0:14992:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:3.0:1788797156.749522:0:14992:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1788797156.749529:0:14992:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8cb0812d19c0 local copy 00010000:00010000:3.0:1788797156.749539:0:14992:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.138@tcp lock: ffff8cb077c68a00/0xca7fc0c411f94539 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xca7fc0c411f94540 expref: -99 pid: 14292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788797156.750079:0:14992:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb0778dd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73f6407e-c8af-46fc-9cc4-279490305b80:14992:1875689374573440:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788797156.750154:0:14992:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788797156.750201:0:14992:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb077d10a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788797156.750317:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374573440 00000100:00100000:0.0:1788797156.750327:0:14303:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374573440 00000100:00100000:0.0:1788797156.750403:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788797156.750414:0:14303:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb079e28c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73f6407e-c8af-46fc-9cc4-279490305b80+12:14992:x1875689374573440:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788797156.750622:0:14303:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb079e28c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73f6407e-c8af-46fc-9cc4-279490305b80+12:14992:x1875689374573440:12345-0@lo:501:mount.lustre.0 Request processed in 210us (467us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788797156.750630:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788797156.751512:0:14992:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb0778dd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73f6407e-c8af-46fc-9cc4-279490305b80:14992:1875689374573440:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1788797156.751540:0:14992:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.138@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1788797156.751812:0:14992:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.138@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1788797156.751824:0:14992:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.138@tcp lock: ffff8cb077c68a00/0xca7fc0c411f94539 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xca7fc0c411f94540 expref: -99 pid: 14292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797156.751846:0:14992:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.138@tcp lock: ffff8cb077c68a00/0xca7fc0c411f94539 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xca7fc0c411f94540 expref: -99 pid: 14292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788797156.751877:0:14992:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8cb05ca63800 10000000:01000000:3.0:1788797156.751882:0:14992:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788797156.751887:0:14992:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff8cb0812d19c0 10000000:01000000:3.0:1788797156.751889:0:14992:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:3.0:1788797156.751892:0:14992:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8cb0812d19c0 from 1 10000000:01000000:3.0:1788797156.751895:0:14992:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1788797156.751935:0:14992:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.138@tcp lock: ffff8cb077c69e00/0xca7fc0c411f94651 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797156.751944:0:14992:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.138@tcp lock: ffff8cb077c69e00/0xca7fc0c411f94651 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797156.751956:0:14992:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.138@tcp lock: ffff8cb077c69e00/0xca7fc0c411f94651 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788797156.751976:0:14992:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb0778dd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73f6407e-c8af-46fc-9cc4-279490305b80:14992:1875689374573568:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788797156.752024:0:14992:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788797156.752098:0:14992:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb077d10a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788797156.752365:0:14304:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374573568 00000100:00100000:0.0:1788797156.752374:0:14304:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374573568 00000100:00100000:0.0:1788797156.752427:0:14304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788797156.752436:0:14304:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb079e2ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73f6407e-c8af-46fc-9cc4-279490305b80+12:14992:x1875689374573568:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788797156.752451:0:14304:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788797156.752468:0:14304:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cb042ea2a00/0xca7fc0c411f94658 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xca7fc0c411f94651 expref: -99 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797156.752506:0:14304:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cb042ea2a00/0xca7fc0c411f94658 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xca7fc0c411f94651 expref: 13 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797156.752517:0:14304:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cb042ea2a00/0xca7fc0c411f94658 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xca7fc0c411f94651 expref: 13 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797156.752526:0:14304:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb042ea2a00, rc 0) 00000100:00100000:0.0:1788797156.752578:0:14304:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb079e2ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73f6407e-c8af-46fc-9cc4-279490305b80+13:14992:x1875689374573568:12345-0@lo:101:mount.lustre.0 Request processed in 144us (553us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797156.752585:0:14304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788797156.752696:0:14992:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb0778dd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73f6407e-c8af-46fc-9cc4-279490305b80:14992:1875689374573568:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788797156.752711:0:14992:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.138@tcp lock: ffff8cb077c69e00/0xca7fc0c411f94651 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xca7fc0c411f94658 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797156.752730:0:14992:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.138@tcp lock: ffff8cb077c69e00/0xca7fc0c411f94651 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xca7fc0c411f94658 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788797156.752746:0:14992:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.138@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1788797156.752762:0:14992:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.138@tcp lock: ffff8cb077c69e00/0xca7fc0c411f94651 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xca7fc0c411f94658 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797156.752778:0:14992:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.138@tcp lock: ffff8cb077c69e00/0xca7fc0c411f94651 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xca7fc0c411f94658 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788797156.752785:0:14992:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1788797156.752792:0:14992:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788797156.752797:0:14992:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:1.0:1788797156.752799:0:14992:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1788797156.752821:0:14992:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.138@tcp lock: ffff8cb082044600/0xca7fc0c411f9465f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797156.752828:0:14992:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.138@tcp lock: ffff8cb082044600/0xca7fc0c411f9465f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797156.752836:0:14992:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.138@tcp lock: ffff8cb082044600/0xca7fc0c411f9465f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788797156.752863:0:14992:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb0795c7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73f6407e-c8af-46fc-9cc4-279490305b80:14992:1875689374573696:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788797156.752897:0:14992:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788797156.756317:0:14992:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb06f48fcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788797156.756906:0:14304:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374573696 00000100:00100000:0.0:1788797156.756920:0:14304:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374573696 00000100:00100000:2.0:1788797156.757051:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788797156.757064:0:14305:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb079e28450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73f6407e-c8af-46fc-9cc4-279490305b80+13:14992:x1875689374573696:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788797156.757082:0:14305:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788797156.757101:0:14305:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cb040030000/0xca7fc0c411f94666 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xca7fc0c411f9465f expref: -99 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797156.757131:0:14305:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cb040030000/0xca7fc0c411f94666 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xca7fc0c411f9465f expref: 14 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797156.757142:0:14305:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cb040030000/0xca7fc0c411f94666 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xca7fc0c411f9465f expref: 14 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797156.757150:0:14305:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb040030000, rc 0) 00000100:00100000:2.0:1788797156.757229:0:14305:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb079e28450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73f6407e-c8af-46fc-9cc4-279490305b80+14:14992:x1875689374573696:12345-0@lo:101:mount.lustre.0 Request processed in 168us (4331us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797156.757236:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788797156.757360:0:14992:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb0795c7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73f6407e-c8af-46fc-9cc4-279490305b80:14992:1875689374573696:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788797156.757381:0:14992:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.138@tcp lock: ffff8cb082044600/0xca7fc0c411f9465f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xca7fc0c411f94666 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797156.757390:0:14992:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.138@tcp lock: ffff8cb082044600/0xca7fc0c411f9465f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xca7fc0c411f94666 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788797156.759423:0:14992:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:1.0:1788797156.760696:0:14992:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788797156.764856:0:14992:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:1.0:1788797156.764917:0:14992:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:1.0:1788797156.764946:0:14992:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:1.0:1788797156.764987:0:14992:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:1.0:1788797156.765020:0:14992:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:1.0:1788797156.765078:0:14992:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:1.0:1788797156.765174:0:14992:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:1.0:1788797156.765183:0:14992:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:1.0:1788797156.765319:0:14992:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb0795c7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73f6407e-c8af-46fc-9cc4-279490305b80:14992:1875689374573824:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788797156.765413:0:14992:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788797156.765484:0:14992:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb06f48fd80 going to sleep for 11 seconds 00000100:00100000:2.0:1788797156.765857:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374573824 00000100:00100000:2.0:1788797156.765868:0:14303:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374573824 00000100:00100000:2.0:1788797156.765921:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788797156.765930:0:14303:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb079e29450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73f6407e-c8af-46fc-9cc4-279490305b80+14:14992:x1875689374573824:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788797156.766363:0:14303:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb079e29450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73f6407e-c8af-46fc-9cc4-279490305b80+14:14992:x1875689374573824:12345-0@lo:501:mount.lustre.0 Request processed in 419us (937us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797156.766372:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788797156.766817:0:14992:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb0795c7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73f6407e-c8af-46fc-9cc4-279490305b80:14992:1875689374573824:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788797156.766865:0:14992:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb0795c7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73f6407e-c8af-46fc-9cc4-279490305b80:14992:1875689374573952:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788797156.767024:0:14992:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788797156.767082:0:14992:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb06f48fd80 going to sleep for 11 seconds 00000100:00100000:0.0:1788797156.767136:0:14304:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374573952 00000100:00100000:0.0:1788797156.767142:0:14304:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374573952 00000100:00100000:0.0:1788797156.767178:0:14304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788797156.767186:0:14304:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb06fb84c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73f6407e-c8af-46fc-9cc4-279490305b80+14:14992:x1875689374573952:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788797156.767599:0:14304:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb06fb84c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73f6407e-c8af-46fc-9cc4-279490305b80+14:14992:x1875689374573952:12345-0@lo:503:mount.lustre.0 Request processed in 412us (574us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797156.767608:0:14304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788797156.767878:0:14992:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb0795c7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73f6407e-c8af-46fc-9cc4-279490305b80:14992:1875689374573952:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788797156.777407:0:14992:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788797156.777510:0:14992:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb0778ded80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73f6407e-c8af-46fc-9cc4-279490305b80:14992:1875689374574080:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788797156.777615:0:14992:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788797156.777672:0:14992:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb077d10000 going to sleep for 11 seconds 00000100:00100000:2.0:1788797156.777909:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374574080 00000100:00100000:2.0:1788797156.777932:0:14303:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374574080 00000100:00100000:2.0:1788797156.777998:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788797156.778010:0:14303:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb06fb86c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73f6407e-c8af-46fc-9cc4-279490305b80+14:14992:x1875689374574080:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788797156.778358:0:14303:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb06fb86c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73f6407e-c8af-46fc-9cc4-279490305b80+14:14992:x1875689374574080:12345-0@lo:502:mount.lustre.0 Request processed in 348us (741us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797156.778366:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788797156.778537:0:14992:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb0778ded80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73f6407e-c8af-46fc-9cc4-279490305b80:14992:1875689374574080:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788797156.778916:0:14992:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:3.0:1788797156.778979:0:14992:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:3.0:1788797156.779015:0:14992:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:3.0:1788797156.780008:0:14992:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:3.0:1788797156.780077:0:14992:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:3.0:1788797156.780136:0:14992:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:3.0:1788797156.780186:0:14992:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:3.0:1788797156.780220:0:14992:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:3.0:1788797156.780253:0:14992:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:3.0:1788797156.780301:0:14992:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:3.0:1788797156.780337:0:14992:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:3.0:1788797156.780396:0:14992:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:3.0:1788797156.780451:0:14992:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb0778ded80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73f6407e-c8af-46fc-9cc4-279490305b80:14992:1875689374574208:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788797156.781903:0:14992:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788797156.782054:0:14992:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb077d10000 going to sleep for 11 seconds 00000100:00100000:2.0:1788797156.785331:0:14305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374574208 00000100:00100000:2.0:1788797156.785352:0:14305:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374574208 00000100:00100000:2.0:1788797156.785493:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788797156.785504:0:14305:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb06fb84450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73f6407e-c8af-46fc-9cc4-279490305b80+14:14992:x1875689374574208:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788797156.786346:0:14305:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb06fb84450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73f6407e-c8af-46fc-9cc4-279490305b80+14:14992:x1875689374574208:12345-0@lo:502:mount.lustre.0 Request processed in 839us (4442us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797156.786367:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788797156.786949:0:14992:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb0778ded80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73f6407e-c8af-46fc-9cc4-279490305b80:14992:1875689374574208:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788797156.787260:0:14992:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:2.0:1788797156.787282:0:14992:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 14 00000020:01000000:0.0:1788797156.808112:0:15006:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788797156.808125:0:15006:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:0.0:1788797156.808133:0:15006:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788797156.808135:0:15006:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:0.0:1788797156.808141:0:15006:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788797156.808158:0:15006:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff8cb045703380) 00000020:00000080:0.0:1788797156.808185:0:15006:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type obdfilter with refcount 2 00000020:00000080:0.0:1788797156.808191:0:15006:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1788797156.808259:0:15006:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8cb05ca63800 from lustre-OST0000, refs=2 00080000:01000000:0.0:1788797156.808282:0:15006:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:0.0:1788797156.808294:0:15006:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xca7fc0c411f94674 00010000:00010000:0.0:1788797156.815429:0:15006:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:00000004:0.0:1788797156.815919:0:15006:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967324 00080000:10000000:0.0:1788797156.820154:0:15006:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:0.0:1788797156.824831:0:15006:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:0.0:1788797156.824846:0:15006:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788797156.824852:0:15006:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788797156.824855:0:15006:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:0.0:1788797156.824858:0:15006:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1788797156.824861:0:15006:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #16 00000020:01000000:0.0:1788797156.824863:0:15006:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788797156.824864:0:15006:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788797156.824866:0:15006:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1788797156.824868:0:15006:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788797156.824870:0:15006:0:(obd_config.c:1563:class_process_config()) marker 16 (0x6) lustre sys.timeout 00000020:01000000:0.0:1788797156.824872:0:15006:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788797156.824875:0:15006:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788797156.824876:0:15006:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788797156.824880:0:15006:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788797156.824882:0:15006:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1788797156.824884:0:15006:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788797156.824887:0:15006:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788797156.824888:0:15006:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000020:01000000:0.0:1788797156.824890:0:15006:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788797156.824892:0:15006:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788797156.824893:0:15006:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1788797156.824896:0:15006:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1788797156.824966:0:15006:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788797156.824969:0:15006:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788797156.824970:0:15006:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1788797156.824973:0:15006:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:3.0:1788797156.829653:0:14992:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:3.0:1788797156.829691:0:14992:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.138@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1788797156.829710:0:14992:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.138@tcp lock: ffff8cb082044600/0xca7fc0c411f9465f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xca7fc0c411f94666 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797156.829723:0:14992:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.138@tcp lock: ffff8cb082044600/0xca7fc0c411f9465f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xca7fc0c411f94666 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788797156.829744:0:14992:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8cb05ca63800 from 1 10000000:01000000:3.0:1788797156.829747:0:14992:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788797156.829790:0:14992:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.138@tcp lock: ffff8cb077c68200/0xca7fc0c411f9467b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797156.829798:0:14992:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.138@tcp lock: ffff8cb077c68200/0xca7fc0c411f9467b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797156.829808:0:14992:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.138@tcp lock: ffff8cb077c68200/0xca7fc0c411f9467b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788797156.829843:0:14992:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb0778dc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73f6407e-c8af-46fc-9cc4-279490305b80:14992:1875689374574336:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788797156.829908:0:14992:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788797156.829957:0:14992:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb077d10000 going to sleep for 11 seconds 00000100:00100000:1.0:1788797156.830080:0:14304:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374574336 00000100:00100000:1.0:1788797156.830087:0:14304:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374574336 00000100:00100000:1.0:1788797156.830126:0:14304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788797156.830135:0:14304:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb06fb85450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73f6407e-c8af-46fc-9cc4-279490305b80+14:14992:x1875689374574336:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788797156.830147:0:14304:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788797156.830159:0:14304:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cb082045000/0xca7fc0c411f94682 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xca7fc0c411f9467b expref: -99 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797156.830185:0:14304:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cb082045000/0xca7fc0c411f94682 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xca7fc0c411f9467b expref: 15 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797156.830196:0:14304:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cb082045000/0xca7fc0c411f94682 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xca7fc0c411f9467b expref: 15 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797156.830205:0:14304:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb082045000, rc 0) 00000100:00100000:1.0:1788797156.830239:0:14304:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb06fb85450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73f6407e-c8af-46fc-9cc4-279490305b80+15:14992:x1875689374574336:12345-0@lo:101:mount.lustre.0 Request processed in 106us (331us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797156.830246:0:14304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788797156.830429:0:14992:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb0778dc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73f6407e-c8af-46fc-9cc4-279490305b80:14992:1875689374574336:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788797156.830448:0:14992:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.138@tcp lock: ffff8cb077c68200/0xca7fc0c411f9467b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xca7fc0c411f94682 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797156.830458:0:14992:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.138@tcp lock: ffff8cb077c68200/0xca7fc0c411f9467b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xca7fc0c411f94682 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788797156.831328:0:14992:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:3.0:1788797156.831897:0:14992:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788797156.834288:0:14992:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:3.0:1788797156.834393:0:14992:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:3.0:1788797156.834478:0:14992:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:3.0:1788797156.834486:0:14992:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:3.0:1788797156.834598:0:14992:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb0778dc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73f6407e-c8af-46fc-9cc4-279490305b80:14992:1875689374574464:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788797156.834903:0:14992:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788797156.835051:0:14992:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb077d10000 going to sleep for 11 seconds 00000100:00100000:2.0:1788797156.840537:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374574464 00000100:00100000:2.0:1788797156.840555:0:14303:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374574464 00000100:00100000:2.0:1788797156.840744:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788797156.840759:0:14303:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb06fb84850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73f6407e-c8af-46fc-9cc4-279490305b80+15:14992:x1875689374574464:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788797156.841223:0:14303:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb06fb84850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73f6407e-c8af-46fc-9cc4-279490305b80+15:14992:x1875689374574464:12345-0@lo:501:mount.lustre.0 Request processed in 465us (6318us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797156.841232:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788797156.841351:0:14992:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb0778dc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73f6407e-c8af-46fc-9cc4-279490305b80:14992:1875689374574464:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788797156.841409:0:14992:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb0778dc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73f6407e-c8af-46fc-9cc4-279490305b80:14992:1875689374574592:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788797156.841462:0:14992:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788797156.844603:0:14992:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb077d10000 going to sleep for 11 seconds 00000100:00100000:1.0:1788797156.847276:0:14304:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374574592 00000100:00100000:1.0:1788797156.847295:0:14304:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374574592 00000100:00100000:1.0:1788797156.847393:0:14304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788797156.847407:0:14304:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb06fb87c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73f6407e-c8af-46fc-9cc4-279490305b80+15:14992:x1875689374574592:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788797156.847759:0:14304:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb06fb87c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73f6407e-c8af-46fc-9cc4-279490305b80+15:14992:x1875689374574592:12345-0@lo:503:mount.lustre.0 Request processed in 355us (6296us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797156.847777:0:14304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788797156.849781:0:14992:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb0778dc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73f6407e-c8af-46fc-9cc4-279490305b80:14992:1875689374574592:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788797156.850540:0:14992:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788797156.850640:0:14992:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb0778dc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73f6407e-c8af-46fc-9cc4-279490305b80:14992:1875689374574720:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788797156.850720:0:14992:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788797156.850782:0:14992:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb077d10000 going to sleep for 11 seconds 00000100:00100000:1.0:1788797156.850895:0:14304:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374574720 00000100:00100000:1.0:1788797156.850911:0:14304:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374574720 00000100:00100000:1.0:1788797156.850949:0:14304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788797156.850959:0:14304:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb06fb86050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73f6407e-c8af-46fc-9cc4-279490305b80+15:14992:x1875689374574720:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788797156.851165:0:14304:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb06fb86050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73f6407e-c8af-46fc-9cc4-279490305b80+15:14992:x1875689374574720:12345-0@lo:502:mount.lustre.0 Request processed in 206us (444us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797156.851173:0:14304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788797156.854920:0:14992:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb0778dc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73f6407e-c8af-46fc-9cc4-279490305b80:14992:1875689374574720:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788797156.856460:0:14992:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:3.0:1788797156.856570:0:14992:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:3.0:1788797156.860157:0:14992:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:3.0:1788797156.860258:0:14992:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:3.0:1788797156.860294:0:14992:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:3.0:1788797156.860339:0:14992:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:3.0:1788797156.860372:0:14992:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:3.0:1788797156.860402:0:14992:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:3.0:1788797156.860456:0:14992:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb0778dc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73f6407e-c8af-46fc-9cc4-279490305b80:14992:1875689374574848:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788797156.860551:0:14992:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788797156.860628:0:14992:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb077d10000 going to sleep for 11 seconds 00000100:00100000:1.0:1788797156.861254:0:14304:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374574848 00000100:00100000:1.0:1788797156.861264:0:14304:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374574848 00000100:00100000:1.0:1788797156.861318:0:14304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788797156.861328:0:14304:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb06fb86450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73f6407e-c8af-46fc-9cc4-279490305b80+15:14992:x1875689374574848:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788797156.861549:0:14304:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb06fb86450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73f6407e-c8af-46fc-9cc4-279490305b80+15:14992:x1875689374574848:12345-0@lo:502:mount.lustre.0 Request processed in 223us (997us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797156.861557:0:14304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788797156.863020:0:14992:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb0778dc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73f6407e-c8af-46fc-9cc4-279490305b80:14992:1875689374574848:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788797156.863237:0:14992:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:3.0:1788797156.863254:0:14992:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:3.0:1788797156.864372:0:15010:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788797156.864384:0:15010:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788797156.864386:0:15010:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788797156.864392:0:15010:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8cb05ca63800 00000020:00000080:3.0:1788797156.864394:0:15010:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788797156.864401:0:15010:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788797156.864404:0:15010:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788797156.864405:0:15010:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1788797156.864407:0:15010:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788797156.864410:0:15010:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788797156.864411:0:15010:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788797156.864414:0:15010:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8cb05ca63800 00000020:00000080:3.0:1788797156.864430:0:15010:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788797156.864500:0:15010:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788797156.864504:0:15010:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788797156.864506:0:15010:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1788797156.864508:0:15010:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788797156.864511:0:15010:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788797156.864513:0:15010:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788797156.864517:0:15010:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8cb05ca63800 00000020:00000080:3.0:1788797156.864519:0:15010:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788797156.864555:0:15010:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788797156.864557:0:15010:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788797156.864559:0:15010:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1788797156.864562:0:15010:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:1.0:1788797156.875608:0:14992:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:1.0:1788797156.875662:0:14992:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.138@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788797156.875690:0:14992:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.138@tcp lock: ffff8cb077c68200/0xca7fc0c411f9467b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xca7fc0c411f94682 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797156.875705:0:14992:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.138@tcp lock: ffff8cb077c68200/0xca7fc0c411f9467b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xca7fc0c411f94682 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788797156.875809:0:14992:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1788797156.875813:0:14992:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8cb05ca63800 10000000:01000000:1.0:1788797156.875817:0:14992:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8cb05ca63800 10000000:01000000:1.0:1788797156.875822:0:14992:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788797156.875831:0:14992:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8cb05ca63800 from 1 10000000:01000000:1.0:1788797156.875833:0:14992:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788797156.875917:0:14992:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.138@tcp lock: ffff8cb082045e00/0xca7fc0c411f94689 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797156.875934:0:14992:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.138@tcp lock: ffff8cb082045e00/0xca7fc0c411f94689 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797156.875947:0:14992:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.138@tcp lock: ffff8cb082045e00/0xca7fc0c411f94689 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788797156.875975:0:14992:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb0795c4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73f6407e-c8af-46fc-9cc4-279490305b80:14992:1875689374574976:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788797156.876079:0:14992:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788797156.876124:0:14304:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374574976 00000100:00100000:1.0:1788797156.876132:0:14304:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374574976 00000100:00100000:1.0:1788797156.876188:0:14304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788797156.876197:0:14304:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb06fb86850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73f6407e-c8af-46fc-9cc4-279490305b80+15:14992:x1875689374574976:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788797156.876214:0:14304:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788797156.876229:0:14304:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cb082045200/0xca7fc0c411f94690 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xca7fc0c411f94689 expref: -99 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797156.876256:0:14304:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cb082045200/0xca7fc0c411f94690 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xca7fc0c411f94689 expref: 16 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797156.876268:0:14304:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cb082045200/0xca7fc0c411f94690 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xca7fc0c411f94689 expref: 16 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797156.876275:0:14304:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb082045200, rc 0) 00000100:00100000:1.0:1788797156.876310:0:14304:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb06fb86850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73f6407e-c8af-46fc-9cc4-279490305b80+16:14992:x1875689374574976:12345-0@lo:101:mount.lustre.0 Request processed in 114us (231us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797156.876317:0:14304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788797156.876374:0:14992:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb06f48fd80 going to sleep for 11 seconds 00000100:00100000:1.0:1788797156.876408:0:14992:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb0795c4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73f6407e-c8af-46fc-9cc4-279490305b80:14992:1875689374574976:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788797156.876425:0:14992:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.138@tcp lock: ffff8cb082045e00/0xca7fc0c411f94689 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xca7fc0c411f94690 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797156.876436:0:14992:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.138@tcp lock: ffff8cb082045e00/0xca7fc0c411f94689 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xca7fc0c411f94690 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788797156.877114:0:14992:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:1.0:1788797156.877480:0:14992:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788797156.877754:0:14992:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:1.0:1788797156.877810:0:14992:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:1.0:1788797156.877841:0:14992:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:1.0:1788797156.877885:0:14992:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:1.0:1788797156.877921:0:14992:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:1.0:1788797156.877968:0:14992:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:1.0:1788797156.878003:0:14992:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:1.0:1788797156.878063:0:14992:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:1.0:1788797156.878127:0:14992:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:1.0:1788797156.878167:0:14992:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:1.0:1788797156.878202:0:14992:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:1.0:1788797156.878256:0:14992:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:1.0:1788797156.878309:0:14992:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:1.0:1788797156.878346:0:14992:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:1.0:1788797156.888594:0:14992:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:1.0:1788797156.888759:0:14992:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:1.0:1788797156.888804:0:14992:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:1.0:1788797156.888848:0:14992:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:1.0:1788797156.888883:0:14992:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:1.0:1788797156.888914:0:14992:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:1.0:1788797156.888958:0:14992:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:1.0:1788797156.888991:0:14992:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:1.0:1788797156.889018:0:14992:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:1.0:1788797156.891002:0:14992:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:1.0:1788797156.891063:0:14992:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:1.0:1788797156.891098:0:14992:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:1.0:1788797156.891151:0:14992:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:1.0:1788797156.891189:0:14992:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:1.0:1788797156.891309:0:14992:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:1.0:1788797156.891317:0:14992:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:1.0:1788797156.891438:0:14992:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb0795c4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73f6407e-c8af-46fc-9cc4-279490305b80:14992:1875689374575104:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788797156.891522:0:14992:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788797156.891582:0:14304:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374575104 00000100:00100000:1.0:1788797156.891589:0:14304:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374575104 00000100:00100000:1.0:1788797156.891635:0:14304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788797156.891644:0:14304:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb06fb87450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73f6407e-c8af-46fc-9cc4-279490305b80+16:14992:x1875689374575104:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788797156.891873:0:14304:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb06fb87450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73f6407e-c8af-46fc-9cc4-279490305b80+16:14992:x1875689374575104:12345-0@lo:501:mount.lustre.0 Request processed in 229us (351us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797156.891881:0:14304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788797156.891928:0:14992:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb06f48fd80 going to sleep for 11 seconds 00000100:00100000:1.0:1788797156.891947:0:14992:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb0795c4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73f6407e-c8af-46fc-9cc4-279490305b80:14992:1875689374575104:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788797156.891976:0:14992:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb0795c4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73f6407e-c8af-46fc-9cc4-279490305b80:14992:1875689374575232:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788797156.892008:0:14992:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788797156.892048:0:14305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374575232 00000100:00100000:1.0:1788797156.892052:0:14305:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374575232 00000100:00100000:1.0:1788797156.892075:0:14304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788797156.892081:0:14304:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb06fb85850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73f6407e-c8af-46fc-9cc4-279490305b80+16:14992:x1875689374575232:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788797156.892207:0:14304:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb06fb85850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73f6407e-c8af-46fc-9cc4-279490305b80+16:14992:x1875689374575232:12345-0@lo:503:mount.lustre.0 Request processed in 125us (197us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797156.892214:0:14304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788797156.892256:0:14992:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb047c30e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788797156.892270:0:14992:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb0795c4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73f6407e-c8af-46fc-9cc4-279490305b80:14992:1875689374575232:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788797156.892750:0:14992:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788797156.892828:0:14992:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb0795c4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73f6407e-c8af-46fc-9cc4-279490305b80:14992:1875689374575360:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788797156.892870:0:14992:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788797156.892905:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374575360 00000100:00100000:1.0:1788797156.900249:0:14303:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374575360 00000100:00100000:1.0:1788797156.900404:0:14304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788797156.900418:0:14304:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb06fb85050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73f6407e-c8af-46fc-9cc4-279490305b80+16:14992:x1875689374575360:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788797156.900741:0:14304:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb06fb85050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73f6407e-c8af-46fc-9cc4-279490305b80+16:14992:x1875689374575360:12345-0@lo:502:mount.lustre.0 Request processed in 326us (7871us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797156.900749:0:14304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788797156.901115:0:14992:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb06cd99cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788797156.901147:0:14992:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb0795c4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73f6407e-c8af-46fc-9cc4-279490305b80:14992:1875689374575360:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788797156.901458:0:14992:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:2.0:1788797156.901520:0:14992:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:2.0:1788797156.901553:0:14992:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:2.0:1788797156.901611:0:14992:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:2.0:1788797156.903085:0:14992:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:2.0:1788797156.903188:0:14992:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:2.0:1788797156.903242:0:14992:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:2.0:1788797156.903277:0:14992:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:2.0:1788797156.903335:0:14992:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:2.0:1788797156.903372:0:14992:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:2.0:1788797156.903401:0:14992:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:2.0:1788797156.903448:0:14992:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:2.0:1788797156.903481:0:14992:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:2.0:1788797156.903515:0:14992:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:2.0:1788797156.903560:0:14992:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:2.0:1788797156.903593:0:14992:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:2.0:1788797156.903623:0:14992:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:2.0:1788797156.903666:0:14992:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:2.0:1788797156.903696:0:14992:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:2.0:1788797156.903725:0:14992:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:2.0:1788797156.903779:0:14992:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:2.0:1788797156.903813:0:14992:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:2.0:1788797156.904162:0:14992:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:2.0:1788797156.904212:0:14992:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:2.0:1788797156.904243:0:14992:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:2.0:1788797156.904276:0:14992:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:2.0:1788797156.904349:0:14992:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:2.0:1788797156.904384:0:14992:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:2.0:1788797156.904415:0:14992:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:2.0:1788797156.904461:0:14992:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:2.0:1788797156.904499:0:14992:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:2.0:1788797156.904534:0:14992:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:2.0:1788797156.904570:0:14992:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:2.0:1788797156.904615:0:14992:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:2.0:1788797156.904652:0:14992:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:2.0:1788797156.904696:0:14992:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:2.0:1788797156.904742:0:14992:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:2.0:1788797156.904787:0:14992:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:2.0:1788797156.904847:0:14992:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:2.0:1788797156.904883:0:14992:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:2.0:1788797156.904941:0:14992:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb0795d9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73f6407e-c8af-46fc-9cc4-279490305b80:14992:1875689374575488:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788797156.905057:0:14992:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788797156.905112:0:14992:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb0484c0f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788797156.911581:0:14305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374575488 00000100:00100000:3.0:1788797156.911628:0:14305:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374575488 00000100:00100000:3.0:1788797156.911752:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788797156.911774:0:14305:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb06fb87050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73f6407e-c8af-46fc-9cc4-279490305b80+16:14992:x1875689374575488:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788797156.912199:0:14305:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb06fb87050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73f6407e-c8af-46fc-9cc4-279490305b80+16:14992:x1875689374575488:12345-0@lo:502:mount.lustre.0 Request processed in 436us (7170us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797156.912209:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788797156.912832:0:14992:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb0795d9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73f6407e-c8af-46fc-9cc4-279490305b80:14992:1875689374575488:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788797156.913010:0:14992:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:2.0:1788797156.913054:0:14992:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:3.0:1788797156.924264:0:15015:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1788797156.924284:0:15015:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff8cb048f70000) 00000020:00000080:3.0:1788797156.924307:0:15015:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:3.0:1788797156.924420:0:15015:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8cb05ca63800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1788797156.924426:0:15015:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8cb05ca63800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1788797156.924428:0:15015:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8cb05ca63800 3 00010000:00080000:3.0:1788797156.924466:0:15015:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8cb04550f800@lustre-MDT0000-lwp-OST0000: add connection 192.168.204.138@tcp at head 00000100:00080000:2.0:1788797156.925167:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788797156.925173:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788797156.925176:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788797156.925179:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788797156.925284:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb0795d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3301:1875689374575616:0@lo:400:kworker.0 00000100:00100000:1.0:1788797156.925379:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788797156.927918:0:15015:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-4 is initialized 00000020:00000080:3.0:1788797156.930688:0:15015:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:3.0:1788797156.930966:0:15015:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788797156.930993:0:15015:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xca7fc0c411f9469e 00000100:00080000:3.0:1788797156.931006:0:15015:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788797156.931017:0:15015:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8cb04550f800 using connection 192.168.204.138@tcp/0@lo 00000100:00100000:2.0:1788797156.931133:0:14309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374575616 00000100:00100000:2.0:1788797156.931144:0:14309:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374575616 00000100:00100000:2.0:1788797156.931197:0:14309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788797156.931208:0:14309:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0795c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1875689374575616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788797156.933438:0:15015:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cb0778dc700 x1875689374575744/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788797156.933473:0:15015:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1788797156.933643:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb0778dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3299:1875689374575744:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788797156.933732:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788797156.934278:0:14311:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1788797156.934287:0:14311:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:2.0:1788797156.938201:0:14309:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0795c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1875689374575616:12345-0@lo:400:kworker.0 Request processed in 6886us (12712us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797156.938304:0:14309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:2.0:1788797156.938359:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788797156.938365:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788797156.938368:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788797156.938371:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788797156.938404:0:14309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374575744 00000100:00100000:2.0:1788797156.938413:0:14309:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374575744 00000100:00100000:2.0:1788797156.938458:0:14309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788797156.938466:0:14309:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb06f57ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3299:x1875689374575744:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1788797156.938496:0:14309:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 445 last 0 00000020:00000080:2.0:1788797156.938531:0:14309:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xca7fc0c411f946a5 00000004:00100000:2.0:1788797156.938549:0:14309:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788797156.938583:0:14309:0:(import.c:65:import_set_state_nolock()) ffff8cb049a83000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788797156.938658:0:14309:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb06f57ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1875689374575744:12345-0@lo:38:llog_process_th.0 Request processed in 192us (4925us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797156.938666:0:14309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1788797156.939484:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8cb0778dc700 x1875689374575744/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788797166 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788797156.939496:0:3299:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788797156.939505:0:3299:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:2.0:1788797156.939514:0:3299:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1788797156.939519:0:3299:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788797156.939521:0:3299:0:(import.c:65:import_set_state_nolock()) ffff8cb04550f800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788797156.939527:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb0778dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3299:1875689374575744:0@lo:38:llog_process_th.0 00010000:00080000:1.0:1788797156.942056:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8cb0795d9180 x1875689374575616/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788797172 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788797156.942083:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb0795d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3301:1875689374575616:0@lo:400:kworker.0 00000040:00080000:2.0:1788797156.957199:0:15015:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:0.0:1788797156.957333:0:14992:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:0.0:1788797156.957368:0:14992:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.138@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788797156.957389:0:14992:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.138@tcp lock: ffff8cb082045e00/0xca7fc0c411f94689 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xca7fc0c411f94690 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797156.957553:0:14992:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.138@tcp lock: ffff8cb082045e00/0xca7fc0c411f94689 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xca7fc0c411f94690 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1788797156.957612:0:14992:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1788797156.957614:0:14992:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788797156.957616:0:14992:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788797156.957617:0:14992:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788797156.957619:0:14992:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788797156.957620:0:14992:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788797156.957622:0:14992:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788797156.957623:0:14992:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788797156.957625:0:14992:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788797156.957629:0:14992:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:0.0:1788797156.957631:0:14992:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788797156.957632:0:14992:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788797156.957633:0:14992:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788797156.957634:0:14992:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788797156.957635:0:14992:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788797156.957636:0:14992:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788797156.957638:0:14992:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788797156.957639:0:14992:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788797156.957639:0:14992:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788797156.957668:0:14992:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1788797156.957688:0:14992:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb06f57dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73f6407e-c8af-46fc-9cc4-279490305b80:14992:1875689374575872:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788797156.957847:0:14992:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788797156.957940:0:14992:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb0698103c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788797156.960933:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374575872 00000100:00100000:1.0:1788797156.960952:0:14303:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374575872 00000100:00100000:1.0:1788797156.961930:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788797156.961944:0:14303:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb06fb84050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73f6407e-c8af-46fc-9cc4-279490305b80+16:14992:x1875689374575872:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788797156.961984:0:14303:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1788797156.962000:0:14303:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1788797157.028554:0:14303:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788797157.028671:0:14303:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:0.0:1788797157.035395:0:14325:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788797157.035407:0:14325:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788797157.035462:0:14325:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cb042ea3000/0xca7fc0c411f946ac lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797157.035489:0:14325:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cb082044200/0xca7fc0c411f94619 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xca7fc0c411f94612 expref: 16 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797157.035500:0:14325:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8cb042ea3000/0xca7fc0c411f946ac lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797157.035549:0:14325:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cb082044200/0xca7fc0c411f94619 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xca7fc0c411f94612 expref: 16 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797157.035580:0:14325:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8cb082044200/0xca7fc0c411f94619 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xca7fc0c411f94612 expref: 16 pid: 14303 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788797157.035598:0:14325:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb06f57e680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14325:1875689374576000:0@lo:104: 00000100:00100000:0.0:1788797157.035684:0:14325:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788797157.035767:0:14325:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb0698100c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788797157.036113:0:14293:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374576000 00000100:00100000:2.0:1788797157.036125:0:14293:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374576000 00000100:00100000:2.0:1788797157.036177:0:14293:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788797157.036187:0:14293:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb06f57ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:73f6407e-c8af-46fc-9cc4-279490305b80+3:14325:x1875689374576000:12345-0@lo:104: 00010000:00010000:2.0:1788797157.036204:0:14293:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.138@tcp lock: ffff8cb077c69a00/0xca7fc0c411f94612 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xca7fc0c411f94619 expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797157.036283:0:14293:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788797157.036290:0:14293:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb06f57ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:73f6407e-c8af-46fc-9cc4-279490305b80+3:14325:x1875689374576000:12345-0@lo:104: Request processed in 104us (605us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797157.036297:0:14293:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:2.0:1788797157.036322:0:14298:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788797157.036329:0:14298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.138@tcp lock: ffff8cb077c69a00/0xca7fc0c411f94612 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xca7fc0c411f94619 expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797157.036337:0:14298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb077c69a00 already unused, calling callback (ffffffffc1adac20) 10000000:00010000:2.0:1788797157.036342:0:14298:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.138@tcp lock: ffff8cb077c69a00/0xca7fc0c411f94612 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xca7fc0c411f94619 expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797157.036353:0:14298:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.138@tcp lock: ffff8cb077c69a00/0xca7fc0c411f94612 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xca7fc0c411f94619 expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788797157.036361:0:14298:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.138@tcp lock: ffff8cb077c69a00/0xca7fc0c411f94612 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xca7fc0c411f94619 expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788797157.036367:0:14298:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788797157.036403:0:14298:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.138@tcp lock: ffff8cb077c69a00/0xca7fc0c411f94612 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca7fc0c411f94619 expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797157.036410:0:14298:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788797157.036438:0:14298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.138@tcp lock: ffff8cb077c69a00/0xca7fc0c411f94612 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca7fc0c411f94619 expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797157.036446:0:14298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.138@tcp lock: ffff8cb077c69a00/0xca7fc0c411f94612 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca7fc0c411f94619 expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797157.036478:0:14298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788797157.036480:0:14298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788797157.036482:0:14298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788797157.036502:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb0795d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:73f6407e-c8af-46fc-9cc4-279490305b80:3302:1875689374576128:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788797157.036538:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788797157.037431:0:14295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374576128 00000100:00100000:0.0:1788797157.037441:0:14295:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374576128 00010000:00010000:0.0:1788797157.037471:0:14295:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cb082044200/0xca7fc0c411f94619 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xca7fc0c411f94612 expref: 17 pid: 14303 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788797157.037505:0:14295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788797157.037513:0:14295:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0795d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:73f6407e-c8af-46fc-9cc4-279490305b80+17:3302:x1875689374576128:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788797157.037524:0:14295:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788797157.037530:0:14295:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cb082044200/0xca7fc0c411f94619 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xca7fc0c411f94612 expref: 17 pid: 14303 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797157.037541:0:14295:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cb082044200/0xca7fc0c411f94619 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xca7fc0c411f94612 expref: 17 pid: 14303 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797157.037593:0:14295:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8cb042ea3000/0xca7fc0c411f946ac lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797157.037601:0:14295:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cb042ea3000/0xca7fc0c411f946ac lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788797157.037618:0:14295:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.005413833s 00010000:00010000:0.0:1788797157.037624:0:14295:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cb042ea3000/0xca7fc0c411f946ac lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797157.037632:0:14295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cb042ea3000/0xca7fc0c411f946ac lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797157.037638:0:14295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cb042ea3000/0xca7fc0c411f946ac lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797157.037644:0:14295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cb042ea3000/0xca7fc0c411f946ac lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797157.037651:0:14295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb042ea3000 already unused, calling callback (ffffffffc14d98b0) 00010000:00010000:0.0:1788797157.037656:0:14295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cb042ea3000/0xca7fc0c411f946ac lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797157.037664:0:14295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cb042ea3000/0xca7fc0c411f946ac lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797157.037673:0:14295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cb042ea3000/0xca7fc0c411f946ac lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797157.037683:0:14295:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788797157.037738:0:14295:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0795d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:73f6407e-c8af-46fc-9cc4-279490305b80+17:3302:x1875689374576128:12345-0@lo:103:ldlm_bl.0 Request processed in 225us (1198us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797157.039683:0:14295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788797157.039786:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb0795d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:73f6407e-c8af-46fc-9cc4-279490305b80:3302:1875689374576128:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788797157.039835:0:14325:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cb082044200/0xca7fc0c411f94619 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xca7fc0c411f94612 expref: 16 pid: 14303 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788797157.039984:0:14325:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb06f57e680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14325:1875689374576000:0@lo:104: 00010000:00010000:0.0:1788797157.040006:0:14325:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8cb042ea3000/0xca7fc0c411f946ac lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797157.040016:0:14325:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8cb042ea3000/0xca7fc0c411f946ac lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797157.040023:0:14325:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cb042ea3000/0xca7fc0c411f946ac lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797157.040045:0:14325:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cb042ea3000/0xca7fc0c411f946ac lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788797157.060108:0:14303:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb06fb84050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73f6407e-c8af-46fc-9cc4-279490305b80+15:14992:x1875689374575872:12345-0@lo:253:mount.lustre.0 Request processed in 98144us (102237us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797157.060128:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788797157.060366:0:14992:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb06f57dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73f6407e-c8af-46fc-9cc4-279490305b80:14992:1875689374575872:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788797157.060382:0:14992:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1788797157.060386:0:14992:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788797157.060388:0:14992:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788797157.060390:0:14992:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788797157.060391:0:14992:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788797157.060392:0:14992:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788797157.060394:0:14992:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788797157.060396:0:14992:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788797157.060398:0:14992:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788797157.060399:0:14992:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788797157.060414:0:14992:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1788797157.067710:0:14992:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:0.0:1788797157.068628:0:14992:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1788797157.069002:0:14992:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:0.0:1788797157.069663:0:14992:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1788797157.070661:0:14992:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:0.0:1788797157.071543:0:14992:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:0.0:1788797157.072892:0:14992:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:0.0:1788797157.167124:0:14992:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:0.0:1788797157.167137:0:14992:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:0.0:1788797157.167197:0:14992:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1788797157.167422:0:14992:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.138@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1788797157.167446:0:14992:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=48 00000080:00000004:0.0:1788797157.167496:0:14992:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:2.0:1788797157.170517:0:14299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788797158.194392:0:14298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788797158.899111:0:14307:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788797158.899120:0:14307:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8cb07906b800 from 7 10000000:01000000:2.0:1788797158.899125:0:14307:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788797158.899172:0:14307:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.138@tcp lock: ffff8cb040031e00/0xca7fc0c411f946b3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797158.899183:0:14307:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.138@tcp lock: ffff8cb040031e00/0xca7fc0c411f946b3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797158.899193:0:14307:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.138@tcp lock: ffff8cb040031e00/0xca7fc0c411f946b3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788797158.899233:0:14307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb0795db480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73f6407e-c8af-46fc-9cc4-279490305b80:14307:1875689374576256:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788797158.899303:0:14307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788797158.899361:0:14307:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb047c30e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788797158.899602:0:14305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374576256 00000100:00100000:3.0:1788797158.899612:0:14305:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374576256 00000100:00100000:3.0:1788797158.899682:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788797158.899693:0:14305:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb06fb87850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73f6407e-c8af-46fc-9cc4-279490305b80+15:14307:x1875689374576256:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788797158.899707:0:14305:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788797158.899733:0:14305:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cb077c69400/0xca7fc0c411f946ba lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xca7fc0c411f946b3 expref: -99 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797158.899762:0:14305:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cb077c69400/0xca7fc0c411f946ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xca7fc0c411f946b3 expref: 16 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797158.899775:0:14305:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cb077c69400/0xca7fc0c411f946ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xca7fc0c411f946b3 expref: 16 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797158.899786:0:14305:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb077c69400, rc 0) 00000100:00100000:3.0:1788797158.899850:0:14305:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb06fb87850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73f6407e-c8af-46fc-9cc4-279490305b80+16:14307:x1875689374576256:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 159us (546us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797158.899857:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788797158.900079:0:14307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb0795db480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73f6407e-c8af-46fc-9cc4-279490305b80:14307:1875689374576256:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788797158.900095:0:14307:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.138@tcp lock: ffff8cb040031e00/0xca7fc0c411f946b3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xca7fc0c411f946ba expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797158.900114:0:14307:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.138@tcp lock: ffff8cb040031e00/0xca7fc0c411f946b3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xca7fc0c411f946ba expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788797158.900179:0:14307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb0795c4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73f6407e-c8af-46fc-9cc4-279490305b80:14307:1875689374576384:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1788797158.900222:0:14307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788797158.900254:0:14307:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb043716b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788797158.900513:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374576384 00000100:00100000:3.0:1788797158.900529:0:14303:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374576384 00000100:00100000:3.0:1788797158.900563:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788797158.900570:0:14303:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb06fb85c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73f6407e-c8af-46fc-9cc4-279490305b80+16:14307:x1875689374576384:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1788797158.900586:0:14303:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788797158.900603:0:14303:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788797158.900606:0:14303:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:3.0:1788797158.900697:0:14303:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb06fb85c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73f6407e-c8af-46fc-9cc4-279490305b80+16:14307:x1875689374576384:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 126us (474us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797158.900704:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788797158.900756:0:14307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb0795c4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73f6407e-c8af-46fc-9cc4-279490305b80:14307:1875689374576384:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1788797158.900836:0:14307:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.138@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788797158.900846:0:14307:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.138@tcp lock: ffff8cb040031e00/0xca7fc0c411f946b3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xca7fc0c411f946ba expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797158.900854:0:14307:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.138@tcp lock: ffff8cb040031e00/0xca7fc0c411f946b3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xca7fc0c411f946ba expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797159.220907:0:14299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788797160.245365:0:14298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788797161.273534:0:14299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788797162.034569:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788797162.034577:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788797162.034579:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788797162.034582:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788797162.034615:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788797162.034636:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb0795c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:73f6407e-c8af-46fc-9cc4-279490305b80:3302:1875689374576512:0@lo:400:kworker.0 00000100:00100000:1.0:1788797162.034723:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788797162.034787:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb0795c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3300:1875689374576640:0@lo:400:kworker.0 00000100:00100000:1.0:1788797162.034819:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788797162.034837:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788797162.034842:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb0795c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3300:1875689374576768:0@lo:400:kworker.0 00000100:00100000:1.0:1788797162.034866:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788797162.034897:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374576512 00000100:00100000:1.0:1788797162.034905:0:14303:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374576512 00000100:00100000:1.0:1788797162.034955:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788797162.034964:0:14303:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb079f76850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73f6407e-c8af-46fc-9cc4-279490305b80+16:3302:x1875689374576512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788797162.035020:0:14303:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb079f76850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73f6407e-c8af-46fc-9cc4-279490305b80+16:3302:x1875689374576512:12345-0@lo:400:kworker.0 Request processed in 56us (297us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797162.035067:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788797162.035132:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb0795c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:73f6407e-c8af-46fc-9cc4-279490305b80:3302:1875689374576512:0@lo:400:kworker.0 00000100:00100000:2.0:1788797162.035613:0:14309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374576640 00000100:00100000:2.0:1788797162.035619:0:14309:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374576640 00000100:00100000:2.0:1788797162.035658:0:14309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374576768 00000100:00100000:2.0:1788797162.035670:0:14309:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374576768 00000100:00100000:2.0:1788797162.035709:0:14309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788797162.035717:0:14309:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0795c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1875689374576640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788797162.035771:0:14309:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0795c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1875689374576640:12345-0@lo:400:kworker.0 Request processed in 55us (951us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797162.035777:0:14309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788797162.035789:0:14309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788797162.035794:0:14309:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0795c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1875689374576768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788797162.035822:0:14309:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0795c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1875689374576768:12345-0@lo:400:kworker.0 Request processed in 28us (955us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797162.035829:0:14309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1788797162.036338:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cb0795c6300 x1875689374576768/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788797178 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788797162.036353:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb0795c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3300:1875689374576768:0@lo:400:kworker.0 00010000:00080000:0.0:1788797162.036364:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cb0795c5f80 x1875689374576640/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788797178 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788797162.036371:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb0795c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3300:1875689374576640:0@lo:400:kworker.0 00000100:00080000:1.0:1788797162.036783:0:14306:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788797162.290170:0:14298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788797163.317922:0:14299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788797163.702202:0:14343:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788797164.338335:0:14298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788797165.118525:0:15369:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg438-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1788797165.365219:0:14299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788797166.130426:0:3299:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788797151/real 1788797151] req@ffff8cb0778dea00 x1875689374572544/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788797166 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788797166.130463:0:3299:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8cb0778dea00 x1875689374572544/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788797166 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788797166.130628:0:3299:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788797151/real 1788797151] req@ffff8cb0778dd180 x1875689374572672/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788797166 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788797166.130643:0:3299:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8cb0778dd180 x1875689374572672/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788797166 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788797166.130684:0:3299:0:(import.c:65:import_set_state_nolock()) ffff8cb0779d6000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788797166.130705:0:3299:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788797166.130709:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb0778dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3299:1875689374572544:0@lo:8:kworker.0 00000100:00080000:2.0:1788797166.130716:0:3299:0:(import.c:65:import_set_state_nolock()) ffff8cb05ca5a000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788797166.130721:0:3299:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788797166.130924:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb0778dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3299:1875689374572672:0@lo:8:kworker.0 00000100:00100000:1.0:1788797166.131179:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb06f57e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:73f6407e-c8af-46fc-9cc4-279490305b80:3302:1875689374576896:0@lo:400:kworker.0 00000100:00100000:1.0:1788797166.131249:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788797166.132019:0:14304:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374576896 00000100:00100000:2.0:1788797166.132071:0:14304:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374576896 00000100:00100000:2.0:1788797166.132138:0:14304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788797166.132150:0:14304:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb079f75c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73f6407e-c8af-46fc-9cc4-279490305b80+16:3302:x1875689374576896:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1788797166.132308:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788797166.132314:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1788797166.132318:0:36:0:(import.c:65:import_set_state_nolock()) ffff8cb0779d6000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788797166.132322:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 440 00000100:00080000:0.0:1788797166.132326:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1788797166.132335:0:36:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8cb0779d6000 using connection 192.168.204.138@tcp/0@lo 00000100:00100000:0.0:1788797166.132363:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cb06f57d500 x1875689374577024/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788797166.132382:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788797166.132392:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1788797166.132394:0:36:0:(import.c:65:import_set_state_nolock()) ffff8cb05ca5a000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788797166.132398:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 440 00000100:00080000:0.0:1788797166.132547:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1788797166.132554:0:36:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8cb05ca5a000 using connection 192.168.204.138@tcp/0@lo 00000100:00100000:0.0:1788797166.132569:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cb06f57ea00 x1875689374577152/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788797166.136190:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb06f57d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875689374577280:0@lo:400:kworker.0 00000100:00100000:3.0:1788797166.136269:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788797166.136719:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb06f57d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3299:1875689374577024:0@lo:8:kworker.0 00000100:00100000:3.0:1788797166.136815:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788797166.136847:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb06f57ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3299:1875689374577152:0@lo:8:kworker.0 00000100:00100000:3.0:1788797166.136929:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788797166.136969:0:14309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374577280 00000100:00100000:3.0:1788797166.136977:0:14309:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374577280 00000100:00100000:3.0:1788797166.137131:0:14309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788797166.137142:0:14309:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0778df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875689374577280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788797166.137198:0:14309:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0778df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875689374577280:12345-0@lo:400:kworker.0 Request processed in 59us (931us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797166.137205:0:14309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1788797166.137248:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cb06f57d180 x1875689374577280/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788797182 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788797166.137261:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb06f57d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875689374577280:0@lo:400:kworker.0 00000100:00100000:2.0:1788797166.137706:0:14304:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb079f75c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73f6407e-c8af-46fc-9cc4-279490305b80+16:3302:x1875689374576896:12345-0@lo:400:kworker.0 Request processed in 5556us (6455us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797166.137716:0:14304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788797166.137758:0:14995:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374577024 00000100:00100000:0.0:1788797166.137763:0:14995:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374577024 00000100:00100000:0.0:1788797166.137783:0:14995:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374577152 00000100:00100000:0.0:1788797166.137785:0:14995:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374577152 00000100:00100000:0.0:1788797166.137795:0:14995:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788797166.137800:0:14995:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0778dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3299:x1875689374577024:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1788797166.137826:0:14995:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 455 last 0 00000020:00000080:0.0:1788797166.137852:0:14995:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xca7fc0c411f946c1 00002000:00100000:0.0:1788797166.137866:0:14995:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff8caf41993000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:0.0:1788797166.137870:0:14995:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:0.0:1788797166.137872:0:14995:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1788797166.138260:0:14995:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1788797166.138288:0:14995:0:(import.c:65:import_set_state_nolock()) ffff8caf41996000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788797166.138299:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb06f57e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:73f6407e-c8af-46fc-9cc4-279490305b80:3302:1875689374576896:0@lo:400:kworker.0 00000100:00100000:0.0:1788797166.138355:0:14995:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0778dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3299:x1875689374577024:12345-0@lo:8:kworker.0 Request processed in 553us (1539us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797166.138361:0:14995:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788797166.138375:0:14995:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788797166.138379:0:14995:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0778dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3299:x1875689374577152:12345-0@lo:8:kworker.0 00010000:00020000:0.0:1788797166.138389:0:14995:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00010000:00080000:3.0:1788797166.138574:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cb06f57d500 x1875689374577024/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788797186 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788797166.138595:0:3299:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788797166.138610:0:3299:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:3.0:1788797166.138619:0:3299:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1788797166.138625:0:3299:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1788797166.138627:0:3299:0:(import.c:65:import_set_state_nolock()) ffff8cb0779d6000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1788797166.138655:0:3299:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1788797166.138660:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb06f57d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3299:1875689374577024:0@lo:8:kworker.0 00000004:00080000:1.0:1788797166.138922:0:14331:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x240000400:0x6:0x0] 00000100:00100000:1.0:1788797166.138944:0:14331:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb0795c7800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14331:1875689374577536:0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1788797166.138983:0:14331:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788797166.139004:0:14331:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb043716600 going to sleep for 11 seconds 00000100:00100000:1.0:1788797166.139015:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788797166.139023:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb0795c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875689374577408:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788797166.139265:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788797166.139325:0:14996:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:1.0:1788797166.139332:0:14996:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:1.0:1788797166.139420:0:14996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374577536 00000100:00100000:1.0:1788797166.139425:0:14996:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374577536 00000100:00080000:1.0:1788797166.139494:0:14306:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788797166.139830:0:15405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788797166.139839:0:15405:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0795c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:14331:x1875689374577536:12345-0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1788797166.140721:0:14997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374577408 00000100:00100000:3.0:1788797166.140740:0:14997:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374577408 00000100:00100000:3.0:1788797166.140779:0:14997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788797166.140787:0:14997:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0795c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3301:x1875689374577408:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788797166.140816:0:14997:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788797166.140894:0:14997:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0795c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3301:x1875689374577408:12345-0@lo:13:osp-pre-0-0.0 Request processed in 107us (1628us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797166.140901:0:14997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1788797166.140955:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cb0795c5c00 x1875689374577408/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788797182 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788797166.140975:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb0795c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875689374577408:0@lo:13:osp-pre-0-0.0 00000004:00080000:3.0:1788797166.141378:0:14330:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1788797166.141667:0:14330:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 455147637733ns, next at 0ns, rc = 0 00000100:00100000:3.0:1788797166.167414:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb0778dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3301:1875689374577664:0@lo:400:kworker.0 00000100:00100000:3.0:1788797166.167711:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00080000:1.0:1788797166.168107:0:15405:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:1.0:1788797166.168115:0:15405:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:1.0:1788797166.168121:0:15405:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:7 to 0x240000400:33) 00000100:00100000:0.0:1788797166.171081:0:15017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374577664 00000100:00100000:0.0:1788797166.171095:0:15017:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374577664 00000100:00100000:0.0:1788797166.171161:0:15017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788797166.171173:0:15017:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0778de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1875689374577664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788797166.171265:0:15017:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0778de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1875689374577664:12345-0@lo:400:kworker.0 Request processed in 95us (3554us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797166.171272:0:15017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1788797166.171337:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cb0778dfb80 x1875689374577664/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788797182 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788797166.171352:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb0778dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3301:1875689374577664:0@lo:400:kworker.0 00000100:00100000:0.0:1788797166.185295:0:14995:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0778dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3299:x1875689374577152:12345-0@lo:8:kworker.0 Request processed in 46902us (48353us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788797166.185311:0:14995:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:0.0:1788797166.185368:0:3299:0:(import.c:65:import_set_state_nolock()) ffff8cb05ca5a000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788797166.185374:0:3299:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788797166.185378:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb06f57ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3299:1875689374577152:0@lo:8:kworker.0 00000100:00080000:0.0:1788797166.185439:0:14306:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00002000:00010000:0.0:1788797166.210827:0:15405:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788797166.210842:0:15405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000070aaeed/0xca7fc0c411f946c8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797166.210858:0:15405:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=455s v=(0 0) 00010000:00010000:0.0:1788797166.210862:0:15405:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788797166.210869:0:15405:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000070aaeed/0xca7fc0c411f946c8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797166.210900:0:15405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000070aaeed/0xca7fc0c411f946c8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797166.210911:0:15405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000070aaeed/0xca7fc0c411f946c8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797166.210919:0:15405:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000070aaeed/0xca7fc0c411f946c8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797166.210949:0:15405:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788797166.210964:0:14298:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788797166.210969:0:14298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000070aaeed/0xca7fc0c411f946c8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797166.211145:0:14298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb042ea2e00 already unused, calling callback (ffffffffc14d98b0) 00010000:00010000:0.0:1788797166.211150:0:14298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000070aaeed/0xca7fc0c411f946c8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797166.211160:0:14298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000070aaeed/0xca7fc0c411f946c8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797166.211180:0:14298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000070aaeed/0xca7fc0c411f946c8 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797166.211189:0:14298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000070aaeed/0xca7fc0c411f946c8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797166.211214:0:14298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788797166.211216:0:14298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788797166.211218:0:14298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788797166.211953:0:15405:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788797166.211960:0:15405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009392bfef/0xca7fc0c411f946cf lrc: 3/0,1 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797166.211970:0:15405:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=455s v=(0 0) 00010000:00010000:0.0:1788797166.211973:0:15405:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788797166.211978:0:15405:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009392bfef/0xca7fc0c411f946cf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797166.211989:0:15405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009392bfef/0xca7fc0c411f946cf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797166.211997:0:15405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009392bfef/0xca7fc0c411f946cf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797166.212003:0:15405:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009392bfef/0xca7fc0c411f946cf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797166.212025:0:15405:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788797166.213895:0:14299:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788797166.213915:0:14299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009392bfef/0xca7fc0c411f946cf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797166.214152:0:14299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb042ea3e00 already unused, calling callback (ffffffffc14d98b0) 00010000:00010000:0.0:1788797166.214158:0:14299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009392bfef/0xca7fc0c411f946cf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797166.214170:0:14299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009392bfef/0xca7fc0c411f946cf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797166.214200:0:14299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009392bfef/0xca7fc0c411f946cf lrc: 1/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797166.214207:0:14299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009392bfef/0xca7fc0c411f946cf lrc: 0/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797166.214237:0:14299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788797166.214239:0:14299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788797166.214242:0:14299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788797166.217679:0:15405:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788797166.217693:0:15405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007737607f/0xca7fc0c411f946d6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797166.217710:0:15405:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=455s v=(0 0) 00010000:00010000:0.0:1788797166.217715:0:15405:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788797166.217720:0:15405:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007737607f/0xca7fc0c411f946d6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797166.217734:0:15405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007737607f/0xca7fc0c411f946d6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797166.217752:0:15405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007737607f/0xca7fc0c411f946d6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797166.217760:0:15405:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007737607f/0xca7fc0c411f946d6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797166.217788:0:15405:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788797166.217917:0:14298:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788797166.217926:0:14298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007737607f/0xca7fc0c411f946d6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797166.217937:0:14298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb042ea3a00 already unused, calling callback (ffffffffc14d98b0) 00010000:00010000:2.0:1788797166.217941:0:14298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007737607f/0xca7fc0c411f946d6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797166.217952:0:14298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007737607f/0xca7fc0c411f946d6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797166.217974:0:14298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007737607f/0xca7fc0c411f946d6 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797166.217988:0:14298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007737607f/0xca7fc0c411f946d6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797166.218010:0:14298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788797166.218012:0:14298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788797166.218014:0:14298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788797166.218593:0:15405:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788797166.218601:0:15405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f98c5653/0xca7fc0c411f946dd lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797166.218613:0:15405:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=455s v=(0 0) 00010000:00010000:0.0:1788797166.218617:0:15405:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788797166.218621:0:15405:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f98c5653/0xca7fc0c411f946dd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797166.218633:0:15405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f98c5653/0xca7fc0c411f946dd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797166.218642:0:15405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f98c5653/0xca7fc0c411f946dd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797166.218650:0:15405:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f98c5653/0xca7fc0c411f946dd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797166.218683:0:15405:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788797166.218695:0:14299:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788797166.218701:0:14299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f98c5653/0xca7fc0c411f946dd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797166.218709:0:14299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb042ea2800 already unused, calling callback (ffffffffc14d98b0) 00010000:00010000:0.0:1788797166.218713:0:14299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f98c5653/0xca7fc0c411f946dd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797166.218721:0:14299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f98c5653/0xca7fc0c411f946dd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797166.218734:0:14299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f98c5653/0xca7fc0c411f946dd lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797166.218742:0:14299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f98c5653/0xca7fc0c411f946dd lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797166.218757:0:14299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788797166.218760:0:14299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788797166.218762:0:14299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788797166.219249:0:15405:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788797166.219255:0:15405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000448ef9a1/0xca7fc0c411f946e4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797166.219264:0:15405:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=455s v=(0 0) 00010000:00010000:0.0:1788797166.219272:0:15405:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788797166.219276:0:15405:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000448ef9a1/0xca7fc0c411f946e4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797166.219286:0:15405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000448ef9a1/0xca7fc0c411f946e4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797166.219294:0:15405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000448ef9a1/0xca7fc0c411f946e4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797166.219302:0:15405:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000448ef9a1/0xca7fc0c411f946e4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797166.219327:0:15405:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788797166.219665:0:14298:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788797166.219672:0:14298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000448ef9a1/0xca7fc0c411f946e4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797166.219682:0:14298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb042ea3400 already unused, calling callback (ffffffffc14d98b0) 00010000:00010000:2.0:1788797166.219686:0:14298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000448ef9a1/0xca7fc0c411f946e4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797166.219695:0:14298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000448ef9a1/0xca7fc0c411f946e4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797166.219708:0:14298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000448ef9a1/0xca7fc0c411f946e4 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797166.219716:0:14298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000448ef9a1/0xca7fc0c411f946e4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797166.219737:0:14298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788797166.219739:0:14298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788797166.219741:0:14298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788797166.219787:0:15405:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788797166.219793:0:15405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004302cdac/0xca7fc0c411f946eb lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797166.219801:0:15405:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=455s v=(0 0) 00010000:00010000:0.0:1788797166.219804:0:15405:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788797166.219809:0:15405:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004302cdac/0xca7fc0c411f946eb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797166.219817:0:15405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004302cdac/0xca7fc0c411f946eb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797166.219824:0:15405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004302cdac/0xca7fc0c411f946eb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797166.219839:0:15405:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004302cdac/0xca7fc0c411f946eb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797166.219854:0:15405:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788797166.219863:0:14299:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788797166.219866:0:14299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004302cdac/0xca7fc0c411f946eb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797166.219874:0:14299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb042ea2400 already unused, calling callback (ffffffffc14d98b0) 00010000:00010000:0.0:1788797166.219877:0:14299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004302cdac/0xca7fc0c411f946eb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797166.219885:0:14299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004302cdac/0xca7fc0c411f946eb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797166.219897:0:14299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004302cdac/0xca7fc0c411f946eb lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797166.219905:0:14299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004302cdac/0xca7fc0c411f946eb lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797166.219919:0:14299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788797166.219921:0:14299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788797166.219923:0:14299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788797166.220410:0:15405:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788797166.220425:0:15405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fad4e8de/0xca7fc0c411f946f2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797166.220434:0:15405:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=455s v=(0 0) 00010000:00010000:0.0:1788797166.220437:0:15405:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788797166.220441:0:15405:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fad4e8de/0xca7fc0c411f946f2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797166.220452:0:15405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fad4e8de/0xca7fc0c411f946f2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797166.220461:0:15405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fad4e8de/0xca7fc0c411f946f2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797166.220470:0:15405:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fad4e8de/0xca7fc0c411f946f2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797166.220492:0:15405:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788797166.220500:0:14298:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788797166.220506:0:14298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fad4e8de/0xca7fc0c411f946f2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797166.220514:0:14298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb042ea3000 already unused, calling callback (ffffffffc14d98b0) 00010000:00010000:2.0:1788797166.220518:0:14298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fad4e8de/0xca7fc0c411f946f2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797166.220526:0:14298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fad4e8de/0xca7fc0c411f946f2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797166.220538:0:14298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fad4e8de/0xca7fc0c411f946f2 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797166.220546:0:14298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fad4e8de/0xca7fc0c411f946f2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797166.220566:0:14298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788797166.220568:0:14298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788797166.220571:0:14298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788797166.221343:0:15405:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788797166.221351:0:15405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000092546c97/0xca7fc0c411f946f9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797166.221363:0:15405:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=455s v=(0 0) 00010000:00010000:0.0:1788797166.221366:0:15405:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788797166.221371:0:15405:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000092546c97/0xca7fc0c411f946f9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797166.221381:0:15405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000092546c97/0xca7fc0c411f946f9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797166.221400:0:15405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000092546c97/0xca7fc0c411f946f9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797166.221407:0:15405:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000092546c97/0xca7fc0c411f946f9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797166.221427:0:15405:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788797166.221440:0:14299:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788797166.221445:0:14299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000092546c97/0xca7fc0c411f946f9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797166.221452:0:14299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb042ea2600 already unused, calling callback (ffffffffc14d98b0) 00010000:00010000:0.0:1788797166.221456:0:14299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000092546c97/0xca7fc0c411f946f9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797166.221464:0:14299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000092546c97/0xca7fc0c411f946f9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797166.221477:0:14299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000092546c97/0xca7fc0c411f946f9 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797166.221485:0:14299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000092546c97/0xca7fc0c411f946f9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797166.221689:0:14299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788797166.221697:0:14299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788797166.221699:0:14299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788797166.222690:0:15405:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788797166.222699:0:15405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000059e0bc83/0xca7fc0c411f94700 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797166.222713:0:15405:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=455s v=(0 0) 00010000:00010000:0.0:1788797166.222716:0:15405:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788797166.222721:0:15405:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000059e0bc83/0xca7fc0c411f94700 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797166.222732:0:15405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000059e0bc83/0xca7fc0c411f94700 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797166.222741:0:15405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000059e0bc83/0xca7fc0c411f94700 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797166.222748:0:15405:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000059e0bc83/0xca7fc0c411f94700 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797166.222769:0:15405:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:1.0:1788797166.223071:0:5848:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00010000:00010000:2.0:1788797166.224300:0:14298:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788797166.224313:0:14298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000059e0bc83/0xca7fc0c411f94700 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797166.224327:0:14298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb042ea2200 already unused, calling callback (ffffffffc14d98b0) 00010000:00010000:2.0:1788797166.224333:0:14298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000059e0bc83/0xca7fc0c411f94700 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797166.224358:0:14298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000059e0bc83/0xca7fc0c411f94700 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797166.224382:0:14298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000059e0bc83/0xca7fc0c411f94700 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797166.224390:0:14298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000059e0bc83/0xca7fc0c411f94700 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797166.224409:0:14298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788797166.224412:0:14298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788797166.224414:0:14298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788797166.224527:0:15405:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788797166.224535:0:15405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000d37cb33/0xca7fc0c411f94707 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797166.224547:0:15405:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=455s v=(0 0) 00010000:00010000:0.0:1788797166.224552:0:15405:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788797166.224558:0:15405:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000d37cb33/0xca7fc0c411f94707 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797166.224578:0:15405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000d37cb33/0xca7fc0c411f94707 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797166.224598:0:15405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000d37cb33/0xca7fc0c411f94707 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797166.224606:0:15405:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000d37cb33/0xca7fc0c411f94707 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797166.224628:0:15405:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788797166.224980:0:14299:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788797166.224988:0:14299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000d37cb33/0xca7fc0c411f94707 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797166.224997:0:14299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb042ea3200 already unused, calling callback (ffffffffc14d98b0) 00010000:00010000:1.0:1788797166.225000:0:14299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000d37cb33/0xca7fc0c411f94707 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797166.225009:0:14299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000d37cb33/0xca7fc0c411f94707 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797166.225052:0:14299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000d37cb33/0xca7fc0c411f94707 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797166.225061:0:14299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000d37cb33/0xca7fc0c411f94707 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797166.225081:0:14299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788797166.225083:0:14299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788797166.225084:0:14299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788797166.225282:0:15405:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788797166.225288:0:15405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ed12a788/0xca7fc0c411f9470e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797166.225298:0:15405:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=455s v=(0 0) 00010000:00010000:0.0:1788797166.225301:0:15405:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788797166.225305:0:15405:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ed12a788/0xca7fc0c411f9470e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797166.225317:0:15405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ed12a788/0xca7fc0c411f9470e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797166.225326:0:15405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ed12a788/0xca7fc0c411f9470e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797166.225345:0:15405:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ed12a788/0xca7fc0c411f9470e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797166.225367:0:15405:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788797166.225610:0:14298:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788797166.225618:0:14298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ed12a788/0xca7fc0c411f9470e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797166.225626:0:14298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb042ea2000 already unused, calling callback (ffffffffc14d98b0) 00010000:00010000:2.0:1788797166.225630:0:14298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ed12a788/0xca7fc0c411f9470e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797166.225639:0:14298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ed12a788/0xca7fc0c411f9470e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797166.225653:0:14298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ed12a788/0xca7fc0c411f9470e lrc: 1/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797166.225675:0:14298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ed12a788/0xca7fc0c411f9470e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797166.225694:0:14298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788797166.225696:0:14298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788797166.225698:0:14298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788797166.225797:0:15405:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788797166.225803:0:15405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000c74b340/0xca7fc0c411f94715 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797166.225811:0:15405:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=455s v=(0 0) 00010000:00010000:0.0:1788797166.225814:0:15405:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788797166.225818:0:15405:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000c74b340/0xca7fc0c411f94715 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797166.225828:0:15405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000c74b340/0xca7fc0c411f94715 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797166.225836:0:15405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000c74b340/0xca7fc0c411f94715 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797166.225843:0:15405:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000c74b340/0xca7fc0c411f94715 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797166.226169:0:15405:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788797166.226709:0:15405:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788797166.226717:0:15405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002e54d865/0xca7fc0c411f9471c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797166.226734:0:15405:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=455s v=(0 0) 00010000:00010000:0.0:1788797166.226739:0:15405:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788797166.226744:0:15405:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002e54d865/0xca7fc0c411f9471c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797166.226755:0:15405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002e54d865/0xca7fc0c411f9471c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797166.226762:0:15405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002e54d865/0xca7fc0c411f9471c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797166.226771:0:15405:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002e54d865/0xca7fc0c411f9471c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797166.229336:0:14299:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788797166.229353:0:14299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000c74b340/0xca7fc0c411f94715 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797166.229368:0:14299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb042ea3c00 already unused, calling callback (ffffffffc14d98b0) 00010000:00010000:1.0:1788797166.229373:0:14299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000c74b340/0xca7fc0c411f94715 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797166.229400:0:14299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000c74b340/0xca7fc0c411f94715 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797166.229424:0:14299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000c74b340/0xca7fc0c411f94715 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797166.229432:0:14299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000c74b340/0xca7fc0c411f94715 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797166.229482:0:15405:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788797166.229529:0:14298:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00002000:00010000:0.0:1788797166.230742:0:15405:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788797166.230754:0:15405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9f90412/0xca7fc0c411f94723 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797166.230770:0:15405:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=455s v=(0 0) 00010000:00010000:0.0:1788797166.230774:0:15405:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788797166.230781:0:15405:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f9f90412/0xca7fc0c411f94723 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797166.230798:0:15405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f9f90412/0xca7fc0c411f94723 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797166.230821:0:15405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9f90412/0xca7fc0c411f94723 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797166.230829:0:15405:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f9f90412/0xca7fc0c411f94723 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797166.230840:0:15405:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788797166.231704:0:15405:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788797166.231713:0:15405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b86d34e3/0xca7fc0c411f9472a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797166.231724:0:15405:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=455s v=(0 0) 00010000:00010000:0.0:1788797166.231727:0:15405:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788797166.231731:0:15405:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b86d34e3/0xca7fc0c411f9472a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797166.231742:0:15405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b86d34e3/0xca7fc0c411f9472a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797166.231751:0:15405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b86d34e3/0xca7fc0c411f9472a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797166.231758:0:15405:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b86d34e3/0xca7fc0c411f9472a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797166.231780:0:15405:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1788797166.232553:0:15405:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788797166.232561:0:15405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001cab9c7c/0xca7fc0c411f94731 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797166.232571:0:15405:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=455s v=(0 0) 00010000:00010000:0.0:1788797166.232575:0:15405:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788797166.232590:0:15405:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001cab9c7c/0xca7fc0c411f94731 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797166.232601:0:15405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001cab9c7c/0xca7fc0c411f94731 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797166.232610:0:15405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001cab9c7c/0xca7fc0c411f94731 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797166.232617:0:15405:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001cab9c7c/0xca7fc0c411f94731 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797166.232628:0:15405:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:3.0:1788797166.233572:0:14299:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788797166.233592:0:14299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f9f90412/0xca7fc0c411f94723 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797166.233605:0:14299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb079b81200 already unused, calling callback (ffffffffc14d98b0) 00010000:00010000:3.0:1788797166.233610:0:14299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9f90412/0xca7fc0c411f94723 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797166.233622:0:14299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9f90412/0xca7fc0c411f94723 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797166.233644:0:14299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f9f90412/0xca7fc0c411f94723 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797166.233653:0:14299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f9f90412/0xca7fc0c411f94723 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797166.233675:0:14299:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788797166.233686:0:14299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b86d34e3/0xca7fc0c411f9472a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797166.233692:0:14299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb079b81c00 already unused, calling callback (ffffffffc14d98b0) 00010000:00010000:3.0:1788797166.233696:0:14299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b86d34e3/0xca7fc0c411f9472a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797166.233703:0:14299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b86d34e3/0xca7fc0c411f9472a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797166.233714:0:14299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b86d34e3/0xca7fc0c411f9472a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797166.233721:0:14299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b86d34e3/0xca7fc0c411f9472a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797166.233735:0:14299:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788797166.233739:0:14299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001cab9c7c/0xca7fc0c411f94731 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797166.233746:0:14299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb079b81600 already unused, calling callback (ffffffffc14d98b0) 00010000:00010000:3.0:1788797166.233749:0:14299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001cab9c7c/0xca7fc0c411f94731 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797166.233756:0:14299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001cab9c7c/0xca7fc0c411f94731 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797166.233777:0:14299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001cab9c7c/0xca7fc0c411f94731 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797166.233784:0:14299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001cab9c7c/0xca7fc0c411f94731 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797166.233798:0:14299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788797166.233801:0:14299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788797166.233803:0:14299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788797166.237714:0:15405:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788797166.237731:0:15405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000044675201/0xca7fc0c411f94738 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797166.237751:0:15405:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=455s v=(0 0) 00010000:00010000:0.0:1788797166.237764:0:15405:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788797166.237772:0:15405:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000044675201/0xca7fc0c411f94738 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797166.237789:0:15405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000044675201/0xca7fc0c411f94738 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797166.237799:0:15405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000044675201/0xca7fc0c411f94738 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797166.237806:0:15405:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000044675201/0xca7fc0c411f94738 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797166.237832:0:15405:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788797166.238120:0:14299:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788797166.238129:0:14299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000044675201/0xca7fc0c411f94738 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797166.238138:0:14299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb079b80600 already unused, calling callback (ffffffffc14d98b0) 00010000:00010000:3.0:1788797166.238143:0:14299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000044675201/0xca7fc0c411f94738 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797166.238153:0:14299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000044675201/0xca7fc0c411f94738 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797166.238170:0:14299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000044675201/0xca7fc0c411f94738 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797166.238177:0:14299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000044675201/0xca7fc0c411f94738 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797166.238277:0:14299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788797166.238280:0:14299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788797166.238282:0:14299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788797166.239155:0:15413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788797166.239167:0:14298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002e54d865/0xca7fc0c411f9471c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797166.239177:0:14298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb079b80a00 already unused, calling callback (ffffffffc14d98b0) 00010000:00010000:3.0:1788797166.239181:0:14298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002e54d865/0xca7fc0c411f9471c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797166.239190:0:14298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002e54d865/0xca7fc0c411f9471c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788797166.239244:0:15405:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788797166.239251:0:15405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001be42e80/0xca7fc0c411f9473f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797166.239262:0:15405:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=455s v=(0 0) 00010000:00010000:0.0:1788797166.239266:0:15405:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788797166.239271:0:15405:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001be42e80/0xca7fc0c411f9473f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797166.239273:0:14298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002e54d865/0xca7fc0c411f9471c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797166.239290:0:14298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002e54d865/0xca7fc0c411f9471c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797166.239291:0:15405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001be42e80/0xca7fc0c411f9473f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797166.239311:0:15405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001be42e80/0xca7fc0c411f9473f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797166.239315:0:14298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788797166.239317:0:14298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788797166.239320:0:14298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788797166.239327:0:15413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788797166.239331:0:15413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788797166.239331:0:15405:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001be42e80/0xca7fc0c411f9473f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797166.239355:0:15405:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788797166.239517:0:14299:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788797166.239527:0:14299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001be42e80/0xca7fc0c411f9473f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797166.239535:0:14299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb079b80800 already unused, calling callback (ffffffffc14d98b0) 00010000:00010000:3.0:1788797166.239539:0:14299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001be42e80/0xca7fc0c411f9473f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797166.239547:0:14299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001be42e80/0xca7fc0c411f9473f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797166.239558:0:14299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001be42e80/0xca7fc0c411f9473f lrc: 1/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797166.239565:0:14299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001be42e80/0xca7fc0c411f9473f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797166.239589:0:14299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788797166.239591:0:14299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788797166.239593:0:14299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788797166.240124:0:15405:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788797166.240131:0:15405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000005160234/0xca7fc0c411f94746 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797166.240141:0:15405:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=455s v=(0 0) 00010000:00010000:0.0:1788797166.240144:0:15405:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788797166.240149:0:15405:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000005160234/0xca7fc0c411f94746 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797166.240158:0:15405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000005160234/0xca7fc0c411f94746 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797166.240167:0:15405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000005160234/0xca7fc0c411f94746 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797166.240173:0:15405:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000005160234/0xca7fc0c411f94746 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797166.240196:0:15405:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788797166.240285:0:14298:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788797166.240291:0:14298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000005160234/0xca7fc0c411f94746 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797166.240300:0:14298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb079b80200 already unused, calling callback (ffffffffc14d98b0) 00010000:00010000:3.0:1788797166.240304:0:14298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000005160234/0xca7fc0c411f94746 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797166.240324:0:14298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000005160234/0xca7fc0c411f94746 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797166.240338:0:14298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000005160234/0xca7fc0c411f94746 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797166.240346:0:14298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000005160234/0xca7fc0c411f94746 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797166.240366:0:14298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788797166.240369:0:14298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788797166.240372:0:14298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788797166.241534:0:15405:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788797166.241546:0:15405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d9aaaf35/0xca7fc0c411f9474d lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797166.241571:0:15405:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=455s v=(0 0) 00010000:00010000:0.0:1788797166.241576:0:15405:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788797166.241591:0:15405:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d9aaaf35/0xca7fc0c411f9474d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797166.241609:0:15405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d9aaaf35/0xca7fc0c411f9474d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797166.241619:0:15405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d9aaaf35/0xca7fc0c411f9474d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797166.241627:0:15405:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d9aaaf35/0xca7fc0c411f9474d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797166.241652:0:15405:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788797166.242544:0:15413:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788797166.242555:0:15413:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d9aaaf35/0xca7fc0c411f9474d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797166.242564:0:15413:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb079b80400 already unused, calling callback (ffffffffc14d98b0) 00010000:00010000:1.0:1788797166.242569:0:15413:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d9aaaf35/0xca7fc0c411f9474d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797166.242588:0:15413:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d9aaaf35/0xca7fc0c411f9474d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797166.242609:0:15413:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d9aaaf35/0xca7fc0c411f9474d lrc: 1/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797166.242619:0:15413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d9aaaf35/0xca7fc0c411f9474d lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797166.242662:0:15413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788797166.242665:0:15413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788797166.242667:0:15413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788797166.242727:0:15405:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788797166.242736:0:15405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000abcbaae7/0xca7fc0c411f94754 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797166.242746:0:15405:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=455s v=(0 0) 00010000:00010000:0.0:1788797166.242750:0:15405:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788797166.242755:0:15405:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000abcbaae7/0xca7fc0c411f94754 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797166.242767:0:15405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000abcbaae7/0xca7fc0c411f94754 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797166.242788:0:15405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000abcbaae7/0xca7fc0c411f94754 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797166.242796:0:15405:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000abcbaae7/0xca7fc0c411f94754 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797166.242822:0:15405:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788797166.243287:0:14299:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788797166.243294:0:14299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000abcbaae7/0xca7fc0c411f94754 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797166.243302:0:14299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb079b81000 already unused, calling callback (ffffffffc14d98b0) 00010000:00010000:3.0:1788797166.243306:0:14299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000abcbaae7/0xca7fc0c411f94754 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797166.243313:0:14299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000abcbaae7/0xca7fc0c411f94754 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797166.243327:0:14299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000abcbaae7/0xca7fc0c411f94754 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797166.243348:0:14299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000abcbaae7/0xca7fc0c411f94754 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797166.243363:0:14299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788797166.243365:0:14299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788797166.243368:0:14299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788797166.244367:0:15405:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788797166.244381:0:15405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008543ee14/0xca7fc0c411f9475b lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797166.244397:0:15405:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=455s v=(0 0) 00010000:00010000:0.0:1788797166.246345:0:15405:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788797166.246356:0:15405:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008543ee14/0xca7fc0c411f9475b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797166.246377:0:15405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008543ee14/0xca7fc0c411f9475b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797166.246390:0:15405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008543ee14/0xca7fc0c411f9475b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797166.246399:0:15405:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008543ee14/0xca7fc0c411f9475b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797166.246443:0:15405:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788797166.246531:0:14298:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788797166.246540:0:14298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008543ee14/0xca7fc0c411f9475b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797166.246551:0:14298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb079b81a00 already unused, calling callback (ffffffffc14d98b0) 00010000:00010000:3.0:1788797166.246556:0:14298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008543ee14/0xca7fc0c411f9475b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797166.246567:0:14298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008543ee14/0xca7fc0c411f9475b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797166.246599:0:14298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008543ee14/0xca7fc0c411f9475b lrc: 1/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797166.246607:0:14298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008543ee14/0xca7fc0c411f9475b lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797166.246637:0:14298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788797166.246638:0:14298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788797166.246640:0:14298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788797166.250009:0:15405:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788797166.250025:0:15405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ac27f509/0xca7fc0c411f94762 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797166.250059:0:15405:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=455s v=(0 0) 00010000:00010000:0.0:1788797166.250075:0:15405:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788797166.250081:0:15405:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ac27f509/0xca7fc0c411f94762 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797166.250097:0:15405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ac27f509/0xca7fc0c411f94762 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797166.250108:0:15405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ac27f509/0xca7fc0c411f94762 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797166.250116:0:15405:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ac27f509/0xca7fc0c411f94762 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797166.250140:0:15405:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788797166.250294:0:15413:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788797166.250304:0:15413:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ac27f509/0xca7fc0c411f94762 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797166.250315:0:15413:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb079b81800 already unused, calling callback (ffffffffc14d98b0) 00010000:00010000:1.0:1788797166.250321:0:15413:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ac27f509/0xca7fc0c411f94762 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797166.250333:0:15413:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ac27f509/0xca7fc0c411f94762 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797166.250357:0:15413:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ac27f509/0xca7fc0c411f94762 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797166.250365:0:15413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ac27f509/0xca7fc0c411f94762 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797166.250398:0:15413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788797166.250400:0:15413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788797166.250402:0:15413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788797166.252590:0:15405:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788797166.252603:0:15405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000081d7bd36/0xca7fc0c411f94769 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797166.252620:0:15405:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=455s v=(0 0) 00010000:00010000:3.0:1788797166.252624:0:15405:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788797166.252630:0:15405:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000081d7bd36/0xca7fc0c411f94769 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797166.252645:0:15405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000081d7bd36/0xca7fc0c411f94769 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797166.252657:0:15405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000081d7bd36/0xca7fc0c411f94769 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797166.252665:0:15405:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000081d7bd36/0xca7fc0c411f94769 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797166.252698:0:15405:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788797166.253519:0:15405:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788797166.253528:0:15405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008ac9d027/0xca7fc0c411f94770 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797166.253541:0:15405:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=455s v=(0 0) 00010000:00010000:3.0:1788797166.253544:0:15405:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788797166.253549:0:15405:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008ac9d027/0xca7fc0c411f94770 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797166.253575:0:15405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008ac9d027/0xca7fc0c411f94770 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797166.253593:0:15405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008ac9d027/0xca7fc0c411f94770 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797166.253602:0:15405:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008ac9d027/0xca7fc0c411f94770 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797166.254539:0:15405:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1788797166.255181:0:15405:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788797166.255192:0:15405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006e59e099/0xca7fc0c411f94777 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797166.255210:0:15405:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=455s v=(0 0) 00010000:00010000:3.0:1788797166.255215:0:15405:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788797166.255220:0:15405:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006e59e099/0xca7fc0c411f94777 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797166.255233:0:15405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006e59e099/0xca7fc0c411f94777 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797166.255243:0:15405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006e59e099/0xca7fc0c411f94777 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797166.255263:0:15405:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006e59e099/0xca7fc0c411f94777 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797166.258312:0:14298:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788797166.258328:0:14298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000081d7bd36/0xca7fc0c411f94769 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797166.258354:0:14298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb077c69a00 already unused, calling callback (ffffffffc14d98b0) 00010000:00010000:1.0:1788797166.258359:0:14298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000081d7bd36/0xca7fc0c411f94769 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797166.258371:0:14298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000081d7bd36/0xca7fc0c411f94769 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797166.258395:0:14298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000081d7bd36/0xca7fc0c411f94769 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797166.258403:0:14298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000081d7bd36/0xca7fc0c411f94769 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797166.258423:0:14298:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788797166.258427:0:14298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008ac9d027/0xca7fc0c411f94770 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797166.258434:0:14298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb077c68800 already unused, calling callback (ffffffffc14d98b0) 00010000:00010000:1.0:1788797166.258449:0:14298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008ac9d027/0xca7fc0c411f94770 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797166.258456:0:14298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008ac9d027/0xca7fc0c411f94770 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797166.258466:0:14298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008ac9d027/0xca7fc0c411f94770 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797166.258480:0:14298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008ac9d027/0xca7fc0c411f94770 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797166.258494:0:14298:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788797166.258498:0:14298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006e59e099/0xca7fc0c411f94777 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797166.258505:0:14298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb077c68400 already unused, calling callback (ffffffffc14d98b0) 00010000:00010000:1.0:1788797166.258508:0:14298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006e59e099/0xca7fc0c411f94777 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797166.258516:0:14298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006e59e099/0xca7fc0c411f94777 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797166.258526:0:14298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006e59e099/0xca7fc0c411f94777 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797166.258534:0:14298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788797166.258536:0:14298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788797166.258538:0:14298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788797166.260155:0:15405:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788797166.260168:0:15405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006e59e099/0xca7fc0c411f94777 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797166.260300:0:15413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788797166.262535:0:15405:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788797166.262547:0:15405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aa01bdc0/0xca7fc0c411f9477e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797166.262563:0:15405:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=455s v=(0 0) 00010000:00010000:3.0:1788797166.262568:0:15405:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788797166.262575:0:15405:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000aa01bdc0/0xca7fc0c411f9477e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797166.262601:0:15405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000aa01bdc0/0xca7fc0c411f9477e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797166.262611:0:15405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aa01bdc0/0xca7fc0c411f9477e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797166.262619:0:15405:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000aa01bdc0/0xca7fc0c411f9477e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797166.262700:0:15405:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:3.0:1788797166.263069:0:15405:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x240000400:6 00000100:00100000:3.0:1788797166.263295:0:15405:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0795c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:14331:x1875689374577536:12345-0@lo:5:osp-pre-0-0.0 Request processed in 123362us (124216us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797166.263313:0:15405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788797166.263384:0:14331:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb0795c7800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14331:1875689374577536:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1788797166.263404:0:14331:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x240000400:0x21:0x0] from OST, last_created [0x240000400:0x21:0x0]last_used is [0x240000400:0x6:0x0] 00000100:00100000:3.0:1788797166.264358:0:14331:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb0778de300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14331:1875689374577792:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1788797166.264419:0:14331:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788797166.264548:0:14331:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb04919a840 going to sleep for 11 seconds 00000100:00100000:3.0:1788797166.264593:0:14996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374577792 00000100:00100000:3.0:1788797166.264600:0:14996:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374577792 00000100:00100000:3.0:1788797166.264648:0:14996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788797166.264657:0:14996:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0778ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14331:x1875689374577792:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:3.0:1788797166.264706:0:14996:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 34 00010000:00010000:0.0:1788797166.266335:0:14299:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788797166.266350:0:14299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000aa01bdc0/0xca7fc0c411f9477e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797166.266367:0:14299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb077c68600 already unused, calling callback (ffffffffc14d98b0) 00010000:00010000:0.0:1788797166.266386:0:14299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000aa01bdc0/0xca7fc0c411f9477e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797166.266398:0:14299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000aa01bdc0/0xca7fc0c411f9477e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797166.266422:0:14299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000aa01bdc0/0xca7fc0c411f9477e lrc: 1/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797166.266429:0:14299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000aa01bdc0/0xca7fc0c411f9477e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797166.266473:0:14299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788797166.266476:0:14299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788797166.266478:0:14299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788797166.272412:0:14298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788797166.310649:0:14331:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb0778de300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14331:1875689374577792:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1788797166.310680:0:14331:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x21:0x0]-[0x240000400:0x41:0x0] 00000100:00100000:0.0:1788797166.310921:0:14996:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0778ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:14331:x1875689374577792:12345-0@lo:5:osp-pre-0-0.0 Request processed in 45871us (46108us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1788797166.310934:0:14996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:1.0:1788797166.389310:0:15413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788797167.418577:0:14299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788797167.776973:0:6713:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:1.0:1788797167.776994:0:6713:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00010000:00010000:1.0:1788797168.435253:0:14298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788797169.462377:0:15413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788797170.482218:0:14299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788797171.252820:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788797171.252837:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1788797171.252842:0:8:0:(import.c:65:import_set_state_nolock()) ffff8cb05ca5a000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788797171.252852:0:8:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 455 00000100:00080000:2.0:1788797171.252860:0:8:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1788797171.252873:0:8:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8cb05ca5a000 using connection 192.168.204.138@tcp/0@lo 00000100:00100000:2.0:1788797171.252896:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cb0795da680 x1875689374578304/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788797171.253011:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb0795da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3299:1875689374578304:0@lo:8:kworker.0 00000100:00100000:0.0:1788797171.253086:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb0795db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3301:1875689374578432:0@lo:400:kworker.0 00000100:00100000:1.0:1788797171.253119:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788797171.253122:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788797171.253345:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb0795db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:73f6407e-c8af-46fc-9cc4-279490305b80:3302:1875689374577920:0@lo:400:kworker.0 00000100:00100000:0.0:1788797171.254606:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788797171.254626:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb0795dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875689374578176:0@lo:400:kworker.0 00000100:00100000:0.0:1788797171.254679:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788797171.254766:0:14995:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374578304 00000100:00100000:0.0:1788797171.254777:0:14995:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374578304 00000100:00100000:0.0:1788797171.254820:0:14995:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374578176 00000100:00100000:0.0:1788797171.254823:0:14995:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374578176 00000100:00100000:2.0:1788797171.254988:0:14993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788797171.254997:0:14993:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0795c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3299:x1875689374578304:12345-0@lo:8:kworker.0 00010000:00020000:2.0:1788797171.255016:0:14993:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788797171.256826:0:14995:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788797171.256993:0:14995:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb06f57df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3301:x1875689374578176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788797171.257140:0:14995:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb06f57df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3301:x1875689374578176:12345-0@lo:400:kworker.0 Request processed in 152us (2461us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797171.257148:0:14995:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788797171.257186:0:14309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374578432 00000100:00100000:0.0:1788797171.257472:0:14309:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374578432 00000100:00100000:0.0:1788797171.257525:0:14309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788797171.257532:0:14309:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb06f57ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1875689374578432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788797171.257571:0:14309:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb06f57ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1875689374578432:12345-0@lo:400:kworker.0 Request processed in 39us (4446us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797171.257577:0:14309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:0.0:1788797171.257594:0:14306:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788797171.258172:0:3301:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:0.0:1788797171.258225:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb0795dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875689374578176:0@lo:400:kworker.0 00010000:00080000:0.0:1788797171.258246:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cb0795db480 x1875689374578432/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788797187 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788797171.258260:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb0795db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3301:1875689374578432:0@lo:400:kworker.0 00000100:00100000:3.0:1788797171.268675:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb0795c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875689374578048:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788797171.270714:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788797171.272597:0:14997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374578048 00000100:00100000:3.0:1788797171.272616:0:14997:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374578048 00000100:00100000:3.0:1788797171.272687:0:14997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788797171.272698:0:14997:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0778de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875689374578048:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788797171.272775:0:14997:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788797171.275932:0:14997:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0778de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875689374578048:12345-0@lo:13:osp-pre-0-0.0 Request processed in 3224us (5216us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797171.276003:0:14997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788797171.277225:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb0795c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875689374578048:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788797171.279622:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788797171.279716:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb0795d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3302:1875689374578560:0@lo:400:kworker.0 00000100:00100000:3.0:1788797171.281349:0:14305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374577920 00000100:00100000:3.0:1788797171.281372:0:14305:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374577920 00000100:00100000:3.0:1788797171.281751:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788797171.281765:0:14305:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb079f75050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73f6407e-c8af-46fc-9cc4-279490305b80+16:3302:x1875689374577920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788797171.282630:0:14305:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb079f75050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73f6407e-c8af-46fc-9cc4-279490305b80+16:3302:x1875689374577920:12345-0@lo:400:kworker.0 Request processed in 866us (3601us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797171.282642:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788797171.285541:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788797171.285641:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb0795db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:73f6407e-c8af-46fc-9cc4-279490305b80:3302:1875689374577920:0@lo:400:kworker.0 00000100:00100000:3.0:1788797171.287688:0:15017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374578560 00000100:00100000:3.0:1788797171.287707:0:15017:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374578560 00000100:00100000:3.0:1788797171.287924:0:15017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788797171.287936:0:15017:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0778dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1875689374578560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788797171.288327:0:15017:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0778dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1875689374578560:12345-0@lo:400:kworker.0 Request processed in 393us (2794us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797171.288337:0:15017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:3.0:1788797171.288380:0:14306:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1788797171.289226:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cb0795d8e00 x1875689374578560/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788797187 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788797171.289261:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb0795d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3302:1875689374578560:0@lo:400:kworker.0 00000100:00100000:2.0:1788797171.308693:0:14993:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0795c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3299:x1875689374578304:12345-0@lo:8:kworker.0 Request processed in 53688us (55567us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788797171.308710:0:14993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:2.0:1788797171.308775:0:3299:0:(import.c:65:import_set_state_nolock()) ffff8cb05ca5a000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788797171.308780:0:3299:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788797171.308784:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb0795da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3299:1875689374578304:0@lo:8:kworker.0 00010000:00010000:1.0:1788797171.510716:0:14298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788797172.532545:0:15413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788797173.559611:0:14299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788797173.930474:0:15726:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1788797173.930478:0:15726:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:3.0:1788797173.930642:0:15726:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8cb046310000 00000020:01000004:3.0:1788797173.930662:0:15726:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:3.0:1788797173.930679:0:15726:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:3.0:1788797173.930707:0:15726:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff8cb048f719c0) 00000020:00000080:3.0:1788797173.930726:0:15726:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osd-zfs with refcount 2 00000040:00080000:3.0:1788797173.938770:0:14343:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00100000:10000000:2.0:1788797173.950669:0:15726:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1788797173.951231:0:15726:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1788797173.952246:0:15726:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1788797173.952573:0:15726:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:2.0:1788797173.954254:0:15726:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:2.0:1788797173.954859:0:15726:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled params under 663: rc = 0 00100000:10000000:2.0:1788797173.954962:0:15726:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-OST0001 under 663: rc = 0 00100000:10000000:2.0:1788797173.955253:0:15726:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-client under 663: rc = 0 00100000:10000000:2.0:1788797173.955937:0:15726:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000-OST0001 under 464: rc = 0 00100000:10000000:2.0:1788797173.956325:0:15726:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000-OST0001 under 464: rc = 0 00100000:10000000:2.0:1788797173.956797:0:15726:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000 under 464: rc = 0 00100000:10000000:2.0:1788797173.957260:0:15726:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000 under 464: rc = 0 00100000:10000000:2.0:1788797173.958836:0:15726:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000-OST0001 under 464: rc = 0 00100000:10000000:2.0:1788797173.959389:0:15726:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000 under 464: rc = 0 00000020:00000080:2.0:1788797173.960939:0:15726:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1788797173.960958:0:15726:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788797173.960973:0:15726:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xca7fc0c411f9478c 00000020:01000004:2.0:1788797173.960985:0:15726:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:2.0:1788797173.961008:0:15726:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.138@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1788797173.961012:0:15726:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.138@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1788797173.961018:0:15726:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1788797173.961221:0:15726:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:2.0:1788797173.961226:0:15726:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.138@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:2.0:1788797173.975350:0:15726:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.138@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788797173.975393:0:15726:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.204.138@tcp, index=0001, flags=0x20002 00000020:01000004:2.0:1788797173.975398:0:15726:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788797173.975399:0:15726:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788797173.975401:0:15726:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788797173.975406:0:15726:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788797173.975408:0:15726:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788797173.975409:0:15726:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788797173.975410:0:15726:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788797173.975412:0:15726:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788797173.975413:0:15726:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788797173.975416:0:15726:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:2.0:1788797173.975418:0:15726:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788797173.975419:0:15726:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788797173.975420:0:15726:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788797173.975421:0:15726:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788797173.975422:0:15726:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788797173.975423:0:15726:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788797173.975423:0:15726:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788797173.975424:0:15726:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788797173.975425:0:15726:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788797173.975462:0:15726:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1788797173.975483:0:15726:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb0795da680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73f6407e-c8af-46fc-9cc4-279490305b80:15726:1875689374578688:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788797173.975631:0:15726:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788797173.975806:0:15726:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb081353e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788797173.975851:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374578688 00000100:00100000:3.0:1788797173.975858:0:14303:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374578688 00000100:00100000:3.0:1788797173.975949:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788797173.975959:0:14303:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb079f75850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73f6407e-c8af-46fc-9cc4-279490305b80+16:15726:x1875689374578688:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788797173.975989:0:14303:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:3.0:1788797173.975992:0:14303:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:3.0:1788797173.975996:0:14303:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:0.0:1788797174.020437:0:14303:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb079f75850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73f6407e-c8af-46fc-9cc4-279490305b80+16:15726:x1875689374578688:12345-0@lo:253:mount.lustre.0 Request processed in 44457us (44784us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797174.020453:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788797174.020576:0:15726:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb0795da680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73f6407e-c8af-46fc-9cc4-279490305b80:15726:1875689374578688:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788797174.020595:0:15726:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1788797174.020598:0:15726:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788797174.020600:0:15726:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788797174.020602:0:15726:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788797174.020603:0:15726:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788797174.020604:0:15726:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788797174.020606:0:15726:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788797174.020607:0:15726:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788797174.020610:0:15726:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788797174.020611:0:15726:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788797174.020636:0:15726:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8cb046310000 from lustre-OST0001 10000000:01000000:2.0:1788797174.020670:0:15726:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:2.0:1788797174.020674:0:15726:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1788797174.021179:0:15726:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8cb0812d19c0 local copy 00010000:00010000:2.0:1788797174.021195:0:15726:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.138@tcp lock: ffff8cb077c68a00/0xca7fc0c411f94539 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xca7fc0c411f94540 expref: -99 pid: 14292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788797174.021483:0:15726:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb0795da680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73f6407e-c8af-46fc-9cc4-279490305b80:15726:1875689374578816:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788797174.022292:0:15726:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788797174.022349:0:15726:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb081353e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788797174.022829:0:14304:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374578816 00000100:00100000:3.0:1788797174.022842:0:14304:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374578816 00000100:00100000:2.0:1788797174.025922:0:14304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788797174.025953:0:14304:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb079f77450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73f6407e-c8af-46fc-9cc4-279490305b80+16:15726:x1875689374578816:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788797174.026597:0:14304:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb079f77450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73f6407e-c8af-46fc-9cc4-279490305b80+16:15726:x1875689374578816:12345-0@lo:501:mount.lustre.0 Request processed in 658us (4305us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788797174.026609:0:14304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788797174.026755:0:15726:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb0795da680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73f6407e-c8af-46fc-9cc4-279490305b80:15726:1875689374578816:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1788797174.026783:0:15726:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.138@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1788797174.026967:0:15726:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.138@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1788797174.026977:0:15726:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.138@tcp lock: ffff8cb077c68a00/0xca7fc0c411f94539 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xca7fc0c411f94540 expref: -99 pid: 14292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797174.026989:0:15726:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.138@tcp lock: ffff8cb077c68a00/0xca7fc0c411f94539 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xca7fc0c411f94540 expref: -99 pid: 14292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788797174.027768:0:15726:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8cb046310000 10000000:01000000:3.0:1788797174.027778:0:15726:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788797174.027785:0:15726:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1788797174.027788:0:15726:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788797174.027793:0:15726:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:3.0:1788797174.027796:0:15726:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1788797174.027833:0:15726:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.138@tcp lock: ffff8cb077c68600/0xca7fc0c411f94793 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797174.027844:0:15726:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.138@tcp lock: ffff8cb077c68600/0xca7fc0c411f94793 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797174.027857:0:15726:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.138@tcp lock: ffff8cb077c68600/0xca7fc0c411f94793 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788797174.027883:0:15726:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb0778dd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73f6407e-c8af-46fc-9cc4-279490305b80:15726:1875689374578944:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788797174.027940:0:15726:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788797174.031604:0:15726:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb050e71540 going to sleep for 11 seconds 00000100:00100000:1.0:1788797174.033344:0:14305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374578944 00000100:00100000:1.0:1788797174.033372:0:14305:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374578944 00000100:00100000:1.0:1788797174.034868:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788797174.034888:0:14305:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb079f77850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73f6407e-c8af-46fc-9cc4-279490305b80+16:15726:x1875689374578944:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788797174.034914:0:14305:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788797174.034939:0:14305:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cb082045600/0xca7fc0c411f9479a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xca7fc0c411f94793 expref: -99 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797174.034969:0:14305:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cb082045600/0xca7fc0c411f9479a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xca7fc0c411f94793 expref: 17 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797174.034980:0:14305:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cb082045600/0xca7fc0c411f9479a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xca7fc0c411f94793 expref: 17 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797174.034989:0:14305:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb082045600, rc 0) 00000100:00100000:1.0:1788797174.035329:0:14305:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb079f77850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73f6407e-c8af-46fc-9cc4-279490305b80+17:15726:x1875689374578944:12345-0@lo:101:mount.lustre.0 Request processed in 445us (7388us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797174.035337:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788797174.035413:0:15726:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb0778dd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73f6407e-c8af-46fc-9cc4-279490305b80:15726:1875689374578944:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788797174.035442:0:15726:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.138@tcp lock: ffff8cb077c68600/0xca7fc0c411f94793 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xca7fc0c411f9479a expref: -99 pid: 15726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797174.035453:0:15726:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.138@tcp lock: ffff8cb077c68600/0xca7fc0c411f94793 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xca7fc0c411f9479a expref: -99 pid: 15726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788797174.036787:0:15726:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:3.0:1788797174.038310:0:15726:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788797174.038790:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:3.0:1788797174.038848:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:3.0:1788797174.038883:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:3.0:1788797174.038948:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:3.0:1788797174.038986:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:3.0:1788797174.039018:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:3.0:1788797174.039264:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:3.0:1788797174.039272:0:15726:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:3.0:1788797174.039377:0:15726:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb0778dd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73f6407e-c8af-46fc-9cc4-279490305b80:15726:1875689374579072:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788797174.039460:0:15726:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788797174.039662:0:15726:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb050e71540 going to sleep for 11 seconds 00000100:00100000:0.0:1788797174.039823:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374579072 00000100:00100000:0.0:1788797174.039832:0:14303:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374579072 00000100:00100000:0.0:1788797174.039946:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788797174.039955:0:14303:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb079f74050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73f6407e-c8af-46fc-9cc4-279490305b80+17:15726:x1875689374579072:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788797174.040965:0:14303:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb079f74050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73f6407e-c8af-46fc-9cc4-279490305b80+17:15726:x1875689374579072:12345-0@lo:501:mount.lustre.0 Request processed in 1007us (1501us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797174.040985:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788797174.041341:0:15726:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb0778dd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73f6407e-c8af-46fc-9cc4-279490305b80:15726:1875689374579072:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788797174.041584:0:15726:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb0795d9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73f6407e-c8af-46fc-9cc4-279490305b80:15726:1875689374579200:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788797174.041644:0:15726:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788797174.041831:0:15726:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb081353e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788797174.041884:0:14305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374579200 00000100:00100000:1.0:1788797174.041894:0:14305:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374579200 00000100:00100000:1.0:1788797174.041989:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788797174.042007:0:14305:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb079f76c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73f6407e-c8af-46fc-9cc4-279490305b80+17:15726:x1875689374579200:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788797174.042748:0:14305:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb079f76c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73f6407e-c8af-46fc-9cc4-279490305b80+17:15726:x1875689374579200:12345-0@lo:503:mount.lustre.0 Request processed in 739us (1098us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797174.042758:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788797174.042869:0:15726:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb0795d9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73f6407e-c8af-46fc-9cc4-279490305b80:15726:1875689374579200:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788797174.043484:0:15726:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788797174.043571:0:15726:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb06f57f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73f6407e-c8af-46fc-9cc4-279490305b80:15726:1875689374579328:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788797174.043633:0:15726:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788797174.044004:0:15726:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb0436043c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788797174.044270:0:14304:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374579328 00000100:00100000:2.0:1788797174.044279:0:14304:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374579328 00000100:00100000:2.0:1788797174.044318:0:14304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788797174.044327:0:14304:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb079f77050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73f6407e-c8af-46fc-9cc4-279490305b80+17:15726:x1875689374579328:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788797174.044591:0:14304:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb079f77050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73f6407e-c8af-46fc-9cc4-279490305b80+17:15726:x1875689374579328:12345-0@lo:502:mount.lustre.0 Request processed in 264us (957us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797174.044598:0:14304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788797174.044703:0:15726:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb06f57f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73f6407e-c8af-46fc-9cc4-279490305b80:15726:1875689374579328:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788797174.044980:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:0.0:1788797174.045193:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:0.0:1788797174.045232:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:0.0:1788797174.045282:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:0.0:1788797174.045319:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:0.0:1788797174.045352:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:0.0:1788797174.045400:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:0.0:1788797174.045446:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:0.0:1788797174.045500:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:0.0:1788797174.045539:0:15726:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb06f57f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73f6407e-c8af-46fc-9cc4-279490305b80:15726:1875689374579456:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788797174.045592:0:15726:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788797174.045641:0:15726:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb0436043c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788797174.045739:0:14305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374579456 00000100:00100000:3.0:1788797174.045748:0:14305:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374579456 00000100:00100000:3.0:1788797174.045793:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788797174.045803:0:14305:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb079f75450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73f6407e-c8af-46fc-9cc4-279490305b80+17:15726:x1875689374579456:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788797174.045988:0:14305:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb079f75450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73f6407e-c8af-46fc-9cc4-279490305b80+17:15726:x1875689374579456:12345-0@lo:502:mount.lustre.0 Request processed in 187us (396us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797174.045996:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788797174.046247:0:15726:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb06f57f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73f6407e-c8af-46fc-9cc4-279490305b80:15726:1875689374579456:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788797174.046314:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:0.0:1788797174.046324:0:15726:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 10 count 11 00000020:01000000:2.0:1788797174.047392:0:15728:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788797174.047401:0:15728:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:2.0:1788797174.047408:0:15728:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788797174.047410:0:15728:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:2.0:1788797174.047417:0:15728:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788797174.047443:0:15728:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff8cb0494f0000) 00000020:00000080:2.0:1788797174.047468:0:15728:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type obdfilter with refcount 2 00000020:00000080:2.0:1788797174.047490:0:15728:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1788797174.047556:0:15728:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8cb046310000 from lustre-OST0001, refs=2 00080000:01000000:2.0:1788797174.047565:0:15728:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788797174.047572:0:15728:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xca7fc0c411f947a8 00010000:00010000:2.0:1788797174.051706:0:15728:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:00000004:2.0:1788797174.052292:0:15728:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967310 00080000:10000000:2.0:1788797174.055413:0:15728:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:3.0:1788797174.056795:0:15728:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:3.0:1788797174.056813:0:15728:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788797174.056822:0:15728:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788797174.056824:0:15728:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:3.0:1788797174.056830:0:15728:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788797174.056835:0:15728:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788797174.056837:0:15728:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788797174.056840:0:15728:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788797174.056853:0:15728:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1788797174.056857:0:15728:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788797174.056860:0:15728:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788797174.056861:0:15728:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000020:01000000:3.0:1788797174.056863:0:15728:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788797174.056866:0:15728:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788797174.056867:0:15728:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788797174.056871:0:15728:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1788797174.056942:0:15728:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788797174.056945:0:15728:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788797174.056946:0:15728:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1788797174.056949:0:15728:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:2.0:1788797174.059044:0:15726:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:2.0:1788797174.059208:0:15726:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.138@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1788797174.061317:0:15726:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.138@tcp lock: ffff8cb077c68600/0xca7fc0c411f94793 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xca7fc0c411f9479a expref: -99 pid: 15726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797174.061336:0:15726:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.138@tcp lock: ffff8cb077c68600/0xca7fc0c411f94793 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xca7fc0c411f9479a expref: -99 pid: 15726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788797174.061345:0:15726:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8cb046310000 from 1 10000000:01000000:2.0:1788797174.061350:0:15726:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788797174.061415:0:15726:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.138@tcp lock: ffff8cb040031400/0xca7fc0c411f947af lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797174.061424:0:15726:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.138@tcp lock: ffff8cb040031400/0xca7fc0c411f947af lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797174.061446:0:15726:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.138@tcp lock: ffff8cb040031400/0xca7fc0c411f947af lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788797174.061479:0:15726:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb0795d9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73f6407e-c8af-46fc-9cc4-279490305b80:15726:1875689374579584:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788797174.061574:0:15726:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788797174.061679:0:15726:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb0484fa3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788797174.068241:0:14305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374579584 00000100:00100000:0.0:1788797174.068258:0:14305:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374579584 00000100:00100000:0.0:1788797174.068315:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788797174.068325:0:14305:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb079f74c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73f6407e-c8af-46fc-9cc4-279490305b80+17:15726:x1875689374579584:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788797174.068358:0:14305:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788797174.068380:0:14305:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cb079b81200/0xca7fc0c411f947b6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xca7fc0c411f947af expref: -99 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797174.068408:0:14305:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cb079b81200/0xca7fc0c411f947b6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xca7fc0c411f947af expref: 18 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797174.068419:0:14305:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cb079b81200/0xca7fc0c411f947b6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xca7fc0c411f947af expref: 18 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797174.068437:0:14305:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb079b81200, rc 0) 00000100:00100000:0.0:1788797174.068517:0:14305:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb079f74c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73f6407e-c8af-46fc-9cc4-279490305b80+18:15726:x1875689374579584:12345-0@lo:101:mount.lustre.0 Request processed in 193us (6941us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797174.068524:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788797174.068761:0:15726:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb0795d9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73f6407e-c8af-46fc-9cc4-279490305b80:15726:1875689374579584:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788797174.068788:0:15726:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.138@tcp lock: ffff8cb040031400/0xca7fc0c411f947af lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xca7fc0c411f947b6 expref: -99 pid: 15726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797174.068798:0:15726:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.138@tcp lock: ffff8cb040031400/0xca7fc0c411f947af lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xca7fc0c411f947b6 expref: -99 pid: 15726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788797174.069454:0:15726:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:2.0:1788797174.069800:0:15726:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788797174.070942:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:2.0:1788797174.071007:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:2.0:1788797174.071408:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:2.0:1788797174.071419:0:15726:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:2.0:1788797174.071520:0:15726:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb0795d9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73f6407e-c8af-46fc-9cc4-279490305b80:15726:1875689374579712:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788797174.071584:0:15726:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788797174.071634:0:15726:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb0484fa3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788797174.071699:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374579712 00000100:00100000:0.0:1788797174.071706:0:14303:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374579712 00000100:00100000:0.0:1788797174.071758:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788797174.071768:0:14303:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb079f76050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73f6407e-c8af-46fc-9cc4-279490305b80+18:15726:x1875689374579712:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788797174.072282:0:14303:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb079f76050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73f6407e-c8af-46fc-9cc4-279490305b80+18:15726:x1875689374579712:12345-0@lo:501:mount.lustre.0 Request processed in 514us (696us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797174.072292:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788797174.072632:0:15726:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb0795d9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73f6407e-c8af-46fc-9cc4-279490305b80:15726:1875689374579712:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788797174.072674:0:15726:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb0795d9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73f6407e-c8af-46fc-9cc4-279490305b80:15726:1875689374579840:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788797174.072723:0:15726:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788797174.072794:0:15726:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb0484fa3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788797174.072839:0:14304:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374579840 00000100:00100000:0.0:1788797174.072844:0:14304:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374579840 00000100:00100000:0.0:1788797174.072914:0:14304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788797174.072923:0:14304:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb06e471c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73f6407e-c8af-46fc-9cc4-279490305b80+18:15726:x1875689374579840:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788797174.073256:0:14304:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb06e471c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73f6407e-c8af-46fc-9cc4-279490305b80+18:15726:x1875689374579840:12345-0@lo:503:mount.lustre.0 Request processed in 333us (532us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797174.073275:0:14304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788797174.073357:0:15726:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb0795d9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73f6407e-c8af-46fc-9cc4-279490305b80:15726:1875689374579840:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788797174.073868:0:15726:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788797174.073936:0:15726:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb0795d9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73f6407e-c8af-46fc-9cc4-279490305b80:15726:1875689374579968:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788797174.073983:0:15726:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788797174.074447:0:15726:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb0484fa3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788797174.074525:0:14305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374579968 00000100:00100000:3.0:1788797174.074533:0:14305:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374579968 00000100:00100000:3.0:1788797174.074566:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788797174.074576:0:14305:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb06e473850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73f6407e-c8af-46fc-9cc4-279490305b80+18:15726:x1875689374579968:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788797174.074758:0:14305:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb06e473850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73f6407e-c8af-46fc-9cc4-279490305b80+18:15726:x1875689374579968:12345-0@lo:502:mount.lustre.0 Request processed in 183us (774us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797174.074766:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788797174.074874:0:15726:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb0795d9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73f6407e-c8af-46fc-9cc4-279490305b80:15726:1875689374579968:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788797174.075137:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:2.0:1788797174.075194:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:2.0:1788797174.075234:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:2.0:1788797174.075285:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:2.0:1788797174.075317:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:2.0:1788797174.075377:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:2.0:1788797174.075415:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:2.0:1788797174.075464:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:2.0:1788797174.075499:0:15726:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb0795d9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73f6407e-c8af-46fc-9cc4-279490305b80:15726:1875689374580096:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788797174.075544:0:15726:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788797174.075568:0:15726:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb0484fa3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788797174.075879:0:14304:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374580096 00000100:00100000:0.0:1788797174.075887:0:14304:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374580096 00000100:00100000:0.0:1788797174.075926:0:14304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788797174.075934:0:14304:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb06e471050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73f6407e-c8af-46fc-9cc4-279490305b80+18:15726:x1875689374580096:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788797174.076237:0:14304:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb06e471050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73f6407e-c8af-46fc-9cc4-279490305b80+18:15726:x1875689374580096:12345-0@lo:502:mount.lustre.0 Request processed in 303us (693us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797174.076246:0:14304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788797174.076392:0:15726:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb0795d9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73f6407e-c8af-46fc-9cc4-279490305b80:15726:1875689374580096:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788797174.076496:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:2.0:1788797174.076507:0:15726:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:0.0:1788797174.077500:0:15732:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788797174.077512:0:15732:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788797174.077514:0:15732:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788797174.077520:0:15732:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8cb046310000 00000020:00000080:0.0:1788797174.077523:0:15732:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788797174.077529:0:15732:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788797174.077532:0:15732:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788797174.077533:0:15732:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1788797174.077535:0:15732:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788797174.077538:0:15732:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788797174.077539:0:15732:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1788797174.077541:0:15732:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8cb046310000 00000020:00000080:0.0:1788797174.077543:0:15732:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788797174.077604:0:15732:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788797174.077607:0:15732:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788797174.077609:0:15732:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1788797174.077611:0:15732:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788797174.077614:0:15732:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788797174.077615:0:15732:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788797174.077619:0:15732:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8cb046310000 00000020:00000080:0.0:1788797174.077621:0:15732:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788797174.077654:0:15732:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788797174.077671:0:15732:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788797174.077673:0:15732:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1788797174.077676:0:15732:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:3.0:1788797174.077826:0:15726:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:3.0:1788797174.077851:0:15726:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.138@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788797174.077876:0:15726:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.138@tcp lock: ffff8cb040031400/0xca7fc0c411f947af lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xca7fc0c411f947b6 expref: -99 pid: 15726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797174.077890:0:15726:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.138@tcp lock: ffff8cb040031400/0xca7fc0c411f947af lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xca7fc0c411f947b6 expref: -99 pid: 15726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788797174.077937:0:15726:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1788797174.077940:0:15726:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8cb046310000 10000000:01000000:3.0:1788797174.077943:0:15726:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8cb046310000 10000000:01000000:3.0:1788797174.077947:0:15726:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788797174.077959:0:15726:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8cb046310000 from 1 10000000:01000000:3.0:1788797174.077962:0:15726:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788797174.077995:0:15726:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.138@tcp lock: ffff8cb077c69a00/0xca7fc0c411f947bd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797174.078004:0:15726:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.138@tcp lock: ffff8cb077c69a00/0xca7fc0c411f947bd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797174.078016:0:15726:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.138@tcp lock: ffff8cb077c69a00/0xca7fc0c411f947bd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788797174.078414:0:15726:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb0778dea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73f6407e-c8af-46fc-9cc4-279490305b80:15726:1875689374580224:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788797174.078484:0:15726:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788797174.078525:0:15726:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb042befc00 going to sleep for 11 seconds 00000100:00100000:0.0:1788797174.078627:0:14304:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374580224 00000100:00100000:0.0:1788797174.078636:0:14304:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374580224 00000100:00100000:0.0:1788797174.078672:0:14304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788797174.078682:0:14304:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb06e471850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73f6407e-c8af-46fc-9cc4-279490305b80+18:15726:x1875689374580224:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788797174.078696:0:14304:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788797174.078710:0:14304:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cb079b81c00/0xca7fc0c411f947c4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xca7fc0c411f947bd expref: -99 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797174.078736:0:14304:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cb079b81c00/0xca7fc0c411f947c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xca7fc0c411f947bd expref: 19 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797174.078747:0:14304:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cb079b81c00/0xca7fc0c411f947c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xca7fc0c411f947bd expref: 19 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797174.078756:0:14304:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb079b81c00, rc 0) 00000100:00100000:0.0:1788797174.078793:0:14304:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb06e471850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73f6407e-c8af-46fc-9cc4-279490305b80+19:15726:x1875689374580224:12345-0@lo:101:mount.lustre.0 Request processed in 112us (309us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797174.078800:0:14304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788797174.080388:0:15726:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb0778dea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73f6407e-c8af-46fc-9cc4-279490305b80:15726:1875689374580224:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788797174.080413:0:15726:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.138@tcp lock: ffff8cb077c69a00/0xca7fc0c411f947bd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xca7fc0c411f947c4 expref: -99 pid: 15726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797174.080424:0:15726:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.138@tcp lock: ffff8cb077c69a00/0xca7fc0c411f947bd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xca7fc0c411f947c4 expref: -99 pid: 15726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788797174.081601:0:15726:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:3.0:1788797174.084945:0:15726:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788797174.087587:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:3.0:1788797174.087646:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:3.0:1788797174.087680:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:3.0:1788797174.087739:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:3.0:1788797174.087800:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:3.0:1788797174.087868:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:3.0:1788797174.089532:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:3.0:1788797174.089689:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:3.0:1788797174.089770:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:3.0:1788797174.089809:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:3.0:1788797174.089845:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:3.0:1788797174.089920:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:3.0:1788797174.089956:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:3.0:1788797174.089988:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:3.0:1788797174.091394:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:3.0:1788797174.091490:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:3.0:1788797174.091528:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:3.0:1788797174.091584:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:3.0:1788797174.091619:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:3.0:1788797174.091649:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:3.0:1788797174.091692:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:3.0:1788797174.091722:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:3.0:1788797174.091755:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:3.0:1788797174.091806:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:3.0:1788797174.091843:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:3.0:1788797174.091881:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:3.0:1788797174.091929:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:3.0:1788797174.091985:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:3.0:1788797174.092019:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:3.0:1788797174.095313:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13416 00000040:00080000:3.0:1788797174.095400:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13504 00000040:00080000:3.0:1788797174.095448:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13632 00000040:00080000:3.0:1788797174.095485:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13776 00000040:00080000:3.0:1788797174.095537:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13904 00000040:00080000:3.0:1788797174.095573:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14128 00000040:00080000:3.0:1788797174.095622:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14352 00000040:00080000:3.0:1788797174.095658:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14432 00000040:00080000:3.0:1788797174.095772:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14656 00000040:00080000:3.0:1788797174.095780:0:15726:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:3.0:1788797174.095914:0:15726:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb0778dea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73f6407e-c8af-46fc-9cc4-279490305b80:15726:1875689374580352:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788797174.095991:0:15726:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788797174.096325:0:14304:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374580352 00000100:00100000:0.0:1788797174.096333:0:14304:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374580352 00000100:00100000:0.0:1788797174.096389:0:14304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788797174.096399:0:14304:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb06e473c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73f6407e-c8af-46fc-9cc4-279490305b80+19:15726:x1875689374580352:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788797174.096659:0:14304:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb06e473c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73f6407e-c8af-46fc-9cc4-279490305b80+19:15726:x1875689374580352:12345-0@lo:501:mount.lustre.0 Request processed in 261us (667us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797174.096667:0:14304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788797174.098184:0:15726:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb042befc00 going to sleep for 11 seconds 00000100:00100000:3.0:1788797174.098230:0:15726:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb0778dea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73f6407e-c8af-46fc-9cc4-279490305b80:15726:1875689374580352:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788797174.098289:0:15726:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb0778dea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73f6407e-c8af-46fc-9cc4-279490305b80:15726:1875689374580480:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788797174.098358:0:15726:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788797174.098388:0:15726:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb042befc00 going to sleep for 11 seconds 00000100:00100000:2.0:1788797174.099178:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374580480 00000100:00100000:2.0:1788797174.099190:0:14303:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374580480 00000100:00100000:2.0:1788797174.099247:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788797174.099257:0:14303:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb06e471450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73f6407e-c8af-46fc-9cc4-279490305b80+19:15726:x1875689374580480:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788797174.099508:0:14303:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb06e471450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73f6407e-c8af-46fc-9cc4-279490305b80+19:15726:x1875689374580480:12345-0@lo:503:mount.lustre.0 Request processed in 252us (1149us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797174.099516:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788797174.099632:0:15726:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb0778dea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73f6407e-c8af-46fc-9cc4-279490305b80:15726:1875689374580480:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788797174.100712:0:15726:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788797174.100801:0:15726:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb0778dea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73f6407e-c8af-46fc-9cc4-279490305b80:15726:1875689374580608:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788797174.100867:0:15726:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788797174.100895:0:15726:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb046bf0480 going to sleep for 11 seconds 00000100:00100000:0.0:1788797174.101201:0:14304:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374580608 00000100:00100000:0.0:1788797174.101216:0:14304:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374580608 00000100:00100000:0.0:1788797174.101262:0:14304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788797174.101270:0:14304:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb077bed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73f6407e-c8af-46fc-9cc4-279490305b80+19:15726:x1875689374580608:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788797174.101494:0:14304:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb077bed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73f6407e-c8af-46fc-9cc4-279490305b80+19:15726:x1875689374580608:12345-0@lo:502:mount.lustre.0 Request processed in 224us (627us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797174.101502:0:14304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788797174.103365:0:15726:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb0778dea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73f6407e-c8af-46fc-9cc4-279490305b80:15726:1875689374580608:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788797174.103758:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:3.0:1788797174.103829:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:3.0:1788797174.103877:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:3.0:1788797174.103923:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:3.0:1788797174.103959:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:3.0:1788797174.104005:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:3.0:1788797174.106260:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:3.0:1788797174.106330:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:3.0:1788797174.106391:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:3.0:1788797174.106419:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:3.0:1788797174.106462:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:3.0:1788797174.106500:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:3.0:1788797174.106528:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:3.0:1788797174.106554:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:3.0:1788797174.106617:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:3.0:1788797174.106653:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:3.0:1788797174.106679:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:3.0:1788797174.106717:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:3.0:1788797174.106757:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:3.0:1788797174.106785:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:3.0:1788797174.106822:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:3.0:1788797174.106849:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:3.0:1788797174.106875:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:3.0:1788797174.106912:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:3.0:1788797174.106939:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:3.0:1788797174.106965:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:3.0:1788797174.107000:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:3.0:1788797174.109208:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:3.0:1788797174.109322:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:3.0:1788797174.109408:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:3.0:1788797174.109460:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:3.0:1788797174.109654:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:3.0:1788797174.109689:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:3.0:1788797174.109742:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:3.0:1788797174.114670:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:3.0:1788797174.114828:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:3.0:1788797174.114870:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:3.0:1788797174.114907:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:3.0:1788797174.114961:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:3.0:1788797174.114997:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:3.0:1788797174.115110:0:15726:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb0778dea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73f6407e-c8af-46fc-9cc4-279490305b80:15726:1875689374580736:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788797174.115222:0:15726:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788797174.115291:0:15726:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb042befc00 going to sleep for 11 seconds 00000100:00100000:0.0:1788797174.115614:0:14304:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374580736 00000100:00100000:0.0:1788797174.115623:0:14304:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374580736 00000100:00100000:0.0:1788797174.115691:0:14304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788797174.115700:0:14304:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb077becc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73f6407e-c8af-46fc-9cc4-279490305b80+19:15726:x1875689374580736:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788797174.115971:0:14304:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb077becc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73f6407e-c8af-46fc-9cc4-279490305b80+19:15726:x1875689374580736:12345-0@lo:502:mount.lustre.0 Request processed in 269us (746us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797174.115979:0:14304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788797174.117280:0:15726:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb0778dea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73f6407e-c8af-46fc-9cc4-279490305b80:15726:1875689374580736:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788797174.117406:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:3.0:1788797174.117422:0:15726:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:1.0:1788797174.118839:0:15737:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1788797174.118877:0:15737:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff8caf41bc19c0) 00000020:00000080:1.0:1788797174.118908:0:15737:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type lwp with refcount 2 00000020:01000004:1.0:1788797174.118979:0:15737:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8cb046310000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1788797174.118983:0:15737:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8cb046310000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1788797174.118985:0:15737:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8cb046310000 3 00010000:00080000:1.0:1788797174.119020:0:15737:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8caf41bce000@lustre-MDT0000-lwp-OST0001: add connection 192.168.204.138@tcp at head 00010000:00010000:1.0:1788797174.123346:0:15737:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-5 is initialized 00000020:00000080:1.0:1788797174.123623:0:15737:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:1.0:1788797174.123670:0:15737:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788797174.123687:0:15737:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xca7fc0c411f947d2 00000100:00080000:1.0:1788797174.123699:0:15737:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788797174.123715:0:15737:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8caf41bce000 using connection 192.168.204.138@tcp/0@lo 00000100:00100000:1.0:1788797174.123760:0:15737:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cb0795c6d80 x1875689374580864/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788797174.123798:0:15737:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1788797174.123853:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788797174.123858:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788797174.123860:0:8:0:(import.c:65:import_set_state_nolock()) ffff8cb05ca5a000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788797174.123864:0:8:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 460 00000100:00080000:1.0:1788797174.123867:0:8:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788797174.123872:0:8:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8cb05ca5a000 using connection 192.168.204.138@tcp/0@lo 00000100:00100000:1.0:1788797174.123884:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cb0795c6680 x1875689374581120/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788797174.124189:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb0795c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3301:1875689374581376:0@lo:400:kworker.0 00000100:00100000:0.0:1788797174.124264:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788797174.124304:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788797174.124310:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb0795c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3301:1875689374581248:0@lo:400:kworker.0 00000100:00100000:0.0:1788797174.124331:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788797174.124358:0:14309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374581376 00000100:00100000:0.0:1788797174.124365:0:14309:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374581376 00000100:00080000:2.0:1788797174.124410:0:14306:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788797174.124420:0:14309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374581248 00000100:00100000:0.0:1788797174.124423:0:14309:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374581248 00000100:00100000:0.0:1788797174.124464:0:14309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788797174.124474:0:14309:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb06f57f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1875689374581376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788797174.124534:0:14309:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb06f57f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1875689374581376:12345-0@lo:400:kworker.0 Request processed in 61us (269us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797174.124542:0:14309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788797174.124566:0:14309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788797174.124572:0:14309:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb06f57ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1875689374581248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788797174.124600:0:14309:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb06f57ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1875689374581248:12345-0@lo:400:kworker.0 Request processed in 29us (269us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797174.124606:0:14309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:0.0:1788797174.124641:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cb0795c5180 x1875689374581248/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788797190 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788797174.124657:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb0795c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3301:1875689374581248:0@lo:400:kworker.0 00010000:00080000:0.0:1788797174.124669:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cb0795c7800 x1875689374581376/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788797190 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788797174.124676:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb0795c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3301:1875689374581376:0@lo:400:kworker.0 00000100:00100000:3.0:1788797174.125181:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb0795c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3299:1875689374580864:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788797174.125226:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788797174.125265:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb0795c6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3299:1875689374581120:0@lo:8:kworker.0 00000100:00100000:3.0:1788797174.125289:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788797174.125325:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb0795c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875689374580992:0@lo:400:kworker.0 00000100:00100000:3.0:1788797174.125347:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788797174.125384:0:15017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374580864 00000100:00100000:3.0:1788797174.125389:0:15017:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374580864 00000100:00100000:3.0:1788797174.125415:0:15017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788797174.125421:0:15017:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0778dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3299:x1875689374580864:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1788797174.125455:0:15017:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 463 last 0 00000020:00000080:3.0:1788797174.125491:0:15017:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xca7fc0c411f947d9 00000004:00100000:3.0:1788797174.125514:0:15017:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788797174.125551:0:15017:0:(import.c:65:import_set_state_nolock()) ffff8cb0812e4000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788797174.125607:0:15017:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0778dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1875689374580864:12345-0@lo:38:llog_process_th.0 Request processed in 184us (380us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797174.125614:0:15017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788797174.125640:0:14995:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374581120 00000100:00100000:3.0:1788797174.125644:0:14995:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374581120 00000100:00100000:3.0:1788797174.125659:0:14995:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374580992 00000100:00100000:3.0:1788797174.125661:0:14995:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374580992 00000100:00100000:3.0:1788797174.125692:0:14995:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788797174.125699:0:14995:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0778ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1875689374580992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788797174.125734:0:14995:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0778ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1875689374580992:12345-0@lo:400:kworker.0 Request processed in 36us (386us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797174.125740:0:14995:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788797174.125762:0:14995:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788797174.125765:0:14995:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0778dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3299:x1875689374581120:12345-0@lo:8:kworker.0 00000100:00100000:3.0:1788797174.125799:0:14995:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0778dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3299:x1875689374581120:12345-0@lo:8:kworker.0 Request processed in 32us (509us total) trans 0 rc -11/-11 00000100:00100000:3.0:1788797174.125805:0:14995:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:3.0:1788797174.125831:0:14306:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788797174.125849:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb0795c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875689374580992:0@lo:400:kworker.0 00010000:00080000:2.0:1788797174.125850:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cb0795c6d80 x1875689374580864/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788797184 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788797174.125859:0:3299:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788797174.125867:0:3299:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:2.0:1788797174.125876:0:3299:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1788797174.125881:0:3299:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788797174.125884:0:3299:0:(import.c:65:import_set_state_nolock()) ffff8caf41bce000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788797174.125896:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb0795c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3299:1875689374580864:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788797174.125907:0:3299:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788797174.125911:0:3299:0:(import.c:65:import_set_state_nolock()) ffff8cb05ca5a000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788797174.125914:0:3299:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1788797174.125917:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb0795c6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3299:1875689374581120:0@lo:8:kworker.0 00000040:00080000:1.0:1788797174.129480:0:15737:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:3.0:1788797174.129633:0:15726:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:3.0:1788797174.129663:0:15726:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.138@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788797174.129689:0:15726:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.138@tcp lock: ffff8cb077c69a00/0xca7fc0c411f947bd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xca7fc0c411f947c4 expref: -99 pid: 15726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797174.129701:0:15726:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.138@tcp lock: ffff8cb077c69a00/0xca7fc0c411f947bd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xca7fc0c411f947c4 expref: -99 pid: 15726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1788797174.129744:0:15726:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1788797174.129746:0:15726:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788797174.129747:0:15726:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788797174.129748:0:15726:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788797174.129750:0:15726:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788797174.129751:0:15726:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788797174.129752:0:15726:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788797174.129754:0:15726:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788797174.129756:0:15726:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788797174.129760:0:15726:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:3.0:1788797174.129763:0:15726:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788797174.129764:0:15726:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788797174.129765:0:15726:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788797174.129767:0:15726:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788797174.129768:0:15726:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788797174.129769:0:15726:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788797174.129770:0:15726:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788797174.129771:0:15726:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788797174.129772:0:15726:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788797174.129801:0:15726:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1788797174.129824:0:15726:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb0778dd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73f6407e-c8af-46fc-9cc4-279490305b80:15726:1875689374581504:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788797174.129898:0:15726:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788797174.129939:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374581504 00000100:00100000:3.0:1788797174.129946:0:14303:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374581504 00000100:00100000:3.0:1788797174.129991:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788797174.130000:0:14303:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb077bef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73f6407e-c8af-46fc-9cc4-279490305b80+19:15726:x1875689374581504:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788797174.130243:0:14303:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1788797174.130257:0:14303:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:3.0:1788797174.130735:0:15726:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb046bf0480 going to sleep for 11 seconds 20000000:01000000:3.0:1788797174.169400:0:14303:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788797174.169464:0:14303:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:0.0:1788797174.169586:0:14325:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788797174.169592:0:14325:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788797174.169623:0:14325:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cb079b81600/0xca7fc0c411f947e0 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797174.169650:0:14325:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cb077c69400/0xca7fc0c411f946ba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xca7fc0c411f946b3 expref: 19 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797174.169659:0:14325:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8cb079b81600/0xca7fc0c411f947e0 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797174.169777:0:14325:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cb077c69400/0xca7fc0c411f946ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xca7fc0c411f946b3 expref: 19 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797174.169793:0:14325:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8cb077c69400/0xca7fc0c411f946ba lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xca7fc0c411f946b3 expref: 19 pid: 14305 timeout: 563 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788797174.169830:0:14325:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb06f57d500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14325:1875689374581632:0@lo:104: 00000100:00100000:0.0:1788797174.169897:0:14325:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788797174.170109:0:14325:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb06cd99b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788797174.170169:0:14294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374581632 00000100:00100000:1.0:1788797174.170179:0:14294:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374581632 00000100:00100000:1.0:1788797174.170307:0:14294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788797174.170316:0:14294:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb06f57e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:73f6407e-c8af-46fc-9cc4-279490305b80+3:14325:x1875689374581632:12345-0@lo:104: 00010000:00010000:1.0:1788797174.170330:0:14294:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.138@tcp lock: ffff8cb040031e00/0xca7fc0c411f946b3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xca7fc0c411f946ba expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797174.170397:0:14294:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788797174.170403:0:14294:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb06f57e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:73f6407e-c8af-46fc-9cc4-279490305b80+3:14325:x1875689374581632:12345-0@lo:104: Request processed in 89us (506us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797174.170409:0:14294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:3.0:1788797174.170460:0:14298:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788797174.170467:0:14298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.138@tcp lock: ffff8cb040031e00/0xca7fc0c411f946b3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xca7fc0c411f946ba expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797174.170475:0:14298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb040031e00 already unused, calling callback (ffffffffc1adac20) 10000000:00010000:3.0:1788797174.170478:0:14298:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.138@tcp lock: ffff8cb040031e00/0xca7fc0c411f946b3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xca7fc0c411f946ba expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797174.170487:0:14298:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.138@tcp lock: ffff8cb040031e00/0xca7fc0c411f946b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xca7fc0c411f946ba expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788797174.170506:0:14298:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.138@tcp lock: ffff8cb040031e00/0xca7fc0c411f946b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xca7fc0c411f946ba expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788797174.170511:0:14298:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788797174.170542:0:14298:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.138@tcp lock: ffff8cb040031e00/0xca7fc0c411f946b3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca7fc0c411f946ba expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797174.170549:0:14298:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788797174.170579:0:14298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.138@tcp lock: ffff8cb040031e00/0xca7fc0c411f946b3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca7fc0c411f946ba expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797174.170586:0:14298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.138@tcp lock: ffff8cb040031e00/0xca7fc0c411f946b3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca7fc0c411f946ba expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797174.170604:0:14298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788797174.170606:0:14298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788797174.170608:0:14298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788797174.170620:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb0778dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:73f6407e-c8af-46fc-9cc4-279490305b80:3302:1875689374581760:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788797174.170651:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788797174.171612:0:14295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374581760 00000100:00100000:0.0:1788797174.171623:0:14295:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374581760 00010000:00010000:0.0:1788797174.171656:0:14295:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cb077c69400/0xca7fc0c411f946ba lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xca7fc0c411f946b3 expref: 20 pid: 14305 timeout: 563 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788797174.171698:0:14295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788797174.171707:0:14295:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0778df100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:73f6407e-c8af-46fc-9cc4-279490305b80+20:3302:x1875689374581760:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788797174.171721:0:14295:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788797174.171726:0:14295:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cb077c69400/0xca7fc0c411f946ba lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xca7fc0c411f946b3 expref: 20 pid: 14305 timeout: 563 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797174.171877:0:14295:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cb077c69400/0xca7fc0c411f946ba lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xca7fc0c411f946b3 expref: 20 pid: 14305 timeout: 563 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797174.171901:0:14295:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8cb079b81600/0xca7fc0c411f947e0 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797174.171911:0:14295:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cb079b81600/0xca7fc0c411f947e0 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788797174.171933:0:14295:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.005413833s 00010000:00010000:0.0:1788797174.171939:0:14295:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cb079b81600/0xca7fc0c411f947e0 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797174.171948:0:14295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cb079b81600/0xca7fc0c411f947e0 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797174.171973:0:14295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cb079b81600/0xca7fc0c411f947e0 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797174.171981:0:14295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cb079b81600/0xca7fc0c411f947e0 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797174.171988:0:14295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb079b81600 already unused, calling callback (ffffffffc14d98b0) 00010000:00010000:0.0:1788797174.171994:0:14295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cb079b81600/0xca7fc0c411f947e0 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797174.172005:0:14295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cb079b81600/0xca7fc0c411f947e0 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797174.172017:0:14295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cb079b81600/0xca7fc0c411f947e0 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797174.172148:0:14295:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788797174.172254:0:14295:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0778df100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:73f6407e-c8af-46fc-9cc4-279490305b80+20:3302:x1875689374581760:12345-0@lo:103:ldlm_bl.0 Request processed in 548us (1600us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797174.172263:0:14295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:0.0:1788797174.172309:0:14325:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cb077c69400/0xca7fc0c411f946ba lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xca7fc0c411f946b3 expref: 19 pid: 14305 timeout: 563 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788797174.172321:0:14325:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb06f57d500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14325:1875689374581632:0@lo:104: 00010000:00010000:0.0:1788797174.172339:0:14325:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8cb079b81600/0xca7fc0c411f947e0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797174.172347:0:14325:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8cb079b81600/0xca7fc0c411f947e0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797174.172365:0:14325:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cb079b81600/0xca7fc0c411f947e0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797174.172371:0:14325:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cb079b81600/0xca7fc0c411f947e0 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788797174.172628:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb0778dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:73f6407e-c8af-46fc-9cc4-279490305b80:3302:1875689374581760:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788797174.178498:0:14303:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb077bef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73f6407e-c8af-46fc-9cc4-279490305b80+18:15726:x1875689374581504:12345-0@lo:253:mount.lustre.0 Request processed in 48483us (48584us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797174.178519:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788797174.178636:0:15726:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb0778dd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73f6407e-c8af-46fc-9cc4-279490305b80:15726:1875689374581504:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788797174.178661:0:15726:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1788797174.178666:0:15726:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788797174.178668:0:15726:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788797174.178669:0:15726:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788797174.178670:0:15726:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788797174.178672:0:15726:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788797174.178673:0:15726:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788797174.178675:0:15726:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788797174.178678:0:15726:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788797174.178679:0:15726:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1788797174.178697:0:15726:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1788797174.185735:0:15726:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:3.0:1788797174.185897:0:15726:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1788797174.187554:0:15726:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:3.0:1788797174.188213:0:15726:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1788797174.188408:0:15726:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:3.0:1788797174.188639:0:15726:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:0.0:1788797174.189733:0:15726:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:0.0:1788797174.258254:0:15726:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:0.0:1788797174.258266:0:15726:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:0.0:1788797174.258312:0:15726:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1788797174.258397:0:15726:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.138@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1788797174.258412:0:15726:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=49 00000080:00000004:0.0:1788797174.258470:0:15726:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:2.0:1788797174.578285:0:15413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788797175.282204:0:14307:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788797175.282212:0:14307:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8cb07906b800 from 8 10000000:01000000:1.0:1788797175.282218:0:14307:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788797175.282266:0:14307:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.138@tcp lock: ffff8cb082044200/0xca7fc0c411f947e7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797175.282279:0:14307:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.138@tcp lock: ffff8cb082044200/0xca7fc0c411f947e7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797175.282291:0:14307:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.138@tcp lock: ffff8cb082044200/0xca7fc0c411f947e7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788797175.282319:0:14307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb0795c5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73f6407e-c8af-46fc-9cc4-279490305b80:14307:1875689374581888:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788797175.282390:0:14307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788797175.282492:0:14307:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb0484c0c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788797175.287934:0:14305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374581888 00000100:00100000:0.0:1788797175.287949:0:14305:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374581888 00000100:00100000:0.0:1788797175.288210:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788797175.288224:0:14305:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb077beec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73f6407e-c8af-46fc-9cc4-279490305b80+18:14307:x1875689374581888:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788797175.288282:0:14305:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788797175.288305:0:14305:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cb079b80600/0xca7fc0c411f947ee lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xca7fc0c411f947e7 expref: -99 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797175.288335:0:14305:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cb079b80600/0xca7fc0c411f947ee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xca7fc0c411f947e7 expref: 19 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797175.288348:0:14305:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cb079b80600/0xca7fc0c411f947ee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xca7fc0c411f947e7 expref: 19 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797175.288372:0:14305:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb079b80600, rc 0) 00000100:00100000:0.0:1788797175.288472:0:14305:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb077beec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73f6407e-c8af-46fc-9cc4-279490305b80+19:14307:x1875689374581888:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 252us (6081us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797175.288479:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788797175.288609:0:14307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb0795c5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73f6407e-c8af-46fc-9cc4-279490305b80:14307:1875689374581888:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788797175.288631:0:14307:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.138@tcp lock: ffff8cb082044200/0xca7fc0c411f947e7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xca7fc0c411f947ee expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797175.288642:0:14307:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.138@tcp lock: ffff8cb082044200/0xca7fc0c411f947e7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xca7fc0c411f947ee expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788797175.288723:0:14307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb0795d9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73f6407e-c8af-46fc-9cc4-279490305b80:14307:1875689374582016:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1788797175.288769:0:14307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788797175.292236:0:14307:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb053e25cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788797175.293656:0:14305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374582016 00000100:00100000:0.0:1788797175.293672:0:14305:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374582016 00000100:00100000:0.0:1788797175.293736:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788797175.293747:0:14305:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb077bed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73f6407e-c8af-46fc-9cc4-279490305b80+19:14307:x1875689374582016:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788797175.293774:0:14305:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788797175.293801:0:14305:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788797175.293804:0:14305:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:0.0:1788797175.294069:0:14305:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb077bed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73f6407e-c8af-46fc-9cc4-279490305b80+19:14307:x1875689374582016:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 323us (5297us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797175.294077:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788797175.294115:0:14307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb0795d9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73f6407e-c8af-46fc-9cc4-279490305b80:14307:1875689374582016:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1788797175.294181:0:14307:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.138@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788797175.294190:0:14307:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.138@tcp lock: ffff8cb082044200/0xca7fc0c411f947e7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xca7fc0c411f947ee expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797175.294202:0:14307:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.138@tcp lock: ffff8cb082044200/0xca7fc0c411f947e7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xca7fc0c411f947ee expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797175.608083:0:14299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788797176.373883:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb0778dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875689374582144:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788797176.373966:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788797176.374214:0:14997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374582144 00000100:00100000:0.0:1788797176.374225:0:14997:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374582144 00000100:00100000:0.0:1788797176.374295:0:14997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788797176.374307:0:14997:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0778dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875689374582144:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788797176.374360:0:14997:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788797176.374435:0:14997:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0778dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875689374582144:12345-0@lo:13:osp-pre-0-0.0 Request processed in 131us (469us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797176.374443:0:14997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788797176.374500:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb0778dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875689374582144:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788797176.374621:0:14306:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788797176.627215:0:14298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788797177.650227:0:15413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788797178.674270:0:14299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788797179.449664:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788797179.449671:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788797179.449675:0:37:0:(import.c:65:import_set_state_nolock()) ffff8cb05ca5a000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788797179.449707:0:37:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8cb05ca5a000 using connection 192.168.204.138@tcp/0@lo 00000100:00100000:1.0:1788797179.449732:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cb0795c4380 x1875689374582528/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788797179.449806:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb0795c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:73f6407e-c8af-46fc-9cc4-279490305b80:3300:1875689374582272:0@lo:400:kworker.0 00000100:00100000:0.0:1788797179.449990:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb0795c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875689374582400:0@lo:400:kworker.0 00000100:00100000:0.0:1788797179.450071:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788797179.450142:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb0795c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3303:1875689374582784:0@lo:400:kworker.0 00000100:00100000:0.0:1788797179.450168:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788797179.450189:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788797179.450195:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb0795c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875689374582656:0@lo:400:kworker.0 00000100:00100000:0.0:1788797179.450215:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788797179.450290:0:14995:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374582400 00000100:00100000:0.0:1788797179.450298:0:14995:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374582400 00000100:00100000:0.0:1788797179.450361:0:14995:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788797179.450370:0:14995:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb06f57d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3301:x1875689374582400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788797179.450420:0:14995:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb06f57d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3301:x1875689374582400:12345-0@lo:400:kworker.0 Request processed in 51us (349us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797179.450428:0:14995:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788797179.450449:0:14311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374582784 00000100:00100000:0.0:1788797179.450453:0:14311:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374582784 00000100:00100000:0.0:1788797179.450478:0:14311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374582656 00000100:00100000:0.0:1788797179.450480:0:14311:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374582656 00000100:00100000:0.0:1788797179.450496:0:14311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788797179.450501:0:14311:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb06f57d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875689374582784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788797179.450534:0:14311:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb06f57d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875689374582784:12345-0@lo:400:kworker.0 Request processed in 33us (365us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797179.450548:0:14311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788797179.450560:0:14311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788797179.450565:0:14311:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb06f57dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875689374582656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788797179.450592:0:14311:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb06f57dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875689374582656:12345-0@lo:400:kworker.0 Request processed in 27us (377us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797179.450598:0:14311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:0.0:1788797179.450616:0:14306:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788797179.450621:0:14306:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788797179.450647:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb0795c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875689374582400:0@lo:400:kworker.0 00010000:00080000:0.0:1788797179.450680:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cb0795c4700 x1875689374582656/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788797195 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788797179.450690:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb0795c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875689374582656:0@lo:400:kworker.0 00010000:00080000:0.0:1788797179.450699:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cb0795c7480 x1875689374582784/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788797195 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788797179.450707:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb0795c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3303:1875689374582784:0@lo:400:kworker.0 00000100:00100000:1.0:1788797179.450943:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788797179.450974:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb0795c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3300:1875689374582912:0@lo:400:kworker.0 00000100:00100000:1.0:1788797179.450999:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788797179.451044:0:14305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374582272 00000100:00100000:1.0:1788797179.451048:0:14305:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374582272 00000100:00100000:1.0:1788797179.451075:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788797179.451082:0:14305:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb077bec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73f6407e-c8af-46fc-9cc4-279490305b80+19:3300:x1875689374582272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788797179.451117:0:14305:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb077bec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73f6407e-c8af-46fc-9cc4-279490305b80+19:3300:x1875689374582272:12345-0@lo:400:kworker.0 Request processed in 35us (174us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797179.451123:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788797179.451151:0:14311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374582912 00000100:00100000:1.0:1788797179.451154:0:14311:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374582912 00000100:00100000:1.0:1788797179.451180:0:14311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788797179.451186:0:14311:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0795c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1875689374582912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788797179.451212:0:14311:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0795c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1875689374582912:12345-0@lo:400:kworker.0 Request processed in 27us (212us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797179.451217:0:14311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:1.0:1788797179.451232:0:14306:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788797179.451250:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb0795c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:73f6407e-c8af-46fc-9cc4-279490305b80:3300:1875689374582272:0@lo:400:kworker.0 00010000:00080000:1.0:1788797179.451260:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cb0795c5c00 x1875689374582912/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788797195 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788797179.451283:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb0795c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3300:1875689374582912:0@lo:400:kworker.0 00000100:00100000:3.0:1788797179.457091:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb0795c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3299:1875689374582528:0@lo:8:kworker.0 00000100:00100000:3.0:1788797179.457172:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788797179.457243:0:15405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374582528 00000100:00100000:3.0:1788797179.457250:0:15405:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374582528 00000100:00100000:3.0:1788797179.457288:0:15405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788797179.457297:0:15405:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0778dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3299:x1875689374582528:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1788797179.457339:0:15405:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 468 last 0 00000020:00000080:3.0:1788797179.457369:0:15405:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xca7fc0c411f947f5 00002000:00100000:3.0:1788797179.457382:0:15405:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff8cb077f15800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:3.0:1788797179.457387:0:15405:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:3.0:1788797179.457389:0:15405:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1788797179.457720:0:15405:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788797179.457747:0:15405:0:(import.c:65:import_set_state_nolock()) ffff8cb046308000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788797179.457798:0:15405:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0778dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3299:x1875689374582528:12345-0@lo:8:kworker.0 Request processed in 500us (625us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797179.457805:0:15405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1788797179.459537:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cb0795c4380 x1875689374582528/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788797204 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788797179.459558:0:3299:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:3.0:1788797179.459567:0:3299:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1788797179.459573:0:3299:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1788797179.459575:0:3299:0:(import.c:65:import_set_state_nolock()) ffff8cb05ca5a000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1788797179.459603:0:3299:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1788797179.459609:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb0795c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3299:1875689374582528:0@lo:8:kworker.0 00000004:00080000:0.0:1788797179.459966:0:14334:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x280000400:0x5:0x0] 00000100:00100000:0.0:1788797179.459989:0:14334:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb06f57fb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14334:1875689374583168:0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1788797179.460061:0:14334:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788797179.460090:0:14334:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb0484fa0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788797179.460102:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788797179.460109:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb06f57c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875689374583040:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788797179.460133:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788797179.460161:0:14995:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374583168 00000100:00100000:0.0:1788797179.460167:0:14995:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374583168 00000100:00100000:0.0:1788797179.460225:0:14995:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788797179.460235:0:14995:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb06f57f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14334:x1875689374583168:12345-0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1788797179.461005:0:14333:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1788797179.461595:0:14333:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 468467564358ns, next at 0ns, rc = 0 00002000:00080000:0.0:1788797179.468238:0:14995:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:0.0:1788797179.468251:0:14995:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:0.0:1788797179.468257:0:14995:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:6 to 0x280000400:33) 00000100:00100000:0.0:1788797179.486485:0:14997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374583040 00000100:00100000:0.0:1788797179.486502:0:14997:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374583040 00000100:00100000:0.0:1788797179.486570:0:14997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788797179.486580:0:14997:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb06f57f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3300:x1875689374583040:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788797179.486628:0:14997:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00080000:3.0:1788797179.486906:0:14306:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788797179.487170:0:14997:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb06f57f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3300:x1875689374583040:12345-0@lo:13:osp-pre-1-0.0 Request processed in 591us (27034us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797179.487179:0:14997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1788797179.496074:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cb06f57c000 x1875689374583040/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788797195 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788797179.496107:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb06f57c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875689374583040:0@lo:13:osp-pre-1-0.0 00002000:00010000:0.0:1788797179.497460:0:14995:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788797179.497475:0:14995:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000656ff96e/0xca7fc0c411f947fc lrc: 3/0,1 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797179.497492:0:14995:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=468s v=(0 0) 00010000:00010000:0.0:1788797179.497497:0:14995:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788797179.497503:0:14995:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000656ff96e/0xca7fc0c411f947fc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797179.497522:0:14995:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000656ff96e/0xca7fc0c411f947fc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797179.497539:0:14995:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000656ff96e/0xca7fc0c411f947fc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797179.497546:0:14995:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000656ff96e/0xca7fc0c411f947fc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797179.497562:0:14995:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788797179.498279:0:14995:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788797179.498288:0:14995:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002e5634f3/0xca7fc0c411f94803 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797179.498300:0:14995:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=468s v=(0 0) 00010000:00010000:0.0:1788797179.498303:0:14995:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788797179.498308:0:14995:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002e5634f3/0xca7fc0c411f94803 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797179.498319:0:14995:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002e5634f3/0xca7fc0c411f94803 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797179.498338:0:14995:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002e5634f3/0xca7fc0c411f94803 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797179.498346:0:14995:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002e5634f3/0xca7fc0c411f94803 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797179.498386:0:14995:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788797179.498407:0:15413:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788797179.498413:0:15413:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000656ff96e/0xca7fc0c411f947fc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797179.498420:0:15413:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb079b81400 already unused, calling callback (ffffffffc14d98b0) 00010000:00010000:0.0:1788797179.498424:0:15413:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000656ff96e/0xca7fc0c411f947fc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797179.498435:0:15413:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000656ff96e/0xca7fc0c411f947fc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797179.498455:0:15413:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000656ff96e/0xca7fc0c411f947fc lrc: 1/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797179.498463:0:15413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000656ff96e/0xca7fc0c411f947fc lrc: 0/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797179.498483:0:15413:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788797179.498486:0:15413:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002e5634f3/0xca7fc0c411f94803 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797179.498494:0:15413:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb079b80c00 already unused, calling callback (ffffffffc14d98b0) 00010000:00010000:0.0:1788797179.498496:0:15413:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002e5634f3/0xca7fc0c411f94803 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797179.498516:0:15413:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002e5634f3/0xca7fc0c411f94803 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797179.498527:0:15413:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002e5634f3/0xca7fc0c411f94803 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797179.498534:0:15413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002e5634f3/0xca7fc0c411f94803 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797179.498547:0:15413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788797179.498549:0:15413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788797179.498551:0:15413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788797179.498776:0:14298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788797179.503638:0:14995:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788797179.503650:0:14995:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003f7d6fa5/0xca7fc0c411f9480a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797179.503667:0:14995:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=468s v=(0 0) 00010000:00010000:0.0:1788797179.503671:0:14995:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788797179.503677:0:14995:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003f7d6fa5/0xca7fc0c411f9480a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797179.503690:0:14995:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003f7d6fa5/0xca7fc0c411f9480a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797179.503701:0:14995:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003f7d6fa5/0xca7fc0c411f9480a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797179.503716:0:14995:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003f7d6fa5/0xca7fc0c411f9480a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797179.503742:0:14995:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788797179.503758:0:14299:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788797179.503763:0:14299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003f7d6fa5/0xca7fc0c411f9480a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797179.503771:0:14299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb079b80e00 already unused, calling callback (ffffffffc14d98b0) 00010000:00010000:0.0:1788797179.503776:0:14299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003f7d6fa5/0xca7fc0c411f9480a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797179.503785:0:14299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003f7d6fa5/0xca7fc0c411f9480a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797179.503803:0:14299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003f7d6fa5/0xca7fc0c411f9480a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797179.503811:0:14299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003f7d6fa5/0xca7fc0c411f9480a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797179.504216:0:14299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788797179.504219:0:14299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788797179.504220:0:14299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788797179.505838:0:14995:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788797179.505860:0:14995:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000002186b9f/0xca7fc0c411f94811 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797179.505875:0:14995:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=468s v=(0 0) 00010000:00010000:0.0:1788797179.505879:0:14995:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788797179.505885:0:14995:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000002186b9f/0xca7fc0c411f94811 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797179.505898:0:14995:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000002186b9f/0xca7fc0c411f94811 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797179.505907:0:14995:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000002186b9f/0xca7fc0c411f94811 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797179.505915:0:14995:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000002186b9f/0xca7fc0c411f94811 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797179.505940:0:14995:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788797179.506487:0:14995:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788797179.506494:0:14995:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000319e1815/0xca7fc0c411f94818 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797179.506503:0:14995:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=468s v=(0 0) 00010000:00010000:0.0:1788797179.506507:0:14995:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788797179.506511:0:14995:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000319e1815/0xca7fc0c411f94818 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797179.506521:0:14995:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000319e1815/0xca7fc0c411f94818 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797179.506536:0:14995:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000319e1815/0xca7fc0c411f94818 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797179.506543:0:14995:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000319e1815/0xca7fc0c411f94818 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797179.506562:0:14995:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788797179.506575:0:14298:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788797179.506581:0:14298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000002186b9f/0xca7fc0c411f94811 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797179.506589:0:14298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb079b81e00 already unused, calling callback (ffffffffc14d98b0) 00010000:00010000:0.0:1788797179.506593:0:14298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000002186b9f/0xca7fc0c411f94811 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797179.506603:0:14298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000002186b9f/0xca7fc0c411f94811 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797179.506620:0:14298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000002186b9f/0xca7fc0c411f94811 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797179.506627:0:14298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000002186b9f/0xca7fc0c411f94811 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797179.506776:0:15413:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788797179.506784:0:15413:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000319e1815/0xca7fc0c411f94818 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797179.506792:0:15413:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb079b80000 already unused, calling callback (ffffffffc14d98b0) 00010000:00010000:2.0:1788797179.506795:0:15413:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000319e1815/0xca7fc0c411f94818 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797179.506811:0:15413:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000319e1815/0xca7fc0c411f94818 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797179.506824:0:15413:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000319e1815/0xca7fc0c411f94818 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797179.506831:0:15413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000319e1815/0xca7fc0c411f94818 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797179.506850:0:15413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788797179.506852:0:15413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788797179.506854:0:15413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788797179.507754:0:14298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788797179.507763:0:14298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788797179.507764:0:14298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788797179.508283:0:14995:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788797179.508291:0:14995:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ac27f509/0xca7fc0c411f9481f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797179.508307:0:14995:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=468s v=(0 0) 00010000:00010000:0.0:1788797179.508311:0:14995:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788797179.508316:0:14995:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ac27f509/0xca7fc0c411f9481f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797179.508340:0:14995:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ac27f509/0xca7fc0c411f9481f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797179.508350:0:14995:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ac27f509/0xca7fc0c411f9481f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797179.508357:0:14995:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ac27f509/0xca7fc0c411f9481f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797179.508382:0:14995:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788797179.508551:0:14299:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788797179.508560:0:14299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ac27f509/0xca7fc0c411f9481f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797179.508568:0:14299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb079b81800 already unused, calling callback (ffffffffc14d98b0) 00010000:00010000:2.0:1788797179.508573:0:14299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ac27f509/0xca7fc0c411f9481f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797179.508582:0:14299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ac27f509/0xca7fc0c411f9481f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797179.508597:0:14299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ac27f509/0xca7fc0c411f9481f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797179.508617:0:14299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788797179.508619:0:14299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788797179.508620:0:14299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788797179.508945:0:14995:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ac27f509/0xca7fc0c411f9481f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788797179.509549:0:14995:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788797179.509557:0:14995:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008543ee14/0xca7fc0c411f94826 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797179.509579:0:14995:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=468s v=(0 0) 00010000:00010000:0.0:1788797179.509583:0:14995:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788797179.509588:0:14995:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008543ee14/0xca7fc0c411f94826 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797179.509601:0:14995:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008543ee14/0xca7fc0c411f94826 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797179.509611:0:14995:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008543ee14/0xca7fc0c411f94826 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797179.509618:0:14995:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008543ee14/0xca7fc0c411f94826 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797179.509645:0:14995:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788797179.510145:0:14995:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788797179.510151:0:14995:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000abcbaae7/0xca7fc0c411f9482d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797179.510161:0:14995:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=468s v=(0 0) 00010000:00010000:0.0:1788797179.510164:0:14995:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788797179.510168:0:14995:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000abcbaae7/0xca7fc0c411f9482d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797179.510177:0:14995:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000abcbaae7/0xca7fc0c411f9482d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797179.510195:0:14995:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000abcbaae7/0xca7fc0c411f9482d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797179.510202:0:14995:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000abcbaae7/0xca7fc0c411f9482d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797179.510217:0:14995:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788797179.510227:0:14298:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788797179.510233:0:14298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008543ee14/0xca7fc0c411f94826 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797179.510240:0:14298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb079b81a00 already unused, calling callback (ffffffffc14d98b0) 00010000:00010000:0.0:1788797179.510245:0:14298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008543ee14/0xca7fc0c411f94826 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797179.510254:0:14298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008543ee14/0xca7fc0c411f94826 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797179.510268:0:14298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008543ee14/0xca7fc0c411f94826 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797179.510275:0:14298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008543ee14/0xca7fc0c411f94826 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797179.510292:0:14298:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788797179.510301:0:14298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000abcbaae7/0xca7fc0c411f9482d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797179.510308:0:14298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb079b81000 already unused, calling callback (ffffffffc14d98b0) 00010000:00010000:0.0:1788797179.510311:0:14298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000abcbaae7/0xca7fc0c411f9482d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797179.510318:0:14298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000abcbaae7/0xca7fc0c411f9482d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797179.511050:0:15413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788797179.511115:0:14298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000abcbaae7/0xca7fc0c411f9482d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797179.511123:0:14298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000abcbaae7/0xca7fc0c411f9482d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797179.511138:0:14298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788797179.511140:0:14298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788797179.511141:0:14298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788797179.511620:0:14995:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788797179.511627:0:14995:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d9aaaf35/0xca7fc0c411f94834 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797179.511698:0:14995:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=468s v=(0 0) 00010000:00010000:0.0:1788797179.511702:0:14995:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788797179.511707:0:14995:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d9aaaf35/0xca7fc0c411f94834 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797179.511728:0:14995:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d9aaaf35/0xca7fc0c411f94834 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797179.511737:0:14995:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d9aaaf35/0xca7fc0c411f94834 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797179.511745:0:14995:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d9aaaf35/0xca7fc0c411f94834 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797179.512116:0:14995:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788797179.512559:0:14995:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788797179.512565:0:14995:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000005160234/0xca7fc0c411f9483b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797179.512578:0:14995:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=468s v=(0 0) 00010000:00010000:0.0:1788797179.512582:0:14995:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788797179.512587:0:14995:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000005160234/0xca7fc0c411f9483b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797179.512597:0:14995:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000005160234/0xca7fc0c411f9483b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797179.512605:0:14995:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000005160234/0xca7fc0c411f9483b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797179.512621:0:14995:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000005160234/0xca7fc0c411f9483b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797179.517754:0:14299:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788797179.517770:0:14299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d9aaaf35/0xca7fc0c411f94834 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797179.517783:0:14299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb079b80400 already unused, calling callback (ffffffffc14d98b0) 00010000:00010000:2.0:1788797179.517789:0:14299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d9aaaf35/0xca7fc0c411f94834 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797179.517800:0:14299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d9aaaf35/0xca7fc0c411f94834 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797179.517822:0:14299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d9aaaf35/0xca7fc0c411f94834 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797179.517830:0:14299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d9aaaf35/0xca7fc0c411f94834 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797179.517858:0:14299:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788797179.517863:0:14299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000005160234/0xca7fc0c411f9483b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797179.517869:0:14299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb079b80200 already unused, calling callback (ffffffffc14d98b0) 00010000:00010000:2.0:1788797179.517883:0:14299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000005160234/0xca7fc0c411f9483b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797179.517892:0:14299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000005160234/0xca7fc0c411f9483b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797179.517903:0:14299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000005160234/0xca7fc0c411f9483b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797179.517910:0:14299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788797179.517911:0:14299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788797179.517913:0:14299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788797179.518001:0:14995:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788797179.518008:0:14995:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000005160234/0xca7fc0c411f9483b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797179.518797:0:15413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788797179.518989:0:14995:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788797179.518997:0:14995:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001be42e80/0xca7fc0c411f94842 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797179.519011:0:14995:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=468s v=(0 0) 00010000:00010000:0.0:1788797179.519016:0:14995:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788797179.519023:0:14995:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001be42e80/0xca7fc0c411f94842 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797179.519056:0:14995:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001be42e80/0xca7fc0c411f94842 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797179.519065:0:14995:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001be42e80/0xca7fc0c411f94842 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797179.519072:0:14995:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001be42e80/0xca7fc0c411f94842 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797179.519101:0:14995:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788797179.519114:0:14298:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788797179.519119:0:14298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001be42e80/0xca7fc0c411f94842 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797179.519126:0:14298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb079b80800 already unused, calling callback (ffffffffc14d98b0) 00010000:00010000:0.0:1788797179.519130:0:14298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001be42e80/0xca7fc0c411f94842 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797179.519138:0:14298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001be42e80/0xca7fc0c411f94842 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797179.519152:0:14298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001be42e80/0xca7fc0c411f94842 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797179.519159:0:14298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001be42e80/0xca7fc0c411f94842 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797179.519174:0:14298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788797179.519176:0:14298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788797179.519178:0:14298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788797179.520859:0:14995:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788797179.520874:0:14995:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002e54d865/0xca7fc0c411f94849 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797179.520894:0:14995:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=468s v=(0 0) 00010000:00010000:0.0:1788797179.520910:0:14995:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788797179.520917:0:14995:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002e54d865/0xca7fc0c411f94849 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797179.520934:0:14995:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002e54d865/0xca7fc0c411f94849 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797179.520945:0:14995:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002e54d865/0xca7fc0c411f94849 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797179.520955:0:14995:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002e54d865/0xca7fc0c411f94849 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797179.520981:0:14995:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788797179.521002:0:14299:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788797179.521008:0:14299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002e54d865/0xca7fc0c411f94849 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797179.521015:0:14299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb079b80a00 already unused, calling callback (ffffffffc14d98b0) 00010000:00010000:0.0:1788797179.521020:0:14299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002e54d865/0xca7fc0c411f94849 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797179.521045:0:14299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002e54d865/0xca7fc0c411f94849 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797179.521061:0:14299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002e54d865/0xca7fc0c411f94849 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797179.521079:0:14299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002e54d865/0xca7fc0c411f94849 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797179.521106:0:14299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788797179.521108:0:14299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788797179.521109:0:14299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788797179.525122:0:14995:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788797179.525140:0:14995:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ac27f509/0xca7fc0c411f94850 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797179.525160:0:14995:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=468s v=(0 0) 00010000:00010000:0.0:1788797179.525165:0:14995:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788797179.525172:0:14995:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ac27f509/0xca7fc0c411f94850 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797179.525187:0:14995:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ac27f509/0xca7fc0c411f94850 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797179.525199:0:14995:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ac27f509/0xca7fc0c411f94850 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797179.528746:0:14995:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ac27f509/0xca7fc0c411f94850 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797179.528788:0:14995:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788797179.528808:0:15413:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788797179.528824:0:15413:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ac27f509/0xca7fc0c411f94850 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797179.528834:0:15413:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb079b81800 already unused, calling callback (ffffffffc14d98b0) 00010000:00010000:0.0:1788797179.528839:0:15413:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ac27f509/0xca7fc0c411f94850 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797179.528851:0:15413:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ac27f509/0xca7fc0c411f94850 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797179.528872:0:15413:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ac27f509/0xca7fc0c411f94850 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797179.528880:0:15413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ac27f509/0xca7fc0c411f94850 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797179.528907:0:15413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788797179.528909:0:15413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788797179.528911:0:15413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788797179.529580:0:14995:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788797179.529589:0:14995:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000002186b9f/0xca7fc0c411f94857 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797179.529602:0:14995:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=468s v=(0 0) 00010000:00010000:0.0:1788797179.529606:0:14995:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788797179.529612:0:14995:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000002186b9f/0xca7fc0c411f94857 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797179.531734:0:14995:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000002186b9f/0xca7fc0c411f94857 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797179.531763:0:14995:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000002186b9f/0xca7fc0c411f94857 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797179.531772:0:14995:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000002186b9f/0xca7fc0c411f94857 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797179.531797:0:14995:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788797179.531818:0:14298:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788797179.531824:0:14298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000002186b9f/0xca7fc0c411f94857 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797179.531833:0:14298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb079b81e00 already unused, calling callback (ffffffffc14d98b0) 00010000:00010000:0.0:1788797179.531838:0:14298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000002186b9f/0xca7fc0c411f94857 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797179.531847:0:14298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000002186b9f/0xca7fc0c411f94857 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797179.531870:0:14298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000002186b9f/0xca7fc0c411f94857 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797179.531878:0:14298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000002186b9f/0xca7fc0c411f94857 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797179.531915:0:14298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788797179.531917:0:14298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788797179.531919:0:14298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788797179.534897:0:14995:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788797179.534913:0:14995:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003f7d6fa5/0xca7fc0c411f9485e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797179.534931:0:14995:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=468s v=(0 0) 00010000:00010000:0.0:1788797179.534936:0:14995:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788797179.534942:0:14995:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003f7d6fa5/0xca7fc0c411f9485e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797179.534957:0:14995:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003f7d6fa5/0xca7fc0c411f9485e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797179.534968:0:14995:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003f7d6fa5/0xca7fc0c411f9485e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797179.534976:0:14995:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003f7d6fa5/0xca7fc0c411f9485e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797179.535004:0:14995:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788797179.535616:0:14995:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788797179.535623:0:14995:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001be42e80/0xca7fc0c411f94865 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797179.537103:0:14299:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788797179.537115:0:14299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003f7d6fa5/0xca7fc0c411f9485e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797179.537129:0:14299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb079b80e00 already unused, calling callback (ffffffffc14d98b0) 00010000:00010000:2.0:1788797179.537133:0:14299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003f7d6fa5/0xca7fc0c411f9485e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797179.537144:0:14299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003f7d6fa5/0xca7fc0c411f9485e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797179.537165:0:14299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003f7d6fa5/0xca7fc0c411f9485e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797179.537172:0:14299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003f7d6fa5/0xca7fc0c411f9485e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797179.537206:0:14299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788797179.537208:0:14299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788797179.537209:0:14299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788797179.537508:0:14995:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=468s v=(0 0) 00010000:00010000:0.0:1788797179.537513:0:14995:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788797179.537519:0:14995:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001be42e80/0xca7fc0c411f94865 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797179.537531:0:14995:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001be42e80/0xca7fc0c411f94865 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797179.537540:0:14995:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001be42e80/0xca7fc0c411f94865 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797179.537548:0:14995:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001be42e80/0xca7fc0c411f94865 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797179.537563:0:14995:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788797179.537667:0:15413:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788797179.537674:0:15413:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001be42e80/0xca7fc0c411f94865 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797179.537681:0:15413:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb079b80800 already unused, calling callback (ffffffffc14d98b0) 00010000:00010000:1.0:1788797179.537685:0:15413:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001be42e80/0xca7fc0c411f94865 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797179.537692:0:15413:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001be42e80/0xca7fc0c411f94865 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797179.537706:0:15413:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001be42e80/0xca7fc0c411f94865 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797179.537714:0:15413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001be42e80/0xca7fc0c411f94865 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797179.537728:0:15413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788797179.537730:0:15413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788797179.537732:0:15413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788797179.538472:0:14995:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788797179.538481:0:14995:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000005160234/0xca7fc0c411f9486c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797179.538491:0:14995:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=468s v=(0 0) 00010000:00010000:0.0:1788797179.538495:0:14995:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788797179.538500:0:14995:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000005160234/0xca7fc0c411f9486c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797179.538510:0:14995:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000005160234/0xca7fc0c411f9486c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797179.538531:0:14995:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000005160234/0xca7fc0c411f9486c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797179.538538:0:14995:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000005160234/0xca7fc0c411f9486c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797179.538556:0:14995:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788797179.538930:0:14995:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788797179.538936:0:14995:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000abcbaae7/0xca7fc0c411f94873 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797179.538943:0:14995:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=468s v=(0 0) 00010000:00010000:0.0:1788797179.538946:0:14995:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788797179.538950:0:14995:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000abcbaae7/0xca7fc0c411f94873 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797179.538958:0:14995:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000abcbaae7/0xca7fc0c411f94873 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797179.538964:0:14995:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000abcbaae7/0xca7fc0c411f94873 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797179.538970:0:14995:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000abcbaae7/0xca7fc0c411f94873 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797179.538998:0:14995:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788797179.539013:0:14299:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788797179.539017:0:14299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000005160234/0xca7fc0c411f9486c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797179.539024:0:14299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb079b80200 already unused, calling callback (ffffffffc14d98b0) 00010000:00010000:0.0:1788797179.539060:0:14299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000005160234/0xca7fc0c411f9486c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797179.539070:0:14299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000005160234/0xca7fc0c411f9486c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797179.539082:0:14299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000005160234/0xca7fc0c411f9486c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797179.539089:0:14299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000005160234/0xca7fc0c411f9486c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797179.539105:0:14299:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788797179.539107:0:14299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000abcbaae7/0xca7fc0c411f94873 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797179.539113:0:14299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb079b81000 already unused, calling callback (ffffffffc14d98b0) 00010000:00010000:0.0:1788797179.539116:0:14299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000abcbaae7/0xca7fc0c411f94873 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797179.539134:0:14299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000abcbaae7/0xca7fc0c411f94873 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797179.539143:0:14299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000abcbaae7/0xca7fc0c411f94873 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797179.539149:0:14299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000abcbaae7/0xca7fc0c411f94873 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797179.539161:0:14299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788797179.539163:0:14299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788797179.539164:0:14299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788797179.539589:0:14995:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788797179.539595:0:14995:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008543ee14/0xca7fc0c411f9487a lrc: 3/0,1 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797179.539604:0:14995:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=468s v=(0 0) 00010000:00010000:0.0:1788797179.539607:0:14995:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788797179.539610:0:14995:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008543ee14/0xca7fc0c411f9487a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797179.539619:0:14995:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008543ee14/0xca7fc0c411f9487a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797179.539626:0:14995:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008543ee14/0xca7fc0c411f9487a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797179.539639:0:14995:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008543ee14/0xca7fc0c411f9487a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797179.539655:0:14995:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788797179.539665:0:15413:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788797179.539669:0:15413:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008543ee14/0xca7fc0c411f9487a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797179.539675:0:15413:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb079b81a00 already unused, calling callback (ffffffffc14d98b0) 00010000:00010000:0.0:1788797179.539678:0:15413:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008543ee14/0xca7fc0c411f9487a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797179.539685:0:15413:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008543ee14/0xca7fc0c411f9487a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797179.539696:0:15413:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008543ee14/0xca7fc0c411f9487a lrc: 1/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797179.539703:0:15413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008543ee14/0xca7fc0c411f9487a lrc: 0/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797179.539717:0:15413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788797179.539718:0:15413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788797179.539720:0:15413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788797179.540177:0:14995:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788797179.540189:0:14995:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002e54d865/0xca7fc0c411f94881 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797179.540197:0:14995:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=468s v=(0 0) 00010000:00010000:0.0:1788797179.540201:0:14995:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788797179.540205:0:14995:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002e54d865/0xca7fc0c411f94881 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797179.540214:0:14995:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002e54d865/0xca7fc0c411f94881 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797179.540222:0:14995:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002e54d865/0xca7fc0c411f94881 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797179.540229:0:14995:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002e54d865/0xca7fc0c411f94881 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797179.540245:0:14995:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788797179.540255:0:14299:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788797179.540258:0:14299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002e54d865/0xca7fc0c411f94881 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797179.540265:0:14299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb079b80a00 already unused, calling callback (ffffffffc14d98b0) 00010000:00010000:0.0:1788797179.540268:0:14299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002e54d865/0xca7fc0c411f94881 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797179.540277:0:14299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002e54d865/0xca7fc0c411f94881 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797179.540295:0:14299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002e54d865/0xca7fc0c411f94881 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797179.540302:0:14299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002e54d865/0xca7fc0c411f94881 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797179.540316:0:14299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788797179.540317:0:14299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788797179.540331:0:14299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788797179.540709:0:14995:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788797179.540715:0:14995:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002e5634f3/0xca7fc0c411f94888 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797179.540722:0:14995:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=468s v=(0 0) 00010000:00010000:0.0:1788797179.540724:0:14995:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788797179.540728:0:14995:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002e5634f3/0xca7fc0c411f94888 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797179.540737:0:14995:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002e5634f3/0xca7fc0c411f94888 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797179.540744:0:14995:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002e5634f3/0xca7fc0c411f94888 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797179.540750:0:14995:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002e5634f3/0xca7fc0c411f94888 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797179.541064:0:14298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788797179.545950:0:14995:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788797179.545971:0:15413:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788797179.545979:0:15413:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002e5634f3/0xca7fc0c411f94888 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797179.545988:0:15413:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb079b80c00 already unused, calling callback (ffffffffc14d98b0) 00010000:00010000:0.0:1788797179.545994:0:15413:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002e5634f3/0xca7fc0c411f94888 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797179.546006:0:15413:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002e5634f3/0xca7fc0c411f94888 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797179.546047:0:15413:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002e5634f3/0xca7fc0c411f94888 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797179.546056:0:15413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002e5634f3/0xca7fc0c411f94888 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797179.546082:0:15413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788797179.546084:0:15413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788797179.546085:0:15413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788797179.546700:0:14995:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788797179.546708:0:14995:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000656ff96e/0xca7fc0c411f9488f lrc: 3/0,1 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797179.546723:0:14995:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=468s v=(0 0) 00010000:00010000:0.0:1788797179.546735:0:14995:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788797179.546742:0:14995:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000656ff96e/0xca7fc0c411f9488f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797179.546756:0:14995:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000656ff96e/0xca7fc0c411f9488f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797179.546765:0:14995:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000656ff96e/0xca7fc0c411f9488f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797179.546773:0:14995:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000656ff96e/0xca7fc0c411f9488f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797179.546790:0:14995:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788797179.546800:0:14299:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788797179.546804:0:14299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000656ff96e/0xca7fc0c411f9488f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797179.546812:0:14299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb079b81400 already unused, calling callback (ffffffffc14d98b0) 00010000:00010000:0.0:1788797179.546815:0:14299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000656ff96e/0xca7fc0c411f9488f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797179.546822:0:14299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000656ff96e/0xca7fc0c411f9488f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797179.546833:0:14299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000656ff96e/0xca7fc0c411f9488f lrc: 1/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797179.546852:0:14299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000656ff96e/0xca7fc0c411f9488f lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797179.546867:0:14299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788797179.546869:0:14299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788797179.546871:0:14299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788797179.547266:0:14995:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788797179.547273:0:14995:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001cab9c7c/0xca7fc0c411f94896 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797179.547282:0:14995:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=468s v=(0 0) 00010000:00010000:0.0:1788797179.547285:0:14995:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788797179.547289:0:14995:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001cab9c7c/0xca7fc0c411f94896 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797179.547298:0:14995:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001cab9c7c/0xca7fc0c411f94896 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797179.547307:0:14995:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001cab9c7c/0xca7fc0c411f94896 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797179.547313:0:14995:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001cab9c7c/0xca7fc0c411f94896 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797179.547339:0:14995:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788797179.547724:0:14995:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788797179.547734:0:14995:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d9aaaf35/0xca7fc0c411f9489d lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797179.547742:0:14995:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=468s v=(0 0) 00010000:00010000:0.0:1788797179.547746:0:14995:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788797179.547750:0:14995:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d9aaaf35/0xca7fc0c411f9489d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797179.547759:0:14995:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d9aaaf35/0xca7fc0c411f9489d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797179.547767:0:14995:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d9aaaf35/0xca7fc0c411f9489d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797179.547774:0:14995:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d9aaaf35/0xca7fc0c411f9489d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797179.547789:0:14995:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788797179.547801:0:15413:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788797179.547805:0:15413:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001cab9c7c/0xca7fc0c411f94896 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797179.547813:0:15413:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb079b81600 already unused, calling callback (ffffffffc14d98b0) 00010000:00010000:0.0:1788797179.547816:0:15413:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001cab9c7c/0xca7fc0c411f94896 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797179.547824:0:15413:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001cab9c7c/0xca7fc0c411f94896 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797179.547843:0:15413:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001cab9c7c/0xca7fc0c411f94896 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797179.547850:0:15413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001cab9c7c/0xca7fc0c411f94896 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797179.547867:0:15413:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788797179.547870:0:15413:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d9aaaf35/0xca7fc0c411f9489d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797179.547876:0:15413:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb079b80400 already unused, calling callback (ffffffffc14d98b0) 00010000:00010000:0.0:1788797179.547880:0:15413:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d9aaaf35/0xca7fc0c411f9489d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797179.547887:0:15413:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d9aaaf35/0xca7fc0c411f9489d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797179.547897:0:15413:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d9aaaf35/0xca7fc0c411f9489d lrc: 1/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797179.547905:0:15413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d9aaaf35/0xca7fc0c411f9489d lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797179.547916:0:15413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788797179.547918:0:15413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788797179.547926:0:15413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788797179.548391:0:14995:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788797179.548400:0:14995:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000319e1815/0xca7fc0c411f948a4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797179.548410:0:14995:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=468s v=(0 0) 00010000:00010000:0.0:1788797179.548413:0:14995:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788797179.548417:0:14995:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000319e1815/0xca7fc0c411f948a4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797179.548426:0:14995:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000319e1815/0xca7fc0c411f948a4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797179.548435:0:14995:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000319e1815/0xca7fc0c411f948a4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797179.548442:0:14995:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000319e1815/0xca7fc0c411f948a4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797179.548458:0:14995:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788797179.548469:0:14299:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788797179.548473:0:14299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000319e1815/0xca7fc0c411f948a4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797179.548480:0:14299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb079b80000 already unused, calling callback (ffffffffc14d98b0) 00010000:00010000:0.0:1788797179.548484:0:14299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000319e1815/0xca7fc0c411f948a4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797179.548504:0:14299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000319e1815/0xca7fc0c411f948a4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797179.548516:0:14299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000319e1815/0xca7fc0c411f948a4 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797179.548524:0:14299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000319e1815/0xca7fc0c411f948a4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797179.548541:0:14299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788797179.548543:0:14299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788797179.548545:0:14299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788797179.551370:0:14995:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788797179.551386:0:14995:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000abcbaae7/0xca7fc0c411f948ab lrc: 3/0,1 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797179.551405:0:14995:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=468s v=(0 0) 00010000:00010000:0.0:1788797179.551410:0:14995:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788797179.551417:0:14995:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000abcbaae7/0xca7fc0c411f948ab lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797179.551433:0:14995:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000abcbaae7/0xca7fc0c411f948ab lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797179.551446:0:14995:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000abcbaae7/0xca7fc0c411f948ab lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797179.551465:0:14995:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000abcbaae7/0xca7fc0c411f948ab lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797179.551484:0:14995:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788797179.551503:0:15413:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788797179.551510:0:15413:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000abcbaae7/0xca7fc0c411f948ab lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797179.551518:0:15413:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb079b81000 already unused, calling callback (ffffffffc14d98b0) 00010000:00010000:0.0:1788797179.551523:0:15413:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000abcbaae7/0xca7fc0c411f948ab lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797179.551533:0:15413:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000abcbaae7/0xca7fc0c411f948ab lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797179.551551:0:15413:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000abcbaae7/0xca7fc0c411f948ab lrc: 1/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797179.551559:0:15413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000abcbaae7/0xca7fc0c411f948ab lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797179.551579:0:15413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788797179.551581:0:15413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788797179.551583:0:15413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788797179.552780:0:14298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1788797179.554204:0:5848:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00002000:00010000:0.0:1788797179.557930:0:14995:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788797179.557954:0:14995:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000005160234/0xca7fc0c411f948b2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797179.557971:0:14995:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=468s v=(0 0) 00010000:00010000:0.0:1788797179.557975:0:14995:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788797179.557981:0:14995:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000005160234/0xca7fc0c411f948b2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797179.557996:0:14995:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000005160234/0xca7fc0c411f948b2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797179.558008:0:14995:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000005160234/0xca7fc0c411f948b2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797179.558015:0:14995:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000005160234/0xca7fc0c411f948b2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797179.558055:0:14995:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788797179.558072:0:14299:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788797179.558078:0:14299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000005160234/0xca7fc0c411f948b2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797179.558087:0:14299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb079b80200 already unused, calling callback (ffffffffc14d98b0) 00010000:00010000:0.0:1788797179.558091:0:14299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000005160234/0xca7fc0c411f948b2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797179.558099:0:14299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000005160234/0xca7fc0c411f948b2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797179.558124:0:14299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000005160234/0xca7fc0c411f948b2 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797179.558132:0:14299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000005160234/0xca7fc0c411f948b2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797179.558155:0:14299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788797179.558157:0:14299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788797179.558159:0:14299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788797179.561080:0:14995:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788797179.561095:0:14995:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000002186b9f/0xca7fc0c411f948b9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797179.561113:0:14995:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=468s v=(0 0) 00010000:00010000:0.0:1788797179.561118:0:14995:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788797179.561125:0:14995:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000002186b9f/0xca7fc0c411f948b9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797179.561142:0:14995:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000002186b9f/0xca7fc0c411f948b9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797179.561155:0:14995:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000002186b9f/0xca7fc0c411f948b9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797179.561162:0:14995:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000002186b9f/0xca7fc0c411f948b9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797179.561200:0:14995:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788797179.561215:0:15413:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788797179.561220:0:15413:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000002186b9f/0xca7fc0c411f948b9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797179.561228:0:15413:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb079b81e00 already unused, calling callback (ffffffffc14d98b0) 00010000:00010000:0.0:1788797179.561234:0:15413:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000002186b9f/0xca7fc0c411f948b9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797179.561244:0:15413:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000002186b9f/0xca7fc0c411f948b9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797179.561262:0:15413:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000002186b9f/0xca7fc0c411f948b9 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797179.561270:0:15413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000002186b9f/0xca7fc0c411f948b9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797179.561296:0:15413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788797179.561298:0:15413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788797179.561300:0:15413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:0.0:1788797179.562909:0:14995:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x280000400:5 00000100:00100000:0.0:1788797179.564601:0:14995:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb06f57f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14334:x1875689374583168:12345-0@lo:5:osp-pre-1-0.0 Request processed in 104359us (104531us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797179.564616:0:14995:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788797179.564719:0:14334:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb06f57fb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14334:1875689374583168:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1788797179.564741:0:14334:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x5:0x0] 00000100:00100000:0.0:1788797179.564815:0:14334:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb06f57fb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14334:1875689374583296:0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1788797179.564872:0:14334:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788797179.564925:0:14334:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb0484fa0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788797179.564943:0:14995:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374583296 00000100:00100000:0.0:1788797179.564950:0:14995:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374583296 00000100:00100000:0.0:1788797179.565008:0:14993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788797179.565017:0:14993:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb06f57c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14334:x1875689374583296:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:0.0:1788797179.565095:0:14993:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 34 00000100:00100000:0.0:1788797179.580205:0:14993:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb06f57c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:14334:x1875689374583296:12345-0@lo:5:osp-pre-1-0.0 Request processed in 15177us (15320us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1788797179.580218:0:14993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788797179.580279:0:14334:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb06f57fb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14334:1875689374583296:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1788797179.580298:0:14334:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00010000:00010000:1.0:1788797179.708812:0:14298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788797180.731271:0:14299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788797181.085974:0:16083:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg438-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:2.0:1788797181.495955:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788797181.495982:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb06f57d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875689374583424:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788797181.496108:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788797181.496240:0:14998:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374583424 00000100:00100000:0.0:1788797181.496248:0:14998:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374583424 00000100:00100000:0.0:1788797181.496322:0:14998:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788797181.496332:0:14998:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0795d9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875689374583424:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788797181.496366:0:14998:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788797181.496415:0:14998:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0795d9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875689374583424:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (307us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797181.496423:0:14998:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:2.0:1788797181.496486:0:14306:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788797181.496523:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb06f57d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875689374583424:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788797181.746423:0:15413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788797182.770337:0:14298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788797183.155840:0:14343:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1788797183.726447:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1788797183.726557:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351520896 00000100:00100000:2.0:1788797183.726569:0:14303:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351520896 00000100:00100000:2.0:1788797183.726614:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 76 00000100:00100000:2.0:1788797183.726622:0:14303:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb077befc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2351:x1875689351520896:12345-192.168.204.38@tcp:250:mount.lustre.0 00010000:00080000:2.0:1788797183.726653:0:14303:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from 17a8599e-7555-4132-8043-ffdcb544e5c7@192.168.204.38@tcp t0 exp 0000000000000000 cur 472 last 0 00000020:00000080:2.0:1788797183.726691:0:14303:0:(genops.c:1384:class_connect()) connect: client 17a8599e-7555-4132-8043-ffdcb544e5c7, cookie 0xca7fc0c411f948c0 00000100:00080000:2.0:1788797183.727214:0:14303:0:(import.c:65:import_set_state_nolock()) ffff8cb0501a8000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788797183.727359:0:14303:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb077befc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17a8599e-7555-4132-8043-ffdcb544e5c7+5:2351:x1875689351520896:12345-192.168.204.38@tcp:250:mount.lustre.0 Request processed in 736us (925us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797183.727369:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 76 00000100:00100000:1.0:1788797183.759553:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1788797183.760672:0:14304:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351521024 00000100:00100000:2.0:1788797183.760687:0:14304:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351521024 00000100:00100000:1.0:1788797183.762076:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 77 00000100:00100000:1.0:1788797183.762100:0:14305:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb077bec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17a8599e-7555-4132-8043-ffdcb544e5c7+5:13753:x1875689351521024:12345-192.168.204.38@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788797183.762130:0:14305:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788797183.762156:0:14305:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cb080437200/0xca7fc0c411f948c7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x7c99e04559ee13ae expref: -99 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797183.762193:0:14305:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cb080437200/0xca7fc0c411f948c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee13ae expref: 6 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797183.762204:0:14305:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cb080437200/0xca7fc0c411f948c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee13ae expref: 6 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797183.762215:0:14305:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb080437200, rc 0) 00000100:00100000:1.0:1788797183.762313:0:14305:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb077bec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17a8599e-7555-4132-8043-ffdcb544e5c7+6:13753:x1875689351521024:12345-192.168.204.38@tcp:101:mount.lustre.0 Request processed in 223us (2770us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797183.762321:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 77 00000100:00100000:3.0:1788797183.764884:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1788797183.765819:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351521152 00000100:00100000:2.0:1788797183.765833:0:14303:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351521152 00000100:00100000:2.0:1788797183.765902:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 78 00000100:00100000:2.0:1788797183.765939:0:14303:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb077bedc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17a8599e-7555-4132-8043-ffdcb544e5c7+6:13753:x1875689351521152:12345-192.168.204.38@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788797183.766497:0:14303:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb077bedc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17a8599e-7555-4132-8043-ffdcb544e5c7+6:13753:x1875689351521152:12345-192.168.204.38@tcp:501:mount.lustre.0 Request processed in 560us (1626us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788797183.766507:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 78 00000100:00100000:2.0:1788797183.771683:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1788797183.771865:0:14304:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351521280 00000100:00100000:0.0:1788797183.771877:0:14304:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351521280 00000100:00100000:0.0:1788797183.771935:0:14304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 79 00000100:00100000:0.0:1788797183.771949:0:14304:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb077bed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17a8599e-7555-4132-8043-ffdcb544e5c7+6:13753:x1875689351521280:12345-192.168.204.38@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788797183.771972:0:14304:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788797183.771998:0:14304:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cb079b80400/0xca7fc0c411f948ce lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x7c99e04559ee13b5 expref: -99 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797183.772081:0:14304:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cb079b80400/0xca7fc0c411f948ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee13b5 expref: 7 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797183.772094:0:14304:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cb079b80400/0xca7fc0c411f948ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee13b5 expref: 7 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797183.772105:0:14304:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb079b80400, rc 0) 00000100:00100000:0.0:1788797183.772180:0:14304:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb077bed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17a8599e-7555-4132-8043-ffdcb544e5c7+7:13753:x1875689351521280:12345-192.168.204.38@tcp:101:mount.lustre.0 Request processed in 234us (506us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797183.772188:0:14304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 79 00000100:00100000:3.0:1788797183.774431:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1788797183.774521:0:14305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351521408 00000100:00100000:1.0:1788797183.774531:0:14305:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351521408 00000100:00100000:1.0:1788797183.774587:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 80 00000100:00100000:1.0:1788797183.774598:0:14305:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb077bef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17a8599e-7555-4132-8043-ffdcb544e5c7+7:13753:x1875689351521408:12345-192.168.204.38@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788797183.774958:0:14305:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb077bef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17a8599e-7555-4132-8043-ffdcb544e5c7+8:13753:x1875689351521408:12345-192.168.204.38@tcp:501:mount.lustre.0 Request processed in 362us (535us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797183.774967:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 80 00000100:00100000:3.0:1788797183.777208:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1788797183.777345:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351521536 00000100:00100000:2.0:1788797183.777363:0:14303:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351521536 00000100:00100000:2.0:1788797183.777435:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 81 00000100:00100000:2.0:1788797183.777449:0:14303:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb077bee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17a8599e-7555-4132-8043-ffdcb544e5c7+8:13753:x1875689351521536:12345-192.168.204.38@tcp:503:mount.lustre.0 00000100:00100000:2.0:1788797183.777858:0:14303:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb077bee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17a8599e-7555-4132-8043-ffdcb544e5c7+8:13753:x1875689351521536:12345-192.168.204.38@tcp:503:mount.lustre.0 Request processed in 410us (661us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797183.777868:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 81 00000100:00100000:2.0:1788797183.781137:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1788797183.781618:0:14304:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351521664 00000100:00100000:1.0:1788797183.781629:0:14304:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351521664 00000100:00100000:1.0:1788797183.781691:0:14304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 82 00000100:00100000:1.0:1788797183.781703:0:14304:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb077bee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17a8599e-7555-4132-8043-ffdcb544e5c7+8:13772:x1875689351521664:12345-192.168.204.38@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788797183.782187:0:14304:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb077bee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17a8599e-7555-4132-8043-ffdcb544e5c7+8:13772:x1875689351521664:12345-192.168.204.38@tcp:502:llog_process_th.0 Request processed in 484us (1058us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797183.782197:0:14304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 82 00010000:00010000:0.0:1788797183.794205:0:14299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788797183.813003:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1788797183.818276:0:14305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351521792 00000100:00100000:1.0:1788797183.818294:0:14305:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351521792 00000100:00100000:2.0:1788797183.818482:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 83 00000100:00100000:2.0:1788797183.818497:0:14305:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb077bee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17a8599e-7555-4132-8043-ffdcb544e5c7+8:13772:x1875689351521792:12345-192.168.204.38@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788797183.819314:0:14305:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb077bee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17a8599e-7555-4132-8043-ffdcb544e5c7+8:13772:x1875689351521792:12345-192.168.204.38@tcp:502:llog_process_th.0 Request processed in 816us (6409us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797183.819324:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 83 00000100:00100000:3.0:1788797183.839670:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1788797183.839874:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351521920 00000100:00100000:2.0:1788797183.839886:0:14303:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351521920 00000100:00100000:2.0:1788797183.840073:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 84 00000100:00100000:2.0:1788797183.840087:0:14303:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb079e28850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17a8599e-7555-4132-8043-ffdcb544e5c7+8:13753:x1875689351521920:12345-192.168.204.38@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788797183.840112:0:14303:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788797183.840136:0:14303:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cb040031e00/0xca7fc0c411f948d5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x7c99e04559ee13df expref: -99 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797183.840183:0:14303:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cb040031e00/0xca7fc0c411f948d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee13df expref: 9 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797183.840196:0:14303:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cb040031e00/0xca7fc0c411f948d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee13df expref: 9 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797183.840205:0:14303:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb040031e00, rc 0) 00000100:00100000:2.0:1788797183.840288:0:14303:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb079e28850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17a8599e-7555-4132-8043-ffdcb544e5c7+9:13753:x1875689351521920:12345-192.168.204.38@tcp:101:mount.lustre.0 Request processed in 204us (630us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797183.840295:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 84 00000100:00100000:0.0:1788797183.846573:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1788797183.846680:0:14305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351522048 00000100:00100000:2.0:1788797183.846691:0:14305:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351522048 00000100:00100000:2.0:1788797183.846840:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 85 00000100:00100000:2.0:1788797183.846854:0:14305:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb079e2bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17a8599e-7555-4132-8043-ffdcb544e5c7+9:13753:x1875689351522048:12345-192.168.204.38@tcp:256:mount.lustre.0 20000000:01000000:2.0:1788797183.846890:0:14305:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1788797183.846942:0:14305:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1788797183.846948:0:14305:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1788797183.846951:0:14305:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1788797183.846954:0:14305:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:2.0:1788797183.853009:0:14305:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb079e2bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17a8599e-7555-4132-8043-ffdcb544e5c7+9:13753:x1875689351522048:12345-192.168.204.38@tcp:256:mount.lustre.0 Request processed in 6144us (6431us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797183.853025:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 85 00000100:00100000:3.0:1788797183.858390:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1788797183.858495:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351522176 00000100:00100000:2.0:1788797183.858506:0:14303:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351522176 00000100:00100000:2.0:1788797183.858566:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 86 00000100:00100000:2.0:1788797183.858809:0:14303:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb079e2a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17a8599e-7555-4132-8043-ffdcb544e5c7+9:13753:x1875689351522176:12345-192.168.204.38@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788797183.858844:0:14303:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788797183.858861:0:14303:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cb040030400/0xca7fc0c411f948dc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x7c99e04559ee13e6 expref: -99 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797183.858888:0:14303:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cb040030400/0xca7fc0c411f948dc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee13e6 expref: 10 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797183.858898:0:14303:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cb040030400/0xca7fc0c411f948dc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee13e6 expref: 10 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797183.858907:0:14303:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb040030400, rc 0) 00000100:00100000:2.0:1788797183.858958:0:14303:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb079e2a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17a8599e-7555-4132-8043-ffdcb544e5c7+10:13753:x1875689351522176:12345-192.168.204.38@tcp:101:mount.lustre.0 Request processed in 380us (579us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797183.858965:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 86 00000100:00100000:0.0:1788797183.865144:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1788797183.868891:0:14305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351522304 00000100:00100000:2.0:1788797183.868911:0:14305:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351522304 00000100:00100000:2.0:1788797183.868993:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 87 00000100:00100000:2.0:1788797183.869003:0:14305:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb079e2b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17a8599e-7555-4132-8043-ffdcb544e5c7+10:13753:x1875689351522304:12345-192.168.204.38@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788797183.869370:0:14305:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb079e2b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17a8599e-7555-4132-8043-ffdcb544e5c7+10:13753:x1875689351522304:12345-192.168.204.38@tcp:501:mount.lustre.0 Request processed in 367us (4236us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797183.869379:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 87 00000100:00100000:3.0:1788797183.875804:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1788797183.875905:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351522432 00000100:00100000:2.0:1788797183.875916:0:14303:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351522432 00000100:00100000:2.0:1788797183.876063:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 88 00000100:00100000:2.0:1788797183.876074:0:14303:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb079e29850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17a8599e-7555-4132-8043-ffdcb544e5c7+10:13753:x1875689351522432:12345-192.168.204.38@tcp:503:mount.lustre.0 00000100:00100000:2.0:1788797183.876480:0:14303:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb079e29850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17a8599e-7555-4132-8043-ffdcb544e5c7+10:13753:x1875689351522432:12345-192.168.204.38@tcp:503:mount.lustre.0 Request processed in 407us (689us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797183.876495:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 88 00000100:00100000:3.0:1788797183.882562:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1788797183.884758:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351522560 00000100:00100000:2.0:1788797183.884776:0:14303:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351522560 00000100:00100000:2.0:1788797183.884837:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 89 00000100:00100000:2.0:1788797183.884846:0:14303:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb079e29050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17a8599e-7555-4132-8043-ffdcb544e5c7+10:13776:x1875689351522560:12345-192.168.204.38@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788797183.885156:0:14303:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb079e29050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17a8599e-7555-4132-8043-ffdcb544e5c7+10:13776:x1875689351522560:12345-192.168.204.38@tcp:502:llog_process_th.0 Request processed in 310us (2609us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797183.885164:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 89 00000100:00100000:3.0:1788797183.894264:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1788797183.895327:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351522688 00000100:00100000:2.0:1788797183.895344:0:14303:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351522688 00000100:00100000:2.0:1788797183.895403:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 90 00000100:00100000:2.0:1788797183.895415:0:14303:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb079e2b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17a8599e-7555-4132-8043-ffdcb544e5c7+10:13776:x1875689351522688:12345-192.168.204.38@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788797183.895704:0:14303:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb079e2b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17a8599e-7555-4132-8043-ffdcb544e5c7+10:13776:x1875689351522688:12345-192.168.204.38@tcp:502:llog_process_th.0 Request processed in 291us (1451us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797183.895713:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 90 00000100:00100000:3.0:1788797183.907153:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1788797183.907333:0:14309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351522816 00000100:00100000:0.0:1788797183.907347:0:14309:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351522816 00000100:00100000:0.0:1788797183.907407:0:14309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 4 00000100:00100000:0.0:1788797183.907417:0:14309:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0778dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2351:x1875689351522816:12345-192.168.204.38@tcp:38:mount.lustre.0 00010000:00080000:0.0:1788797183.907453:0:14309:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from 8d52f9f5-7df3-47f4-a430-77f8dd50f6ec@192.168.204.38@tcp t0 exp 0000000000000000 cur 472 last 0 00000020:00000080:0.0:1788797183.907653:0:14309:0:(genops.c:1384:class_connect()) connect: client 8d52f9f5-7df3-47f4-a430-77f8dd50f6ec, cookie 0xca7fc0c411f948e3 00000004:00100000:0.0:1788797183.908392:0:14309:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:0.0:1788797183.908400:0:14309:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000100:00080000:0.0:1788797183.989891:0:14309:0:(import.c:65:import_set_state_nolock()) ffff8caf41991800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788797183.990217:0:14309:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0778dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8d52f9f5-7df3-47f4-a430-77f8dd50f6ec+6:2351:x1875689351522816:12345-192.168.204.38@tcp:38:mount.lustre.0 Request processed in 82799us (83072us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797183.990228:0:14309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 4 00000100:00100000:3.0:1788797183.993288:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1788797183.993433:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1788797183.994472:0:14311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351522944 00000100:00100000:1.0:1788797183.994487:0:14311:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351522944 00000100:00100000:2.0:1788797183.994632:0:14311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351523072 00000100:00100000:2.0:1788797183.994637:0:14311:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351523072 00000100:00100000:2.0:1788797183.994669:0:14311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 5 00000100:00100000:2.0:1788797183.994679:0:14311:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0778dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8d52f9f5-7df3-47f4-a430-77f8dd50f6ec+7:0:x1875689351522944:12345-192.168.204.38@tcp:41:mount.lustre.0 00000004:00000024:2.0:1788797183.994731:0:14311:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1788797183.994839:0:14311:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0778dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8d52f9f5-7df3-47f4-a430-77f8dd50f6ec+7:0:x1875689351522944:12345-192.168.204.38@tcp:41:mount.lustre.0 Request processed in 160us (1560us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797183.994847:0:14311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 5 00000100:00100000:2.0:1788797183.994867:0:14311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 6 00000100:00100000:2.0:1788797183.994893:0:14311:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8caf42060000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8d52f9f5-7df3-47f4-a430-77f8dd50f6ec+6:13753:x1875689351523072:12345-192.168.204.38@tcp:41:mount.lustre.0 00000004:00000024:2.0:1788797183.994907:0:14311:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1788797183.994931:0:14311:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8caf42060000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8d52f9f5-7df3-47f4-a430-77f8dd50f6ec+6:13753:x1875689351523072:12345-192.168.204.38@tcp:41:mount.lustre.0 Request processed in 39us (1497us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797183.994937:0:14311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 6 00000100:00080000:3.0:1788797183.995141:0:14306:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788797183.998345:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1788797183.998503:0:14311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351523200 00000100:00100000:2.0:1788797183.998513:0:14311:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351523200 00000100:00100000:3.0:1788797183.998778:0:14309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 7 00000100:00100000:3.0:1788797183.998789:0:14309:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8caf42062a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8d52f9f5-7df3-47f4-a430-77f8dd50f6ec+6:13753:x1875689351523200:12345-192.168.204.38@tcp:40:mount.lustre.0 00000100:00100000:3.0:1788797183.998898:0:14309:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8caf42062a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8d52f9f5-7df3-47f4-a430-77f8dd50f6ec+6:13753:x1875689351523200:12345-192.168.204.38@tcp:40:mount.lustre.0 Request processed in 111us (562us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797183.998905:0:14309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 7 00000100:00100000:2.0:1788797184.001425:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1788797184.001474:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1788797184.001556:0:14996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351523328 00000100:00100000:3.0:1788797184.001573:0:14996:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351523328 00000100:00100000:3.0:1788797184.001619:0:14996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9 00000100:00100000:3.0:1788797184.001628:0:14996:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0795daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2351:x1875689351523328:12345-192.168.204.38@tcp:8:mount.lustre.0 00010000:00080000:3.0:1788797184.001674:0:14996:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 8d52f9f5-7df3-47f4-a430-77f8dd50f6ec@192.168.204.38@tcp t0 exp 0000000000000000 cur 473 last 0 00000020:00000080:3.0:1788797184.001705:0:14996:0:(genops.c:1384:class_connect()) connect: client 8d52f9f5-7df3-47f4-a430-77f8dd50f6ec, cookie 0xca7fc0c411f948ea 00002000:00100000:3.0:1788797184.001717:0:14996:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 8d52f9f5-7df3-47f4-a430-77f8dd50f6ec/ffff8cb04550c800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788797184.001741:0:14996:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788797184.002090:0:14996:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1788797184.002121:0:14996:0:(import.c:65:import_set_state_nolock()) ffff8cb045508000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788797184.002186:0:14996:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0795daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8d52f9f5-7df3-47f4-a430-77f8dd50f6ec+6:2351:x1875689351523328:12345-192.168.204.38@tcp:8:mount.lustre.0 Request processed in 558us (771us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797184.002194:0:14996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9 00000100:00100000:1.0:1788797184.002952:0:14304:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351523584 00000100:00100000:1.0:1788797184.002961:0:14304:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351523584 00000100:00100000:1.0:1788797184.003016:0:14304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 91 00000100:00100000:1.0:1788797184.003025:0:14304:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb079e29c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17a8599e-7555-4132-8043-ffdcb544e5c7+10:2353:x1875689351523584:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:1.0:1788797184.003093:0:14304:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb079e29c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17a8599e-7555-4132-8043-ffdcb544e5c7+10:2353:x1875689351523584:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 69us (1619us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797184.003100:0:14304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 91 00000100:00100000:2.0:1788797184.009183:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1788797184.009226:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1788797184.009328:0:15405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351523456 00000100:00100000:3.0:1788797184.009339:0:15405:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351523456 00000100:00100000:3.0:1788797184.009397:0:15405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 10 00000100:00100000:3.0:1788797184.009405:0:15405:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0795da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2351:x1875689351523456:12345-192.168.204.38@tcp:8:mount.lustre.0 00010000:00080000:3.0:1788797184.009442:0:15405:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 8d52f9f5-7df3-47f4-a430-77f8dd50f6ec@192.168.204.38@tcp t0 exp 0000000000000000 cur 473 last 0 00000020:00000080:3.0:1788797184.009477:0:15405:0:(genops.c:1384:class_connect()) connect: client 8d52f9f5-7df3-47f4-a430-77f8dd50f6ec, cookie 0xca7fc0c411f948f1 00000100:00100000:0.0:1788797184.009483:0:14312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351523712 00002000:00100000:3.0:1788797184.009489:0:15405:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 8d52f9f5-7df3-47f4-a430-77f8dd50f6ec/ffff8cb045509000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00000100:00100000:0.0:1788797184.009490:0:14312:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351523712 00002000:00100000:3.0:1788797184.009517:0:15405:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00000100:00100000:0.0:1788797184.009534:0:14312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 0 00000100:00100000:0.0:1788797184.009543:0:14312:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0795d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8d52f9f5-7df3-47f4-a430-77f8dd50f6ec+6:13753:x1875689351523712:12345-192.168.204.38@tcp:33:mount.lustre.0 00002000:00080000:3.0:1788797184.009769:0:15405:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788797184.009811:0:15405:0:(import.c:65:import_set_state_nolock()) ffff8cb07aac2800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788797184.009875:0:15405:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0795da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8d52f9f5-7df3-47f4-a430-77f8dd50f6ec+6:2351:x1875689351523456:12345-192.168.204.38@tcp:8:mount.lustre.0 Request processed in 469us (701us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797184.009883:0:15405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 10 00000004:00080000:0.0:1788797184.013673:0:14312:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 4061us 00000004:00200000:1.0:1788797184.053998:0:14312:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:1.0:1788797184.054171:0:14312:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0795d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8d52f9f5-7df3-47f4-a430-77f8dd50f6ec+6:13753:x1875689351523712:12345-192.168.204.38@tcp:33:mount.lustre.0 Request processed in 44623us (44937us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797184.054187:0:14312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 0 00000100:00100000:2.0:1788797184.237633:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1788797184.238634:0:14310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351523840 00000100:00100000:1.0:1788797184.238657:0:14310:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351523840 00000100:00100000:1.0:1788797184.238733:0:14310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 8 00000100:00100000:1.0:1788797184.238745:0:14310:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0795dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8d52f9f5-7df3-47f4-a430-77f8dd50f6ec+6:13797:x1875689351523840:12345-192.168.204.38@tcp:101:mkdir.0 00010000:00010000:1.0:1788797184.238773:0:14310:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788797184.238810:0:14310:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080437000/0xca7fc0c411f948f8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c99e04559ee1410 expref: -99 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797184.238930:0:14310:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080436800/0xca7fc0c411f948ff lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797184.238971:0:14310:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080436800/0xca7fc0c411f948ff lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797184.238994:0:14310:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080436800/0xca7fc0c411f948ff lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788797184.239093:0:14310:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788797184.239097:0:14310:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788797184.239142:0:14310:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080436800/0xca7fc0c411f948ff lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797184.239175:0:14310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080437000/0xca7fc0c411f948f8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1410 expref: 8 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797184.239385:0:14310:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080436800/0xca7fc0c411f948ff lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1410 expref: 7 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797184.239395:0:14310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cb06ce84800) 00010000:00010000:1.0:1788797184.239399:0:14310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788797184.239403:0:14310:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb080436800, rc 0) 00000100:00100000:1.0:1788797184.241294:0:14310:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0795dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8d52f9f5-7df3-47f4-a430-77f8dd50f6ec+7:13797:x1875689351523840:12345-192.168.204.38@tcp:101:mkdir.0 Request processed in 1719us (2841us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797184.241321:0:14310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 8 00000100:00100000:0.0:1788797184.562704:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb06f57d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875689374583680:0@lo:400:kworker.0 00000100:00100000:0.0:1788797184.562781:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788797184.562844:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb048e28700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3300:1875689374584192:0@lo:400:kworker.0 00000100:00100000:0.0:1788797184.562872:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788797184.562898:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788797184.562903:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb048e2aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875689374583808:0@lo:400:kworker.0 00000100:00100000:0.0:1788797184.562924:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788797184.562963:0:14996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374583680 00000100:00100000:0.0:1788797184.562971:0:14996:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374583680 00000100:00100000:0.0:1788797184.563025:0:14996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374583808 00000100:00100000:0.0:1788797184.563048:0:14996:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374583808 00000100:00100000:0.0:1788797184.563073:0:14996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788797184.563081:0:14996:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb048e28e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3300:x1875689374583680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788797184.563135:0:14996:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb048e28e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3300:x1875689374583680:12345-0@lo:400:kworker.0 Request processed in 55us (353us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797184.563423:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb048e2b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875689374583936:0@lo:400:kworker.0 00000100:00100000:1.0:1788797184.563457:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788797184.563481:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788797184.563487:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb06f57e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:73f6407e-c8af-46fc-9cc4-279490305b80:3302:1875689374583552:0@lo:400:kworker.0 00000100:00100000:1.0:1788797184.563537:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788797184.563564:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb048e2a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3302:1875689374584064:0@lo:400:kworker.0 00000100:00100000:1.0:1788797184.563586:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788797184.563616:0:14993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788797184.563625:0:14993:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb048e28a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3300:x1875689374583808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788797184.563657:0:14993:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb048e28a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3300:x1875689374583808:12345-0@lo:400:kworker.0 Request processed in 35us (732us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797184.563665:0:14993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788797184.563707:0:14309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374584192 00000100:00100000:1.0:1788797184.563712:0:14309:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374584192 00000100:00100000:1.0:1788797184.563741:0:14309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374583936 00000100:00100000:1.0:1788797184.563744:0:14309:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374583936 00000100:00100000:1.0:1788797184.563754:0:14309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374584064 00000100:00100000:1.0:1788797184.563756:0:14309:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374584064 00000100:00100000:1.0:1788797184.563768:0:14309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788797184.563774:0:14309:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb048e2b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1875689374584192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788797184.563804:0:14309:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb048e2b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1875689374584192:12345-0@lo:400:kworker.0 Request processed in 30us (931us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797184.563811:0:14309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788797184.563822:0:14309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788797184.563827:0:14309:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0795c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875689374583936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788797184.563853:0:14309:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0795c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875689374583936:12345-0@lo:400:kworker.0 Request processed in 25us (395us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797184.563858:0:14309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788797184.563868:0:14309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788797184.563873:0:14309:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0795c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1875689374584064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788797184.563909:0:14309:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0795c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1875689374584064:12345-0@lo:400:kworker.0 Request processed in 36us (322us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797184.563915:0:14309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788797184.563952:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb048e2a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3302:1875689374584064:0@lo:400:kworker.0 00000100:00100000:1.0:1788797184.563963:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb048e2b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875689374583936:0@lo:400:kworker.0 00000100:00080000:1.0:1788797184.564010:0:14306:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788797184.564016:0:14306:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788797184.564018:0:14306:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788797184.564069:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb048e2aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875689374583808:0@lo:400:kworker.0 00000100:00100000:1.0:1788797184.564080:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb06f57d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875689374583680:0@lo:400:kworker.0 00000100:00100000:1.0:1788797184.564089:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb048e28700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3300:1875689374584192:0@lo:400:kworker.0 00000100:00100000:1.0:1788797184.564122:0:14305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374583552 00000100:00100000:1.0:1788797184.564126:0:14305:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374583552 00000100:00100000:1.0:1788797184.564164:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1788797184.564171:0:14305:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb079e2b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73f6407e-c8af-46fc-9cc4-279490305b80+19:3302:x1875689374583552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788797184.564219:0:14305:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb079e2b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73f6407e-c8af-46fc-9cc4-279490305b80+19:3302:x1875689374583552:12345-0@lo:400:kworker.0 Request processed in 48us (681us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797184.564237:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1788797184.564279:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb06f57e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:73f6407e-c8af-46fc-9cc4-279490305b80:3302:1875689374583552:0@lo:400:kworker.0 00000100:00100000:2.0:1788797184.564630:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb0795d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875689374584320:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788797184.564674:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788797184.564729:0:14998:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374584320 00000100:00100000:2.0:1788797184.564733:0:14998:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374584320 00000100:00100000:2.0:1788797184.564763:0:14998:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788797184.564771:0:14998:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0795db100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3301:x1875689374584320:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788797184.564789:0:14998:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788797184.564830:0:14998:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0795db100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3301:x1875689374584320:12345-0@lo:13:osp-pre-1-0.0 Request processed in 61us (157us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797184.564837:0:14998:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788797184.564872:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb0795d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875689374584320:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788797184.564982:0:14996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000001:00080000:1.0:1788797184.644064:0:7640:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00000001:00100000:1.0:1788797184.644118:0:7640:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 8d52f9f5-7df3-47f4-a430-77f8dd50f6ec 00000001:00100000:1.0:1788797184.644126:0:7640:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:0.0:1788797184.818196:0:15413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788797185.842266:0:14298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788797186.461318:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1788797186.461800:0:14309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351523968 00000100:00100000:1.0:1788797186.461814:0:14309:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351523968 00000100:00100000:1.0:1788797186.461925:0:14309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9 00000100:00100000:1.0:1788797186.461938:0:14309:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0795d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8d52f9f5-7df3-47f4-a430-77f8dd50f6ec+7:13849:x1875689351523968:12345-192.168.204.38@tcp:41:lfs.0 00000004:00000024:1.0:1788797186.461991:0:14309:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1788797186.462158:0:14309:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0795d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8d52f9f5-7df3-47f4-a430-77f8dd50f6ec+7:13849:x1875689351523968:12345-192.168.204.38@tcp:41:lfs.0 Request processed in 222us (857us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797186.462165:0:14309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9 00000100:00080000:3.0:1788797186.462323:0:14306:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788797186.481980:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1788797186.482297:0:14998:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351524096 00000100:00100000:2.0:1788797186.482315:0:14998:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351524096 00000100:00100000:2.0:1788797186.482403:0:14998:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 6 00000100:00100000:2.0:1788797186.482415:0:14998:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8caf42062680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:8d52f9f5-7df3-47f4-a430-77f8dd50f6ec+6:13849:x1875689351524096:12345-192.168.204.38@tcp:13:lfs.0 00002000:00000024:2.0:1788797186.482922:0:14998:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788797186.483025:0:14998:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8caf42062680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:8d52f9f5-7df3-47f4-a430-77f8dd50f6ec+6:13849:x1875689351524096:12345-192.168.204.38@tcp:13:lfs.0 Request processed in 611us (1055us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797186.483062:0:14998:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 6 00000100:00080000:3.0:1788797186.483141:0:14306:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788797186.487910:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1788797186.488654:0:14998:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351524224 00000100:00100000:2.0:1788797186.488669:0:14998:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351524224 00000100:00100000:2.0:1788797186.488752:0:14998:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 7 00000100:00100000:2.0:1788797186.488763:0:14998:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb048e28000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:8d52f9f5-7df3-47f4-a430-77f8dd50f6ec+5:13849:x1875689351524224:12345-192.168.204.38@tcp:13:lfs.0 00002000:00000024:2.0:1788797186.488812:0:14998:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788797186.488915:0:14998:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb048e28000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:8d52f9f5-7df3-47f4-a430-77f8dd50f6ec+5:13849:x1875689351524224:12345-192.168.204.38@tcp:13:lfs.0 Request processed in 154us (1016us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797186.488923:0:14998:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 7 00000100:00080000:3.0:1788797186.489008:0:14306:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788797186.611505:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788797186.611532:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb048e29500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875689374584448:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788797186.611619:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788797186.611738:0:14998:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374584448 00000100:00100000:2.0:1788797186.611749:0:14998:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374584448 00000100:00100000:2.0:1788797186.611822:0:14998:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788797186.611844:0:14998:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8caf42061500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875689374584448:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788797186.611871:0:14998:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788797186.611927:0:14998:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8caf42061500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875689374584448:12345-0@lo:13:osp-pre-0-0.0 Request processed in 95us (308us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797186.611934:0:14998:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788797186.612226:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb048e29500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875689374584448:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788797186.612248:0:14306:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788797186.705891:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1788797186.706002:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351524352 00000100:00100000:3.0:1788797186.706014:0:14303:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351524352 00000100:00100000:3.0:1788797186.706113:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 93 00000100:00100000:3.0:1788797186.706127:0:14303:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb079e28050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17a8599e-7555-4132-8043-ffdcb544e5c7+10:13884:x1875689351524352:12345-192.168.204.38@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788797186.706152:0:14303:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788797186.706179:0:14303:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cb077c68e00/0xca7fc0c411f94906 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x7c99e04559ee1417 expref: -99 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797186.706225:0:14303:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cb077c68e00/0xca7fc0c411f94906 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1417 expref: 11 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797186.706239:0:14303:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cb077c68e00/0xca7fc0c411f94906 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1417 expref: 11 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797186.706249:0:14303:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb077c68e00, rc 0) 00000100:00100000:3.0:1788797186.706339:0:14303:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb079e28050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17a8599e-7555-4132-8043-ffdcb544e5c7+11:13884:x1875689351524352:12345-192.168.204.38@tcp:101:mount.lustre.0 Request processed in 215us (457us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797186.706347:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 93 00000100:00100000:1.0:1788797186.711152:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1788797186.712774:0:14304:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351524480 00000100:00100000:2.0:1788797186.712798:0:14304:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351524480 00000100:00100000:2.0:1788797186.713132:0:14304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 94 00000100:00100000:2.0:1788797186.713145:0:14304:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb079e2a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17a8599e-7555-4132-8043-ffdcb544e5c7+11:13884:x1875689351524480:12345-192.168.204.38@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788797186.713497:0:14304:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb079e2a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17a8599e-7555-4132-8043-ffdcb544e5c7+11:13884:x1875689351524480:12345-192.168.204.38@tcp:501:mount.lustre.0 Request processed in 354us (2368us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797186.713506:0:14304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 94 00000100:00100000:0.0:1788797186.716206:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1788797186.716421:0:14305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351524608 00000100:00100000:1.0:1788797186.716436:0:14305:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351524608 00000100:00100000:1.0:1788797186.716525:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 95 00000100:00100000:1.0:1788797186.716537:0:14305:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb079e2a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17a8599e-7555-4132-8043-ffdcb544e5c7+11:13884:x1875689351524608:12345-192.168.204.38@tcp:503:mount.lustre.0 00000100:00100000:1.0:1788797186.717118:0:14305:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb079e2a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17a8599e-7555-4132-8043-ffdcb544e5c7+11:13884:x1875689351524608:12345-192.168.204.38@tcp:503:mount.lustre.0 Request processed in 581us (921us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797186.717128:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 95 00000100:00100000:1.0:1788797186.731871:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1788797186.735042:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351524736 00000100:00100000:3.0:1788797186.735060:0:14303:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351524736 00000100:00100000:3.0:1788797186.735138:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 96 00000100:00100000:3.0:1788797186.735166:0:14303:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb079e28c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17a8599e-7555-4132-8043-ffdcb544e5c7+11:13888:x1875689351524736:12345-192.168.204.38@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788797186.735585:0:14303:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb079e28c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17a8599e-7555-4132-8043-ffdcb544e5c7+11:13888:x1875689351524736:12345-192.168.204.38@tcp:502:llog_process_th.0 Request processed in 388us (3696us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797186.735594:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 96 00000100:00100000:3.0:1788797186.760142:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1788797186.760320:0:14304:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351524864 00000100:00100000:2.0:1788797186.760336:0:14304:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351524864 00000100:00100000:2.0:1788797186.760406:0:14304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 97 00000100:00100000:2.0:1788797186.760421:0:14304:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb079e2ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17a8599e-7555-4132-8043-ffdcb544e5c7+11:13888:x1875689351524864:12345-192.168.204.38@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788797186.760745:0:14304:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb079e2ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17a8599e-7555-4132-8043-ffdcb544e5c7+11:13888:x1875689351524864:12345-192.168.204.38@tcp:502:llog_process_th.0 Request processed in 327us (615us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797186.760754:0:14304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 97 00000100:00100000:0.0:1788797186.773389:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1788797186.774176:0:14305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351524992 00000100:00100000:1.0:1788797186.774198:0:14305:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351524992 00000100:00100000:2.0:1788797186.774404:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 98 00000100:00100000:2.0:1788797186.774416:0:14305:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb079e28450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17a8599e-7555-4132-8043-ffdcb544e5c7+11:13884:x1875689351524992:12345-192.168.204.38@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788797186.774436:0:14305:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788797186.774456:0:14305:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cb041484200/0xca7fc0c411f9490d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x7c99e04559ee1441 expref: -99 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797186.774500:0:14305:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cb041484200/0xca7fc0c411f9490d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1441 expref: 12 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797186.774520:0:14305:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cb041484200/0xca7fc0c411f9490d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1441 expref: 12 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797186.774530:0:14305:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb041484200, rc 0) 00000100:00100000:2.0:1788797186.774992:0:14305:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb079e28450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17a8599e-7555-4132-8043-ffdcb544e5c7+12:13884:x1875689351524992:12345-192.168.204.38@tcp:101:mount.lustre.0 Request processed in 575us (1612us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797186.775002:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 98 00000100:00100000:1.0:1788797186.781276:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1788797186.781413:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351525120 00000100:00100000:3.0:1788797186.781425:0:14303:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351525120 00000100:00100000:3.0:1788797186.781526:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 99 00000100:00100000:3.0:1788797186.781538:0:14303:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb079e29450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17a8599e-7555-4132-8043-ffdcb544e5c7+12:13884:x1875689351525120:12345-192.168.204.38@tcp:256:mount.lustre.0 20000000:01000000:3.0:1788797186.781563:0:14303:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1788797186.781704:0:14303:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1788797186.781710:0:14303:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1788797186.781714:0:14303:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1788797186.781716:0:14303:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:2.0:1788797186.786350:0:14303:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb079e29450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17a8599e-7555-4132-8043-ffdcb544e5c7+12:13884:x1875689351525120:12345-192.168.204.38@tcp:256:mount.lustre.0 Request processed in 4797us (5068us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797186.786369:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 99 00000100:00100000:0.0:1788797186.797740:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1788797186.797878:0:14305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351525248 00000100:00100000:2.0:1788797186.797891:0:14305:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351525248 00000100:00100000:2.0:1788797186.797989:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 100 00000100:00100000:2.0:1788797186.798000:0:14305:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb06fb84c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17a8599e-7555-4132-8043-ffdcb544e5c7+12:13884:x1875689351525248:12345-192.168.204.38@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788797186.798021:0:14305:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788797186.798074:0:14305:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cb041485a00/0xca7fc0c411f94914 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x7c99e04559ee1448 expref: -99 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797186.798107:0:14305:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cb041485a00/0xca7fc0c411f94914 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1448 expref: 13 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797186.798119:0:14305:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cb041485a00/0xca7fc0c411f94914 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1448 expref: 13 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797186.798129:0:14305:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb041485a00, rc 0) 00000100:00100000:2.0:1788797186.798211:0:14305:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb06fb84c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17a8599e-7555-4132-8043-ffdcb544e5c7+13:13884:x1875689351525248:12345-192.168.204.38@tcp:101:mount.lustre.0 Request processed in 212us (485us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797186.798219:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 100 00000100:00100000:1.0:1788797186.800865:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1788797186.802295:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351525376 00000100:00100000:2.0:1788797186.802318:0:14303:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351525376 00000100:00100000:2.0:1788797186.802547:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 101 00000100:00100000:2.0:1788797186.802563:0:14303:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb06fb86c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17a8599e-7555-4132-8043-ffdcb544e5c7+13:13884:x1875689351525376:12345-192.168.204.38@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788797186.802951:0:14303:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb06fb86c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17a8599e-7555-4132-8043-ffdcb544e5c7+13:13884:x1875689351525376:12345-192.168.204.38@tcp:501:mount.lustre.0 Request processed in 392us (2098us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797186.802970:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 101 00000100:00100000:3.0:1788797186.805253:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1788797186.805443:0:14305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351525504 00000100:00100000:2.0:1788797186.805456:0:14305:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351525504 00000100:00100000:2.0:1788797186.805519:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 102 00000100:00100000:2.0:1788797186.805530:0:14305:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb06fb84450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17a8599e-7555-4132-8043-ffdcb544e5c7+13:13884:x1875689351525504:12345-192.168.204.38@tcp:503:mount.lustre.0 00000100:00100000:2.0:1788797186.805748:0:14305:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb06fb84450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17a8599e-7555-4132-8043-ffdcb544e5c7+13:13884:x1875689351525504:12345-192.168.204.38@tcp:503:mount.lustre.0 Request processed in 220us (505us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797186.805755:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 102 00000100:00100000:0.0:1788797186.810441:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1788797186.810577:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351525632 00000100:00100000:2.0:1788797186.810589:0:14303:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351525632 00000100:00100000:2.0:1788797186.810646:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 103 00000100:00100000:2.0:1788797186.810656:0:14303:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb06fb85450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17a8599e-7555-4132-8043-ffdcb544e5c7+13:13891:x1875689351525632:12345-192.168.204.38@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788797186.811198:0:14303:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb06fb85450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17a8599e-7555-4132-8043-ffdcb544e5c7+13:13891:x1875689351525632:12345-192.168.204.38@tcp:502:llog_process_th.0 Request processed in 541us (765us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797186.811208:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 103 00000100:00100000:0.0:1788797186.814364:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1788797186.814558:0:14305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351525760 00000100:00100000:2.0:1788797186.814570:0:14305:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351525760 00000100:00100000:2.0:1788797186.814833:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 104 00000100:00100000:2.0:1788797186.814846:0:14305:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb06fb84850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17a8599e-7555-4132-8043-ffdcb544e5c7+13:13891:x1875689351525760:12345-192.168.204.38@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788797186.815589:0:14305:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb06fb84850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17a8599e-7555-4132-8043-ffdcb544e5c7+13:13891:x1875689351525760:12345-192.168.204.38@tcp:502:llog_process_th.0 Request processed in 742us (1236us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797186.815599:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 104 00000100:00100000:3.0:1788797186.828213:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1788797186.828468:0:15017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351525888 00000100:00100000:0.0:1788797186.828485:0:15017:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351525888 00000100:00100000:0.0:1788797186.828555:0:15017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 10 00000100:00100000:0.0:1788797186.828565:0:15017:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8caf42063480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2351:x1875689351525888:12345-192.168.204.38@tcp:38:mount.lustre.0 00010000:00080000:0.0:1788797186.828602:0:15017:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from f43fc909-14ed-4850-ae62-0e6c56c6a361@192.168.204.38@tcp t0 exp 0000000000000000 cur 475 last 0 00000020:00000080:0.0:1788797186.828733:0:15017:0:(genops.c:1384:class_connect()) connect: client f43fc909-14ed-4850-ae62-0e6c56c6a361, cookie 0xca7fc0c411f9491b 00000004:00100000:0.0:1788797186.828778:0:15017:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:0.0:1788797186.828941:0:15017:0:(import.c:65:import_set_state_nolock()) ffff8cb046316800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788797186.829076:0:15017:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8caf42063480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f43fc909-14ed-4850-ae62-0e6c56c6a361+6:2351:x1875689351525888:12345-192.168.204.38@tcp:38:mount.lustre.0 Request processed in 511us (875us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797186.829086:0:15017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 10 00000100:00100000:0.0:1788797186.838571:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1788797186.838616:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1788797186.842939:0:14310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351526144 00000100:00100000:2.0:1788797186.842967:0:14310:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351526144 00000100:00100000:2.0:1788797186.843123:0:14310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351526016 00000100:00100000:2.0:1788797186.843127:0:14310:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351526016 00000100:00100000:2.0:1788797186.843164:0:14310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 11 00000100:00100000:2.0:1788797186.843679:0:14310:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb048e29880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f43fc909-14ed-4850-ae62-0e6c56c6a361+7:13884:x1875689351526144:12345-192.168.204.38@tcp:41:mount.lustre.0 00000004:00000024:2.0:1788797186.843734:0:14310:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1788797186.843810:0:14310:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb048e29880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f43fc909-14ed-4850-ae62-0e6c56c6a361+7:13884:x1875689351526144:12345-192.168.204.38@tcp:41:mount.lustre.0 Request processed in 633us (5249us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797186.843821:0:14310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 11 00000100:00100000:2.0:1788797186.843847:0:14310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 12 00000100:00100000:2.0:1788797186.843854:0:14310:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb048e2a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f43fc909-14ed-4850-ae62-0e6c56c6a361+6:0:x1875689351526016:12345-192.168.204.38@tcp:41:mount.lustre.0 00000004:00000024:2.0:1788797186.843867:0:14310:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1788797186.843890:0:14310:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb048e2a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f43fc909-14ed-4850-ae62-0e6c56c6a361+6:0:x1875689351526016:12345-192.168.204.38@tcp:41:mount.lustre.0 Request processed in 36us (5274us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797186.843896:0:14310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 12 00000100:00080000:3.0:1788797186.844337:0:14306:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788797186.852883:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1788797186.853343:0:14310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351526272 00000100:00100000:2.0:1788797186.853354:0:14310:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351526272 00000100:00100000:2.0:1788797186.853464:0:14310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 13 00000100:00100000:2.0:1788797186.853497:0:14310:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0795c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f43fc909-14ed-4850-ae62-0e6c56c6a361+6:13884:x1875689351526272:12345-192.168.204.38@tcp:40:mount.lustre.0 00000100:00100000:2.0:1788797186.853621:0:14310:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0795c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f43fc909-14ed-4850-ae62-0e6c56c6a361+6:13884:x1875689351526272:12345-192.168.204.38@tcp:40:mount.lustre.0 Request processed in 147us (746us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797186.853630:0:14310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 13 00000100:00100000:3.0:1788797186.860698:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1788797186.860796:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1788797186.861121:0:14993:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351526400 00000100:00100000:1.0:1788797186.861134:0:14993:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351526400 00000100:00100000:3.0:1788797186.861204:0:14995:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351526528 00000100:00100000:3.0:1788797186.861209:0:14995:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351526528 00000100:00100000:3.0:1788797186.861242:0:14995:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 11 00000100:00100000:3.0:1788797186.861252:0:14995:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8caf42061c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2351:x1875689351526400:12345-192.168.204.38@tcp:8:mount.lustre.0 00000100:00100000:2.0:1788797186.861265:0:15405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 12 00000100:00100000:2.0:1788797186.861271:0:15405:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8caf42061180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2351:x1875689351526528:12345-192.168.204.38@tcp:8:mount.lustre.0 00010000:00080000:2.0:1788797186.861286:0:15405:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from f43fc909-14ed-4850-ae62-0e6c56c6a361@192.168.204.38@tcp t0 exp 0000000000000000 cur 475 last 0 00010000:00080000:3.0:1788797186.861294:0:14995:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from f43fc909-14ed-4850-ae62-0e6c56c6a361@192.168.204.38@tcp t0 exp 0000000000000000 cur 475 last 0 00000020:00000080:2.0:1788797186.861323:0:15405:0:(genops.c:1384:class_connect()) connect: client f43fc909-14ed-4850-ae62-0e6c56c6a361, cookie 0xca7fc0c411f94922 00000020:00000080:3.0:1788797186.861324:0:14995:0:(genops.c:1384:class_connect()) connect: client f43fc909-14ed-4850-ae62-0e6c56c6a361, cookie 0xca7fc0c411f94929 00002000:00100000:3.0:1788797186.861339:0:14995:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli f43fc909-14ed-4850-ae62-0e6c56c6a361/ffff8cb07aac6800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788797186.861340:0:15405:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli f43fc909-14ed-4850-ae62-0e6c56c6a361/ffff8cb0501ae800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788797186.861349:0:14995:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00100000:2.0:1788797186.861349:0:15405:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788797186.861652:0:14995:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1788797186.861752:0:14995:0:(import.c:65:import_set_state_nolock()) ffff8cb07aac2000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788797186.861759:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1788797186.861871:0:14313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351526656 00000100:00100000:0.0:1788797186.861877:0:14313:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351526656 00000100:00100000:0.0:1788797186.861920:0:14313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1 00000100:00100000:0.0:1788797186.861929:0:14313:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0795c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f43fc909-14ed-4850-ae62-0e6c56c6a361+6:13884:x1875689351526656:12345-192.168.204.38@tcp:33:mount.lustre.0 00002000:00080000:2.0:1788797186.861966:0:15405:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000004:00200000:0.0:1788797186.862087:0:14313:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00080000:2.0:1788797186.862272:0:15405:0:(import.c:65:import_set_state_nolock()) ffff8cb05ca57000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788797186.862349:0:15405:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8caf42061180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f43fc909-14ed-4850-ae62-0e6c56c6a361+6:2351:x1875689351526528:12345-192.168.204.38@tcp:8:mount.lustre.0 Request processed in 1076us (1552us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797186.862350:0:14995:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8caf42061c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f43fc909-14ed-4850-ae62-0e6c56c6a361+6:2351:x1875689351526400:12345-192.168.204.38@tcp:8:mount.lustre.0 Request processed in 1098us (1670us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797186.862359:0:15405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 12 00000100:00100000:0.0:1788797186.862383:0:14313:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0795c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f43fc909-14ed-4850-ae62-0e6c56c6a361+6:13884:x1875689351526656:12345-192.168.204.38@tcp:33:mount.lustre.0 Request processed in 455us (628us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797186.862390:0:14313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1 00000100:00100000:3.0:1788797186.862440:0:14995:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 11 00010000:00010000:0.0:1788797186.866729:0:14299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788797187.086940:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1788797187.087302:0:15017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351526784 00000100:00100000:2.0:1788797187.087313:0:15017:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351526784 00000100:00100000:2.0:1788797187.087379:0:15017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 14 00000100:00100000:2.0:1788797187.087391:0:15017:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8caf42060e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f43fc909-14ed-4850-ae62-0e6c56c6a361+6:13913:x1875689351526784:12345-192.168.204.38@tcp:101:mkdir.0 00010000:00010000:2.0:1788797187.087415:0:15017:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788797187.087451:0:15017:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484a00/0xca7fc0c411f94930 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c99e04559ee1472 expref: -99 pid: 15017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797187.087533:0:15017:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041485600/0xca7fc0c411f94937 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797187.087548:0:15017:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041485600/0xca7fc0c411f94937 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797187.087562:0:15017:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041485600/0xca7fc0c411f94937 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15017 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788797187.087601:0:15017:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788797187.087606:0:15017:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788797187.087631:0:15017:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041485600/0xca7fc0c411f94937 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797187.087661:0:15017:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484a00/0xca7fc0c411f94930 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1472 expref: 8 pid: 15017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797187.087704:0:15017:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041485600/0xca7fc0c411f94937 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1472 expref: 7 pid: 15017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797187.087713:0:15017:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cb06ce84800) 00010000:00010000:2.0:1788797187.087716:0:15017:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788797187.087720:0:15017:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb041485600, rc 0) 00000100:00100000:2.0:1788797187.088282:0:15017:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8caf42060e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f43fc909-14ed-4850-ae62-0e6c56c6a361+7:13913:x1875689351526784:12345-192.168.204.38@tcp:101:mkdir.0 Request processed in 889us (1359us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797187.088292:0:15017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 14 00010000:00010000:0.0:1788797187.892179:0:15413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788797188.218143:0:6713:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of f43fc909-14ed-4850-ae62-0e6c56c6a361 00000001:00100000:1.0:1788797188.218170:0:6713:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 8d52f9f5-7df3-47f4-a430-77f8dd50f6ec 00010000:00010000:0.0:1788797188.916835:0:14298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788797189.217510:0:5848:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of f43fc909-14ed-4850-ae62-0e6c56c6a361 00000001:00100000:3.0:1788797189.217525:0:5848:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 8d52f9f5-7df3-47f4-a430-77f8dd50f6ec 00000100:00100000:2.0:1788797189.684975:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb0795d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:73f6407e-c8af-46fc-9cc4-279490305b80:3300:1875689374584704:0@lo:400:kworker.0 00000100:00100000:2.0:1788797189.685074:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788797189.685600:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb0795d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875689374584832:0@lo:400:kworker.0 00000100:00100000:3.0:1788797189.685637:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788797189.685691:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb0795d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3301:1875689374585344:0@lo:400:kworker.0 00000100:00100000:3.0:1788797189.685713:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788797189.686310:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb0795da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3300:1875689374585216:0@lo:400:kworker.0 00000100:00100000:2.0:1788797189.686343:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788797189.686385:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374584704 00000100:00100000:2.0:1788797189.686395:0:14303:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374584704 00000100:00100000:2.0:1788797189.686449:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1788797189.686459:0:14303:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb06fb87c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73f6407e-c8af-46fc-9cc4-279490305b80+19:3300:x1875689374584704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788797189.686523:0:14303:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb06fb87c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73f6407e-c8af-46fc-9cc4-279490305b80+19:3300:x1875689374584704:12345-0@lo:400:kworker.0 Request processed in 66us (1449us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797189.686531:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1788797189.686560:0:14310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374585344 00000100:00100000:2.0:1788797189.686564:0:14310:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374585344 00000100:00100000:2.0:1788797189.686596:0:14310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374585216 00000100:00100000:2.0:1788797189.686598:0:14310:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374585216 00000100:00100000:2.0:1788797189.686617:0:14310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788797189.686633:0:14310:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8caf42061880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1875689374585344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788797189.686699:0:14310:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8caf42061880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1875689374585344:12345-0@lo:400:kworker.0 Request processed in 66us (984us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797189.686706:0:14310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788797189.686718:0:14310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788797189.686723:0:14310:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0795db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1875689374585216:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1788797189.687646:0:14306:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788797189.687696:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb0795d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:73f6407e-c8af-46fc-9cc4-279490305b80:3300:1875689374584704:0@lo:400:kworker.0 00000100:00100000:3.0:1788797189.687792:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb0795d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3301:1875689374585344:0@lo:400:kworker.0 00000100:00100000:3.0:1788797189.687836:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb048e2ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875689374584576:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788797189.689398:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788797189.689716:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb0795d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875689374584960:0@lo:400:kworker.0 00000100:00100000:0.0:1788797189.689893:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788797189.689955:0:14996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374584832 00000100:00100000:0.0:1788797189.689965:0:14996:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374584832 00000100:00100000:0.0:1788797189.690025:0:14996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374584960 00000100:00100000:0.0:1788797189.690043:0:14996:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374584960 00000100:00100000:0.0:1788797189.690067:0:14996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788797189.690086:0:14996:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8caf42062d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3301:x1875689374584832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788797189.690167:0:14996:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8caf42062d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3301:x1875689374584832:12345-0@lo:400:kworker.0 Request processed in 93us (4528us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797189.690175:0:14996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788797189.690193:0:14996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788797189.690200:0:14996:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb048e2b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1875689374584960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788797189.690243:0:14996:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb048e2b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1875689374584960:12345-0@lo:400:kworker.0 Request processed in 44us (351us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797189.690250:0:14996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788797189.690287:0:3302:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:0.0:1788797189.690311:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb0795d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875689374584960:0@lo:400:kworker.0 00000100:00100000:0.0:1788797189.690411:0:14998:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374584576 00000100:00100000:0.0:1788797189.690416:0:14998:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374584576 00000100:00100000:0.0:1788797189.690442:0:14998:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788797189.690471:0:14998:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8caf42062300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875689374584576:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788797189.690499:0:14998:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788797189.690535:0:14998:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8caf42062300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875689374584576:12345-0@lo:13:osp-pre-1-0.0 Request processed in 66us (1145us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797189.690542:0:14998:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788797189.692248:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb048e2ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875689374584576:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788797189.692272:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb0795d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875689374585088:0@lo:400:kworker.0 00000100:00100000:3.0:1788797189.692353:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788797189.692597:0:14306:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788797189.692603:0:14306:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788797189.692625:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb0795d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875689374584832:0@lo:400:kworker.0 00000100:00100000:1.0:1788797189.694060:0:14311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374585088 00000100:00100000:1.0:1788797189.694201:0:14311:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374585088 00000100:00100000:2.0:1788797189.696942:0:14310:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0795db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1875689374585216:12345-0@lo:400:kworker.0 Request processed in 10204us (10584us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797189.696962:0:14310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788797189.697837:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb0795da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3300:1875689374585216:0@lo:400:kworker.0 00000100:00100000:0.0:1788797189.698339:0:14311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788797189.698351:0:14311:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8caf42060a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875689374585088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788797189.698465:0:14311:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8caf42060a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875689374585088:12345-0@lo:400:kworker.0 Request processed in 116us (6112us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797189.698472:0:14311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788797189.698521:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb0795d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875689374585088:0@lo:400:kworker.0 00000001:00100000:1.0:1788797189.740502:0:7640:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of f43fc909-14ed-4850-ae62-0e6c56c6a361 00010000:00010000:2.0:1788797189.957538:0:14299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788797190.426743:0:16286:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:0.0:1788797190.963199:0:15413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788797191.730539:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788797191.730569:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8caf42060700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875689374585472:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788797191.730661:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788797191.731076:0:14998:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374585472 00000100:00100000:3.0:1788797191.731097:0:14998:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374585472 00000100:00100000:3.0:1788797191.731211:0:14998:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788797191.731224:0:14998:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0795db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875689374585472:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788797191.731270:0:14998:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788797191.731337:0:14998:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0795db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875689374585472:12345-0@lo:13:osp-pre-0-0.0 Request processed in 116us (675us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797191.731345:0:14998:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788797191.731402:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8caf42060700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875689374585472:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788797191.731635:0:14306:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788797191.986506:0:14298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788797192.094316:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1788797192.094364:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1788797192.094520:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1788797192.094547:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1788797192.094564:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1788797192.094580:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1788797192.094602:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1788797192.094632:0:14996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351527168 00000100:00100000:0.0:1788797192.094642:0:14996:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351527168 00000100:00100000:0.0:1788797192.094694:0:14996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351527680 00000100:00100000:0.0:1788797192.094697:0:14996:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351527680 00000100:00100000:0.0:1788797192.094710:0:14996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351527296 00000100:00100000:0.0:1788797192.094711:0:14996:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351527296 00000100:00100000:0.0:1788797192.094720:0:14996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351527552 00000100:00100000:0.0:1788797192.094723:0:14996:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351527552 00000100:00100000:0.0:1788797192.094756:0:14996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 7 00000100:00100000:0.0:1788797192.094764:0:14996:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb048e2bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8d52f9f5-7df3-47f4-a430-77f8dd50f6ec+5:2355:x1875689351527168:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:0.0:1788797192.094849:0:14996:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb048e2bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8d52f9f5-7df3-47f4-a430-77f8dd50f6ec+5:2355:x1875689351527168:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 84us (483us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797192.094856:0:14996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 7 00000100:00100000:0.0:1788797192.094875:0:14996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 8 00000100:00100000:0.0:1788797192.094881:0:14996:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb048e29c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f43fc909-14ed-4850-ae62-0e6c56c6a361+5:2355:x1875689351527680:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:0.0:1788797192.094901:0:14996:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb048e29c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f43fc909-14ed-4850-ae62-0e6c56c6a361+5:2355:x1875689351527680:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 21us (354us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797192.094906:0:14996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 8 00000100:00100000:0.0:1788797192.094915:0:14996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9 00000100:00100000:0.0:1788797192.094919:0:14996:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb048e28380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8d52f9f5-7df3-47f4-a430-77f8dd50f6ec+5:2355:x1875689351527296:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:0.0:1788797192.094935:0:14996:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb048e28380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8d52f9f5-7df3-47f4-a430-77f8dd50f6ec+5:2355:x1875689351527296:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 16us (355us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797192.094940:0:14996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9 00000100:00100000:0.0:1788797192.094950:0:14996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 10 00000100:00100000:0.0:1788797192.094956:0:14996:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb048e2ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f43fc909-14ed-4850-ae62-0e6c56c6a361+5:2355:x1875689351527552:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:0.0:1788797192.094975:0:14996:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb048e2ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f43fc909-14ed-4850-ae62-0e6c56c6a361+5:2355:x1875689351527552:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 20us (372us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797192.094980:0:14996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 10 00000100:00100000:0.0:1788797192.094998:0:14309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351527424 00000100:00100000:0.0:1788797192.095002:0:14309:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351527424 00000100:00100000:0.0:1788797192.095056:0:14309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351527040 00000100:00100000:0.0:1788797192.095060:0:14309:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351527040 00000100:00100000:0.0:1788797192.095102:0:14309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19 00000100:00100000:0.0:1788797192.095109:0:14309:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb048e29f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f43fc909-14ed-4850-ae62-0e6c56c6a361+6:2355:x1875689351527424:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:0.0:1788797192.095134:0:14309:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb048e29f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f43fc909-14ed-4850-ae62-0e6c56c6a361+6:2355:x1875689351527424:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 27us (616us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797192.095139:0:14309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19 00000100:00100000:0.0:1788797192.095151:0:14309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 20 00000100:00100000:0.0:1788797192.095157:0:14309:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb048e29180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8d52f9f5-7df3-47f4-a430-77f8dd50f6ec+6:2355:x1875689351527040:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:0.0:1788797192.095175:0:14309:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb048e29180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8d52f9f5-7df3-47f4-a430-77f8dd50f6ec+6:2355:x1875689351527040:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 18us (610us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797192.095179:0:14309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 20 00000100:00100000:2.0:1788797192.095875:0:14305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351526912 00000100:00100000:2.0:1788797192.095884:0:14305:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351526912 00000100:00100000:2.0:1788797192.095936:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 106 00000100:00100000:2.0:1788797192.095946:0:14305:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb06fb86050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17a8599e-7555-4132-8043-ffdcb544e5c7+13:2355:x1875689351526912:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:2.0:1788797192.095984:0:14305:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb06fb86050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17a8599e-7555-4132-8043-ffdcb544e5c7+13:2355:x1875689351526912:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 40us (1678us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797192.095991:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 106 00000100:00080000:2.0:1788797192.096052:0:14306:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788797192.096057:0:14306:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788797192.096060:0:14306:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788797193.010672:0:14299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788797193.396983:0:14343:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788797194.034289:0:15413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788797194.237279:0:16434:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd02ff03e0 20000000:00000080:1.0:1788797194.237297:0:16434:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8caf43811000 uarg=0000000000000000 20000000:01000000:1.0:1788797194.237336:0:16434:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1788797194.237342:0:16434:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1788797194.237346:0:16434:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1788797194.238712:0:16435:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 10 20000000:00000400:3.0:1788797194.239841:0:16434:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:3.0:1788797194.251936:0:16434:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1788797194.252855:0:16434:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cb079b81600/0xca7fc0c411f9493e lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797194.252880:0:16434:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cb042ea3800/0xca7fc0c411f94635 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xca7fc0c411f9462e expref: 18 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797194.252888:0:16434:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cb082045000/0xca7fc0c411f94682 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xca7fc0c411f9467b expref: 18 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797194.252895:0:16434:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cb079b81200/0xca7fc0c411f947b6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xca7fc0c411f947af expref: 18 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797194.252904:0:16434:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cb040030400/0xca7fc0c411f948dc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee13e6 expref: 12 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797194.252911:0:16434:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cb041485a00/0xca7fc0c411f94914 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1448 expref: 12 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797194.252940:0:16434:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8cb079b81600/0xca7fc0c411f9493e lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 16434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797194.252984:0:16434:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cb041485a00/0xca7fc0c411f94914 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1448 expref: 12 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797194.253000:0:16434:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8cb041485a00/0xca7fc0c411f94914 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1448 expref: 12 pid: 14305 timeout: 583 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788797194.253017:0:16434:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb048e29500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16434:1875689374585600:192.168.204.38@tcp:104: 00010000:00010000:0.0:1788797194.253749:0:16434:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cb040030400/0xca7fc0c411f948dc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee13e6 expref: 12 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797194.253762:0:16434:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8cb040030400/0xca7fc0c411f948dc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee13e6 expref: 12 pid: 14303 timeout: 583 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788797194.253773:0:16434:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb048e28700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16434:1875689374585728:192.168.204.38@tcp:104: 00010000:00010000:0.0:1788797194.253804:0:16434:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cb079b81200/0xca7fc0c411f947b6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xca7fc0c411f947af expref: 18 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797194.253811:0:16434:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8cb079b81200/0xca7fc0c411f947b6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xca7fc0c411f947af expref: 18 pid: 14305 timeout: 583 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788797194.253820:0:16434:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb048e2aa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16434:1875689374585856:0@lo:104: 00000100:00100000:0.0:1788797194.253855:0:16434:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788797194.253888:0:16434:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cb082045000/0xca7fc0c411f94682 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xca7fc0c411f9467b expref: 18 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797194.253908:0:16434:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8cb082045000/0xca7fc0c411f94682 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xca7fc0c411f9467b expref: 18 pid: 14304 timeout: 583 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788797194.253916:0:16434:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb048e2a300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16434:1875689374585984:0@lo:104: 00000100:00100000:0.0:1788797194.253941:0:16434:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788797194.253966:0:16434:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cb042ea3800/0xca7fc0c411f94635 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xca7fc0c411f9462e expref: 18 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797194.253975:0:16434:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8cb042ea3800/0xca7fc0c411f94635 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xca7fc0c411f9462e expref: 18 pid: 14305 timeout: 583 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788797194.253983:0:16434:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb079b91500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16434:1875689374586112:0@lo:104: 00000100:00100000:0.0:1788797194.254006:0:16434:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788797194.254017:0:16434:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb0484c0540 going to sleep for 11 seconds 00000100:00100000:2.0:1788797194.254320:0:14294:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1788797194.254334:0:14294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374585856 00000100:00100000:2.0:1788797194.254351:0:14294:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374585856 00000100:00100000:2.0:1788797194.254405:0:14294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374585984 00000100:00100000:2.0:1788797194.254409:0:14294:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374585984 00000100:00100000:2.0:1788797194.254419:0:14294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374586112 00000100:00100000:2.0:1788797194.254421:0:14294:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374586112 00000100:00100000:2.0:1788797194.254433:0:14294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788797194.254440:0:14294:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb048e2b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:73f6407e-c8af-46fc-9cc4-279490305b80+5:16434:x1875689374585856:12345-0@lo:104: 00010000:00010000:2.0:1788797194.254451:0:14294:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.138@tcp lock: ffff8cb040031400/0xca7fc0c411f947af lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xca7fc0c411f947b6 expref: -99 pid: 15726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797194.254516:0:14294:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788797194.254522:0:14294:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb048e2b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:73f6407e-c8af-46fc-9cc4-279490305b80+5:16434:x1875689374585856:12345-0@lo:104: Request processed in 83us (667us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797194.254529:0:14294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788797194.254546:0:14294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788797194.254551:0:14294:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb079b93800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:73f6407e-c8af-46fc-9cc4-279490305b80+4:16434:x1875689374585984:12345-0@lo:104: 00010000:00010000:2.0:1788797194.254559:0:14294:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.138@tcp lock: ffff8cb077c68200/0xca7fc0c411f9467b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xca7fc0c411f94682 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797194.254594:0:14294:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788797194.254600:0:14294:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb079b93800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:73f6407e-c8af-46fc-9cc4-279490305b80+4:16434:x1875689374585984:12345-0@lo:104: Request processed in 49us (658us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797194.254605:0:14294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788797194.254617:0:14294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788797194.254622:0:14294:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb079158850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:73f6407e-c8af-46fc-9cc4-279490305b80+3:16434:x1875689374586112:12345-0@lo:104: 00010000:00010000:2.0:1788797194.254630:0:14294:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.138@tcp lock: ffff8cb040031a00/0xca7fc0c411f9462e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xca7fc0c411f94635 expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797194.254662:0:14294:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1788797194.254672:0:14294:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb079158850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:73f6407e-c8af-46fc-9cc4-279490305b80+3:16434:x1875689374586112:12345-0@lo:104: Request processed in 51us (666us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797194.254678:0:14294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:2.0:1788797194.254718:0:14299:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788797194.254724:0:14299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.138@tcp lock: ffff8cb040031400/0xca7fc0c411f947af lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xca7fc0c411f947b6 expref: -99 pid: 15726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797194.254732:0:14299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb040031400 already unused, calling callback (ffffffffc1adac20) 10000000:00010000:2.0:1788797194.254736:0:14299:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.138@tcp lock: ffff8cb040031400/0xca7fc0c411f947af lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xca7fc0c411f947b6 expref: -99 pid: 15726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797194.254744:0:14299:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.138@tcp lock: ffff8cb040031400/0xca7fc0c411f947af lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xca7fc0c411f947b6 expref: -99 pid: 15726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788797194.254751:0:14299:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.138@tcp lock: ffff8cb040031400/0xca7fc0c411f947af lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xca7fc0c411f947b6 expref: -99 pid: 15726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788797194.254756:0:14299:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788797194.254784:0:14299:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.138@tcp lock: ffff8cb040031400/0xca7fc0c411f947af lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca7fc0c411f947b6 expref: -99 pid: 15726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797194.254791:0:14299:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788797194.254814:0:14299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.138@tcp lock: ffff8cb040031400/0xca7fc0c411f947af lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca7fc0c411f947b6 expref: -99 pid: 15726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797194.254820:0:14299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.138@tcp lock: ffff8cb040031400/0xca7fc0c411f947af lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca7fc0c411f947b6 expref: -99 pid: 15726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797194.254833:0:14299:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788797194.254836:0:14299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.138@tcp lock: ffff8cb077c68200/0xca7fc0c411f9467b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xca7fc0c411f94682 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797194.254852:0:14299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb077c68200 already unused, calling callback (ffffffffc1adac20) 10000000:00010000:2.0:1788797194.254856:0:14299:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.138@tcp lock: ffff8cb077c68200/0xca7fc0c411f9467b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xca7fc0c411f94682 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797194.254867:0:14299:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.138@tcp lock: ffff8cb077c68200/0xca7fc0c411f9467b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xca7fc0c411f94682 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788797194.254873:0:14299:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.138@tcp lock: ffff8cb077c68200/0xca7fc0c411f9467b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xca7fc0c411f94682 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788797194.254877:0:14299:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788797194.254890:0:14299:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.138@tcp lock: ffff8cb077c68200/0xca7fc0c411f9467b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca7fc0c411f94682 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797194.254896:0:14299:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788797194.254910:0:14299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.138@tcp lock: ffff8cb077c68200/0xca7fc0c411f9467b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca7fc0c411f94682 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797194.254917:0:14299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.138@tcp lock: ffff8cb077c68200/0xca7fc0c411f9467b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca7fc0c411f94682 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797194.254926:0:14299:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788797194.254929:0:14299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.138@tcp lock: ffff8cb040031a00/0xca7fc0c411f9462e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xca7fc0c411f94635 expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797194.254933:0:14299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb040031a00 already unused, calling callback (ffffffffc1adac20) 10000000:00010000:2.0:1788797194.254936:0:14299:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.138@tcp lock: ffff8cb040031a00/0xca7fc0c411f9462e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xca7fc0c411f94635 expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797194.254953:0:14299:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.138@tcp lock: ffff8cb040031a00/0xca7fc0c411f9462e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xca7fc0c411f94635 expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788797194.254960:0:14299:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.138@tcp lock: ffff8cb040031a00/0xca7fc0c411f9462e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xca7fc0c411f94635 expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788797194.254965:0:14299:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788797194.254978:0:14299:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.138@tcp lock: ffff8cb040031a00/0xca7fc0c411f9462e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca7fc0c411f94635 expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797194.254984:0:14299:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788797194.254991:0:14299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.138@tcp lock: ffff8cb040031a00/0xca7fc0c411f9462e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca7fc0c411f94635 expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797194.254997:0:14299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.138@tcp lock: ffff8cb040031a00/0xca7fc0c411f9462e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca7fc0c411f94635 expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797194.255010:0:14299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788797194.255012:0:14299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788797194.255013:0:14299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788797194.255020:0:15413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788797194.255075:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb0795d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:73f6407e-c8af-46fc-9cc4-279490305b80:3303:1875689374586240:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788797194.255106:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788797194.255150:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb0795dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:73f6407e-c8af-46fc-9cc4-279490305b80:3300:1875689374586368:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788797194.255171:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788797194.255186:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788797194.255191:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb0795d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:73f6407e-c8af-46fc-9cc4-279490305b80:3300:1875689374586496:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788797194.255210:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788797194.255261:0:14296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374586240 00000100:00100000:2.0:1788797194.255265:0:14296:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374586240 00010000:00010000:2.0:1788797194.255283:0:14296:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cb079b81200/0xca7fc0c411f947b6 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xca7fc0c411f947af expref: 19 pid: 14305 timeout: 583 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788797194.255303:0:14296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374586368 00000100:00100000:2.0:1788797194.255307:0:14296:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374586368 00010000:00010000:2.0:1788797194.255317:0:14296:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cb082045000/0xca7fc0c411f94682 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xca7fc0c411f9467b expref: 20 pid: 14304 timeout: 583 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788797194.255327:0:14296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374586496 00000100:00100000:2.0:1788797194.255329:0:14296:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374586496 00010000:00010000:2.0:1788797194.255336:0:14296:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cb042ea3800/0xca7fc0c411f94635 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xca7fc0c411f9462e expref: 21 pid: 14305 timeout: 583 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788797194.255346:0:14296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788797194.255352:0:14296:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0795da680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:73f6407e-c8af-46fc-9cc4-279490305b80+21:3303:x1875689374586240:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788797194.255361:0:14296:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788797194.255366:0:14296:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cb079b81200/0xca7fc0c411f947b6 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xca7fc0c411f947af expref: 21 pid: 14305 timeout: 583 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797194.255375:0:14296:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cb079b81200/0xca7fc0c411f947b6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xca7fc0c411f947af expref: 21 pid: 14305 timeout: 583 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797194.255389:0:14296:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788797194.255416:0:14296:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0795da680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:73f6407e-c8af-46fc-9cc4-279490305b80+21:3303:x1875689374586240:12345-0@lo:103:ldlm_bl.0 Request processed in 63us (308us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797194.255422:0:14296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788797194.255435:0:14296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788797194.255441:0:14296:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0795d8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:73f6407e-c8af-46fc-9cc4-279490305b80+20:3300:x1875689374586368:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788797194.255457:0:14296:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788797194.255461:0:14296:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cb082045000/0xca7fc0c411f94682 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xca7fc0c411f9467b expref: 20 pid: 14304 timeout: 583 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797194.255470:0:14296:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cb082045000/0xca7fc0c411f94682 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xca7fc0c411f9467b expref: 20 pid: 14304 timeout: 583 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797194.255479:0:14296:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788797194.255506:0:14296:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0795d8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:73f6407e-c8af-46fc-9cc4-279490305b80+20:3300:x1875689374586368:12345-0@lo:103:ldlm_bl.0 Request processed in 66us (334us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797194.255512:0:14296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788797194.255525:0:14296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788797194.255531:0:14296:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb077f5c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:73f6407e-c8af-46fc-9cc4-279490305b80+19:3300:x1875689374586496:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788797194.255538:0:14296:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788797194.255543:0:14296:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cb042ea3800/0xca7fc0c411f94635 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xca7fc0c411f9462e expref: 19 pid: 14305 timeout: 583 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797194.255549:0:14296:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cb042ea3800/0xca7fc0c411f94635 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xca7fc0c411f9462e expref: 19 pid: 14305 timeout: 583 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797194.255558:0:14296:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788797194.255577:0:14296:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb077f5c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:73f6407e-c8af-46fc-9cc4-279490305b80+19:3300:x1875689374586496:12345-0@lo:103:ldlm_bl.0 Request processed in 47us (366us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797194.255583:0:14296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788797194.255641:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb0795d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:73f6407e-c8af-46fc-9cc4-279490305b80:3303:1875689374586240:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788797194.255663:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb0795d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:73f6407e-c8af-46fc-9cc4-279490305b80:3300:1875689374586496:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788797194.255670:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb0795dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:73f6407e-c8af-46fc-9cc4-279490305b80:3300:1875689374586368:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788797194.255770:0:14298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788797194.259721:0:16434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cb079b81200/0xca7fc0c411f947b6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xca7fc0c411f947af expref: 18 pid: 14305 timeout: 583 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788797194.259747:0:16434:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb048e2aa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16434:1875689374585856:0@lo:104: 00010000:00010000:0.0:1788797194.259760:0:16434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cb082045000/0xca7fc0c411f94682 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xca7fc0c411f9467b expref: 17 pid: 14304 timeout: 583 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788797194.259770:0:16434:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb048e2a300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16434:1875689374585984:0@lo:104: 00010000:00010000:0.0:1788797194.259780:0:16434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cb042ea3800/0xca7fc0c411f94635 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xca7fc0c411f9462e expref: 16 pid: 14305 timeout: 583 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788797194.259790:0:16434:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb079b91500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16434:1875689374586112:0@lo:104: 00000100:00100000:0.0:1788797194.266929:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1788797194.267086:0:16434:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb048e29500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16434:1875689374585600:192.168.204.38@tcp:104: 00000100:00100000:1.0:1788797194.267100:0:16434:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb048e28700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16434:1875689374585728:192.168.204.38@tcp:104: 00000100:00100000:2.0:1788797194.267119:0:14296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351527808 00000100:00100000:2.0:1788797194.267127:0:14296:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351527808 00010000:00010000:1.0:1788797194.267139:0:16434:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8cb079b81600/0xca7fc0c411f9493e lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797194.267164:0:14296:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cb040030400/0xca7fc0c411f948dc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee13e6 expref: 13 pid: 14303 timeout: 583 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788797194.267200:0:14296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 7 00000100:00100000:2.0:1788797194.267210:0:14296:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb079b93480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:17a8599e-7555-4132-8043-ffdcb544e5c7+13:2354:x1875689351527808:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788797194.267226:0:14296:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788797194.267232:0:14296:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cb040030400/0xca7fc0c411f948dc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee13e6 expref: 13 pid: 14303 timeout: 583 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797194.267242:0:14296:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cb040030400/0xca7fc0c411f948dc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee13e6 expref: 13 pid: 14303 timeout: 583 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797194.267261:0:14296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cb040030400/0xca7fc0c411f948dc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee13e6 expref: 13 pid: 14303 timeout: 583 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797194.267276:0:14296:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788797194.267339:0:14296:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb079b93480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:17a8599e-7555-4132-8043-ffdcb544e5c7+12:2354:x1875689351527808:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 130us (433us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797194.267347:0:14296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 7 00000100:00100000:3.0:1788797194.282836:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1788797194.282940:0:14297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351527936 00000100:00100000:2.0:1788797194.282950:0:14297:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351527936 00010000:00010000:2.0:1788797194.282988:0:14297:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cb041485a00/0xca7fc0c411f94914 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1448 expref: 12 pid: 14305 timeout: 583 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788797194.283075:0:14297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 8 00000100:00100000:2.0:1788797194.283085:0:14297:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8caf42060700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:17a8599e-7555-4132-8043-ffdcb544e5c7+12:2355:x1875689351527936:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788797194.283116:0:14297:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788797194.283123:0:14297:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cb041485a00/0xca7fc0c411f94914 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1448 expref: 12 pid: 14305 timeout: 583 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797194.283138:0:14297:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cb041485a00/0xca7fc0c411f94914 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1448 expref: 12 pid: 14305 timeout: 583 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797194.283162:0:14297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cb041485a00/0xca7fc0c411f94914 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1448 expref: 12 pid: 14305 timeout: 583 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797194.283183:0:14297:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8cb079b81600/0xca7fc0c411f9493e lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797194.283193:0:14297:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cb079b81600/0xca7fc0c411f9493e lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797194.283210:0:14297:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cb079b81600/0xca7fc0c411f9493e lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797194.283218:0:14297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cb079b81600/0xca7fc0c411f9493e lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797194.283225:0:14297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cb079b81600/0xca7fc0c411f9493e lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797194.283232:0:14297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cb079b81600/0xca7fc0c411f9493e lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797194.283239:0:14297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb079b81600 already unused, calling callback (ffffffffc14d98b0) 00010000:00010000:2.0:1788797194.283243:0:14297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cb079b81600/0xca7fc0c411f9493e lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797194.283261:0:14297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cb079b81600/0xca7fc0c411f9493e lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 16434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797194.283285:0:14297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cb079b81600/0xca7fc0c411f9493e lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797194.283297:0:14297:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788797194.283364:0:14297:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8caf42060700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:17a8599e-7555-4132-8043-ffdcb544e5c7+11:2355:x1875689351527936:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 280us (539us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797194.283372:0:14297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 8 00010000:00010000:1.0:1788797194.283445:0:16434:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8cb079b81600/0xca7fc0c411f9493e lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797194.283455:0:16434:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cb079b81600/0xca7fc0c411f9493e lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797194.283461:0:16434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cb079b81600/0xca7fc0c411f9493e lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788797194.802232:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788797194.802255:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb0795dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875689374586624:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788797194.802617:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788797194.802671:0:14998:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374586624 00000100:00100000:3.0:1788797194.802681:0:14998:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374586624 00000100:00080000:2.0:1788797194.802716:0:14306:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788797194.802758:0:14998:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788797194.802770:0:14998:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0795d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875689374586624:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788797194.802811:0:14998:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788797194.802893:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb079b91880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3300:1875689374586880:0@lo:400:kworker.0 00000100:00100000:0.0:1788797194.802943:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788797194.802950:0:14998:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0795d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875689374586624:12345-0@lo:13:osp-pre-1-0.0 Request processed in 184us (334us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797194.802957:0:14998:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788797194.802962:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788797194.802967:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb079b91c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3300:1875689374587008:0@lo:400:kworker.0 00000100:00100000:3.0:1788797194.802977:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb079b92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3302:1875689374587136:0@lo:400:kworker.0 00000100:00100000:0.0:1788797194.803000:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788797194.803053:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb079b93b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875689374586752:0@lo:400:kworker.0 00000100:00100000:3.0:1788797194.803096:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788797194.805541:0:14309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374586880 00000100:00100000:0.0:1788797194.805557:0:14309:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374586880 00000100:00100000:0.0:1788797194.805614:0:14309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374587008 00000100:00100000:0.0:1788797194.805618:0:14309:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374587008 00000100:00100000:0.0:1788797194.805654:0:14309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788797194.805665:0:14309:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb079b92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1875689374586880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788797194.805752:0:14309:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb079b92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1875689374586880:12345-0@lo:400:kworker.0 Request processed in 89us (2808us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797194.805759:0:14309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788797194.805777:0:14309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788797194.805784:0:14309:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb079b92300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1875689374587008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788797194.805811:0:14309:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb079b92300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1875689374587008:12345-0@lo:400:kworker.0 Request processed in 28us (2811us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797194.805815:0:14309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788797194.806321:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788797194.806506:0:14306:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788797194.806857:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb079b91c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3300:1875689374587008:0@lo:400:kworker.0 00000100:00100000:0.0:1788797194.806870:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb079b91880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3300:1875689374586880:0@lo:400:kworker.0 00000100:00100000:0.0:1788797194.806900:0:14309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374587136 00000100:00100000:0.0:1788797194.806905:0:14309:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374587136 00000100:00100000:0.0:1788797194.806943:0:14309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788797194.806950:0:14309:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0795d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1875689374587136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788797194.807229:0:14309:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0795d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1875689374587136:12345-0@lo:400:kworker.0 Request processed in 278us (908us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797194.807235:0:14309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:0.0:1788797194.807255:0:14306:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788797194.807705:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb079b92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3302:1875689374587136:0@lo:400:kworker.0 00000100:00100000:3.0:1788797194.810445:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb0795dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875689374586624:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788797194.815582:0:14996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374586752 00000100:00100000:0.0:1788797194.815603:0:14996:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374586752 00000100:00100000:0.0:1788797194.815797:0:14996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788797194.815807:0:14996:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8caf42061f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1875689374586752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788797194.815906:0:14996:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8caf42061f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1875689374586752:12345-0@lo:400:kworker.0 Request processed in 101us (12809us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797194.815913:0:14996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:2.0:1788797194.815963:0:14306:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788797194.816848:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb079b93b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875689374586752:0@lo:400:kworker.0 00010000:00010000:2.0:1788797195.058253:0:14299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788797195.764021:0:14307:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788797195.764050:0:14307:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8cb046310000 from 10 10000000:01000000:2.0:1788797195.764058:0:14307:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788797195.764126:0:14307:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.138@tcp lock: ffff8cb041485a00/0xca7fc0c411f94945 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797195.764141:0:14307:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.138@tcp lock: ffff8cb041485a00/0xca7fc0c411f94945 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797195.764158:0:14307:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.138@tcp lock: ffff8cb041485a00/0xca7fc0c411f94945 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788797195.764229:0:14307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb0795d9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73f6407e-c8af-46fc-9cc4-279490305b80:14307:1875689374587264:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788797195.764382:0:14307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788797195.764462:0:14307:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb06cfc16c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788797195.764638:0:14304:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374587264 00000100:00100000:0.0:1788797195.764649:0:14304:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374587264 00000100:00100000:0.0:1788797195.764715:0:14304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1788797195.764727:0:14304:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb06fb86450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73f6407e-c8af-46fc-9cc4-279490305b80+16:14307:x1875689374587264:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788797195.764744:0:14304:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788797195.764762:0:14304:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cb079b80a00/0xca7fc0c411f9494c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xca7fc0c411f94945 expref: -99 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797195.764791:0:14304:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cb079b80a00/0xca7fc0c411f9494c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xca7fc0c411f94945 expref: 17 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797195.764803:0:14304:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cb079b80a00/0xca7fc0c411f9494c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xca7fc0c411f94945 expref: 17 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797195.764814:0:14304:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb079b80a00, rc 0) 00000100:00100000:0.0:1788797195.764866:0:14304:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb06fb86450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73f6407e-c8af-46fc-9cc4-279490305b80+17:14307:x1875689374587264:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 141us (485us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797195.764886:0:14304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1788797195.765762:0:14307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb0795d9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73f6407e-c8af-46fc-9cc4-279490305b80:14307:1875689374587264:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788797195.765789:0:14307:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.138@tcp lock: ffff8cb041485a00/0xca7fc0c411f94945 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xca7fc0c411f9494c expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797195.765810:0:14307:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.138@tcp lock: ffff8cb041485a00/0xca7fc0c411f94945 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xca7fc0c411f9494c expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788797195.765903:0:14307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb0795d9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73f6407e-c8af-46fc-9cc4-279490305b80:14307:1875689374587392:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788797195.765952:0:14307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788797195.766002:0:14307:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb06cfc16c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788797195.766139:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374587392 00000100:00100000:0.0:1788797195.766147:0:14303:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374587392 00000100:00100000:0.0:1788797195.766187:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1788797195.766195:0:14303:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb06fb86850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73f6407e-c8af-46fc-9cc4-279490305b80+17:14307:x1875689374587392:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788797195.766532:0:14303:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb06fb86850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73f6407e-c8af-46fc-9cc4-279490305b80+17:14307:x1875689374587392:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 336us (579us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797195.766540:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1788797195.766884:0:14307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb0795d9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73f6407e-c8af-46fc-9cc4-279490305b80:14307:1875689374587392:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788797195.766928:0:14307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb0795d9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73f6407e-c8af-46fc-9cc4-279490305b80:14307:1875689374587520:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788797195.766975:0:14307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788797195.767025:0:14307:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb06cfc16c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788797195.767446:0:14305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374587520 00000100:00100000:0.0:1788797195.767453:0:14305:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374587520 00000100:00100000:0.0:1788797195.767490:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1788797195.767499:0:14305:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb06fb87450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73f6407e-c8af-46fc-9cc4-279490305b80+17:14307:x1875689374587520:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788797195.767718:0:14305:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb06fb87450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73f6407e-c8af-46fc-9cc4-279490305b80+17:14307:x1875689374587520:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 219us (741us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797195.767725:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1788797195.768338:0:14307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb0795d9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73f6407e-c8af-46fc-9cc4-279490305b80:14307:1875689374587520:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788797195.770332:0:16473:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:0.0:1788797195.772359:0:14307:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:0.0:1788797195.772404:0:14307:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.138@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788797195.772416:0:14307:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.138@tcp lock: ffff8cb041485a00/0xca7fc0c411f94945 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xca7fc0c411f9494c expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797195.772428:0:14307:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.138@tcp lock: ffff8cb041485a00/0xca7fc0c411f94945 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xca7fc0c411f9494c expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788797195.772439:0:14307:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788797195.772442:0:14307:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8cb05ca63800 from 10 10000000:01000000:0.0:1788797195.772445:0:14307:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788797195.772482:0:14307:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.138@tcp lock: ffff8cb079b81a00/0xca7fc0c411f94953 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797195.772500:0:14307:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.138@tcp lock: ffff8cb079b81a00/0xca7fc0c411f94953 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797195.772512:0:14307:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.138@tcp lock: ffff8cb079b81a00/0xca7fc0c411f94953 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788797195.772537:0:14307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb079b91880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73f6407e-c8af-46fc-9cc4-279490305b80:14307:1875689374587648:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788797195.772605:0:14307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788797195.772659:0:14307:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb06f48fcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788797195.773661:0:14304:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374587648 00000100:00100000:2.0:1788797195.773672:0:14304:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374587648 00000100:00100000:2.0:1788797195.773722:0:14304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1788797195.773733:0:14304:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb06fb85850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73f6407e-c8af-46fc-9cc4-279490305b80+17:14307:x1875689374587648:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788797195.773752:0:14304:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788797195.773780:0:14304:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cb041484e00/0xca7fc0c411f9495a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xca7fc0c411f94953 expref: -99 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797195.773827:0:14304:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cb041484e00/0xca7fc0c411f9495a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xca7fc0c411f94953 expref: 18 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797195.773841:0:14304:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cb041484e00/0xca7fc0c411f9495a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xca7fc0c411f94953 expref: 18 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797195.773851:0:14304:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb041484e00, rc 0) 00000100:00100000:2.0:1788797195.773930:0:14304:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb06fb85850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73f6407e-c8af-46fc-9cc4-279490305b80+18:14307:x1875689374587648:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 199us (1325us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797195.773937:0:14304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1788797195.774060:0:14307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb079b91880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73f6407e-c8af-46fc-9cc4-279490305b80:14307:1875689374587648:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788797195.774079:0:14307:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.138@tcp lock: ffff8cb079b81a00/0xca7fc0c411f94953 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xca7fc0c411f9495a expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797195.774089:0:14307:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.138@tcp lock: ffff8cb079b81a00/0xca7fc0c411f94953 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xca7fc0c411f9495a expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788797195.774162:0:14307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb0795c7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73f6407e-c8af-46fc-9cc4-279490305b80:14307:1875689374587776:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788797195.774191:0:14307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788797195.774228:0:14307:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb0464b3780 going to sleep for 11 seconds 00000100:00100000:2.0:1788797195.774646:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374587776 00000100:00100000:2.0:1788797195.774653:0:14303:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374587776 00000100:00100000:2.0:1788797195.774698:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1788797195.774708:0:14303:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb06fb85050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73f6407e-c8af-46fc-9cc4-279490305b80+18:14307:x1875689374587776:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788797195.775134:0:14303:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb06fb85050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73f6407e-c8af-46fc-9cc4-279490305b80+18:14307:x1875689374587776:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 426us (940us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797195.775143:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1788797195.775248:0:14307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb0795c7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73f6407e-c8af-46fc-9cc4-279490305b80:14307:1875689374587776:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788797195.775287:0:14307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb0795c7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73f6407e-c8af-46fc-9cc4-279490305b80:14307:1875689374587904:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788797195.775334:0:14307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788797195.775365:0:14307:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb0464b3780 going to sleep for 11 seconds 00000100:00100000:0.0:1788797195.775495:0:14305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374587904 00000100:00100000:0.0:1788797195.775501:0:14305:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374587904 00000100:00100000:0.0:1788797195.775542:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1788797195.775550:0:14305:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb06fb87050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73f6407e-c8af-46fc-9cc4-279490305b80+18:14307:x1875689374587904:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788797195.775742:0:14305:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb06fb87050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73f6407e-c8af-46fc-9cc4-279490305b80+18:14307:x1875689374587904:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 192us (407us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797195.775750:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1788797195.776130:0:14307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb0795c7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73f6407e-c8af-46fc-9cc4-279490305b80:14307:1875689374587904:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788797195.783701:0:16474:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:1.0:1788797195.784206:0:14307:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:1.0:1788797195.784238:0:14307:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.138@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788797195.784250:0:14307:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.138@tcp lock: ffff8cb079b81a00/0xca7fc0c411f94953 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xca7fc0c411f9495a expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797195.784263:0:14307:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.138@tcp lock: ffff8cb079b81a00/0xca7fc0c411f94953 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xca7fc0c411f9495a expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788797195.784275:0:14307:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788797195.784278:0:14307:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8cb07906b800 from 10 10000000:01000000:1.0:1788797195.784280:0:14307:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788797195.784321:0:14307:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.138@tcp lock: ffff8cb080437600/0xca7fc0c411f94961 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797195.784329:0:14307:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.138@tcp lock: ffff8cb080437600/0xca7fc0c411f94961 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797195.784340:0:14307:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.138@tcp lock: ffff8cb080437600/0xca7fc0c411f94961 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788797195.784378:0:14307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb0795c7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73f6407e-c8af-46fc-9cc4-279490305b80:14307:1875689374588032:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788797195.784456:0:14307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788797195.784511:0:14307:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb0464b3300 going to sleep for 11 seconds 00000100:00100000:0.0:1788797195.784895:0:14305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374588032 00000100:00100000:0.0:1788797195.784904:0:14305:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374588032 00000100:00100000:0.0:1788797195.784960:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1788797195.784973:0:14305:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb06fb84050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73f6407e-c8af-46fc-9cc4-279490305b80+18:14307:x1875689374588032:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788797195.784994:0:14305:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788797195.785022:0:14305:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cb079b81800/0xca7fc0c411f94968 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xca7fc0c411f94961 expref: -99 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797195.785087:0:14305:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cb079b81800/0xca7fc0c411f94968 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xca7fc0c411f94961 expref: 19 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797195.785113:0:14305:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cb079b81800/0xca7fc0c411f94968 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xca7fc0c411f94961 expref: 19 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797195.785123:0:14305:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb079b81800, rc 0) 00000100:00100000:0.0:1788797195.785181:0:14305:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb06fb84050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73f6407e-c8af-46fc-9cc4-279490305b80+19:14307:x1875689374588032:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 213us (726us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797195.785187:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1788797195.785316:0:14307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb0795c7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73f6407e-c8af-46fc-9cc4-279490305b80:14307:1875689374588032:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788797195.785332:0:14307:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.138@tcp lock: ffff8cb080437600/0xca7fc0c411f94961 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xca7fc0c411f94968 expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797195.785341:0:14307:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.138@tcp lock: ffff8cb080437600/0xca7fc0c411f94961 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xca7fc0c411f94968 expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788797195.785398:0:14307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb0795c7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73f6407e-c8af-46fc-9cc4-279490305b80:14307:1875689374588160:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788797195.785429:0:14307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788797195.785737:0:14307:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb0464b3300 going to sleep for 11 seconds 00000100:00100000:0.0:1788797195.786308:0:14305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374588160 00000100:00100000:0.0:1788797195.786317:0:14305:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374588160 00000100:00100000:0.0:1788797195.786348:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1788797195.786356:0:14305:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb06fb87850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73f6407e-c8af-46fc-9cc4-279490305b80+19:14307:x1875689374588160:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788797195.786916:0:14305:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb06fb87850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73f6407e-c8af-46fc-9cc4-279490305b80+19:14307:x1875689374588160:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 558us (1484us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797195.786925:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1788797195.790121:0:14307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb0795c7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73f6407e-c8af-46fc-9cc4-279490305b80:14307:1875689374588160:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788797195.790238:0:14307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb0795c7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73f6407e-c8af-46fc-9cc4-279490305b80:14307:1875689374588288:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788797195.790346:0:14307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788797195.790401:0:14307:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb0464b3300 going to sleep for 11 seconds 00000100:00100000:3.0:1788797195.790669:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374588288 00000100:00100000:3.0:1788797195.790679:0:14303:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374588288 00000100:00100000:3.0:1788797195.791019:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1788797195.791054:0:14303:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb06fb85c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73f6407e-c8af-46fc-9cc4-279490305b80+19:14307:x1875689374588288:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788797195.791461:0:14303:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb06fb85c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73f6407e-c8af-46fc-9cc4-279490305b80+19:14307:x1875689374588288:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 432us (1114us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797195.791468:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1788797195.791575:0:14307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb0795c7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73f6407e-c8af-46fc-9cc4-279490305b80:14307:1875689374588288:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788797195.795955:0:16476:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:3.0:1788797195.798752:0:14307:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:3.0:1788797195.799162:0:14307:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.138@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788797195.799179:0:14307:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.138@tcp lock: ffff8cb080437600/0xca7fc0c411f94961 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xca7fc0c411f94968 expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797195.799194:0:14307:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.138@tcp lock: ffff8cb080437600/0xca7fc0c411f94961 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xca7fc0c411f94968 expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788797195.867903:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1788797195.868386:0:14305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351528064 00000100:00100000:2.0:1788797195.868400:0:14305:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351528064 00000100:00100000:2.0:1788797195.869172:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 116 00000100:00100000:2.0:1788797195.869186:0:14305:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb079f76850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17a8599e-7555-4132-8043-ffdcb544e5c7+11:13768:x1875689351528064:12345-192.168.204.38@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788797195.869215:0:14305:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788797195.869234:0:14305:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cb041484a00/0xca7fc0c411f9496f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x7c99e04559ee1479 expref: -99 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797195.869286:0:14305:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cb041484a00/0xca7fc0c411f9496f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1479 expref: 12 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797195.869303:0:14305:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cb041484a00/0xca7fc0c411f9496f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1479 expref: 12 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797195.869313:0:14305:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb041484a00, rc 0) 00000100:00100000:2.0:1788797195.869393:0:14305:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb079f76850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17a8599e-7555-4132-8043-ffdcb544e5c7+12:13768:x1875689351528064:12345-192.168.204.38@tcp:101:ll_cfg_requeue.0 Request processed in 210us (1508us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797195.869401:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 116 00000100:00100000:0.0:1788797195.880181:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1788797195.880433:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351528192 00000100:00100000:3.0:1788797195.880445:0:14303:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351528192 00000100:00100000:3.0:1788797195.880560:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 117 00000100:00100000:3.0:1788797195.880570:0:14303:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb079f75c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17a8599e-7555-4132-8043-ffdcb544e5c7+12:13768:x1875689351528192:12345-192.168.204.38@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788797195.880912:0:14303:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb079f75c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17a8599e-7555-4132-8043-ffdcb544e5c7+12:13768:x1875689351528192:12345-192.168.204.38@tcp:501:ll_cfg_requeue.0 Request processed in 343us (738us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797195.880921:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 117 00000100:00100000:1.0:1788797195.905623:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1788797195.906764:0:14305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351528320 00000100:00100000:2.0:1788797195.906779:0:14305:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351528320 00000100:00100000:2.0:1788797195.906897:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 118 00000100:00100000:2.0:1788797195.906907:0:14305:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb079f75050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17a8599e-7555-4132-8043-ffdcb544e5c7+12:13768:x1875689351528320:12345-192.168.204.38@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788797195.907192:0:14305:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb079f75050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17a8599e-7555-4132-8043-ffdcb544e5c7+12:13768:x1875689351528320:12345-192.168.204.38@tcp:503:ll_cfg_requeue.0 Request processed in 286us (1578us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797195.910252:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 118 00000100:00100000:0.0:1788797195.919392:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1788797195.919451:0:14304:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351528448 00000100:00100000:0.0:1788797195.919464:0:14304:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351528448 00000100:00100000:0.0:1788797195.919525:0:14304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 119 00000100:00100000:0.0:1788797195.920181:0:14304:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb079f75850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17a8599e-7555-4132-8043-ffdcb544e5c7+12:13768:x1875689351528448:12345-192.168.204.38@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788797195.920211:0:14304:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788797195.920232:0:14304:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cb079b81400/0xca7fc0c411f94976 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x7c99e04559ee1480 expref: -99 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797195.920263:0:14304:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cb079b81400/0xca7fc0c411f94976 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1480 expref: 13 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797195.920285:0:14304:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cb079b81400/0xca7fc0c411f94976 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1480 expref: 13 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797195.920295:0:14304:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb079b81400, rc 0) 00000100:00100000:0.0:1788797195.920351:0:14304:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb079f75850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17a8599e-7555-4132-8043-ffdcb544e5c7+13:13768:x1875689351528448:12345-192.168.204.38@tcp:101:ll_cfg_requeue.0 Request processed in 816us (972us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797195.920358:0:14304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 119 00000100:00100000:1.0:1788797195.929865:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1788797195.929905:0:14305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351528576 00000100:00100000:1.0:1788797195.929916:0:14305:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351528576 00000100:00100000:1.0:1788797195.929965:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 120 00000100:00100000:1.0:1788797195.929975:0:14305:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb079f77450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17a8599e-7555-4132-8043-ffdcb544e5c7+13:13768:x1875689351528576:12345-192.168.204.38@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788797195.930481:0:14305:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb079f77450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17a8599e-7555-4132-8043-ffdcb544e5c7+13:13768:x1875689351528576:12345-192.168.204.38@tcp:501:ll_cfg_requeue.0 Request processed in 506us (629us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797195.930491:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 120 00000100:00100000:3.0:1788797195.937503:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1788797195.937557:0:14304:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351528704 00000100:00100000:3.0:1788797195.937568:0:14304:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351528704 00000100:00100000:3.0:1788797195.937731:0:14304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 121 00000100:00100000:3.0:1788797195.937745:0:14304:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb079f77850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17a8599e-7555-4132-8043-ffdcb544e5c7+13:13768:x1875689351528704:12345-192.168.204.38@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788797195.939302:0:14304:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb079f77850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17a8599e-7555-4132-8043-ffdcb544e5c7+13:13768:x1875689351528704:12345-192.168.204.38@tcp:503:ll_cfg_requeue.0 Request processed in 1552us (1804us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797195.939314:0:14304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 121 00010000:00010000:0.0:1788797196.086259:0:15413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788797196.850552:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8caf42063100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875689374588416:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788797196.850638:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788797196.850762:0:14998:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374588416 00000100:00100000:1.0:1788797196.850771:0:14998:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374588416 00000100:00100000:1.0:1788797196.850836:0:14998:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788797196.850846:0:14998:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb079b91c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875689374588416:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788797196.850882:0:14998:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00080000:2.0:1788797196.855475:0:14306:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788797196.859881:0:14998:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb079b91c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875689374588416:12345-0@lo:13:osp-pre-0-0.0 Request processed in 9020us (9225us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797196.859899:0:14998:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788797196.860206:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8caf42063100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875689374588416:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788797197.106355:0:14298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788797197.205061:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1788797197.205122:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1788797197.205157:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1788797197.205229:0:14995:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351529216 00000100:00100000:3.0:1788797197.205244:0:14995:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351529216 00000100:00100000:3.0:1788797197.205353:0:14995:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351529472 00000100:00100000:3.0:1788797197.205357:0:14995:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351529472 00000100:00100000:3.0:1788797197.205388:0:14995:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 12 00000100:00100000:3.0:1788797197.205404:0:14995:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb079b90e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8d52f9f5-7df3-47f4-a430-77f8dd50f6ec+5:2355:x1875689351529216:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:3.0:1788797197.205515:0:14995:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb079b90e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8d52f9f5-7df3-47f4-a430-77f8dd50f6ec+5:2355:x1875689351529216:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 115us (392us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797197.205523:0:14995:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 12 00000100:00100000:3.0:1788797197.205544:0:14995:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 13 00000100:00100000:3.0:1788797197.205551:0:14995:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb079b90380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f43fc909-14ed-4850-ae62-0e6c56c6a361+5:2355:x1875689351529472:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:3.0:1788797197.205577:0:14995:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb079b90380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f43fc909-14ed-4850-ae62-0e6c56c6a361+5:2355:x1875689351529472:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 27us (420us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797197.205583:0:14995:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 13 00000100:00100000:2.0:1788797197.207597:0:15017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351528960 00000100:00100000:2.0:1788797197.207614:0:15017:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351528960 00000100:00100000:2.0:1788797197.207700:0:15017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 24 00000100:00100000:2.0:1788797197.207713:0:15017:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb079b90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8d52f9f5-7df3-47f4-a430-77f8dd50f6ec+6:2355:x1875689351528960:12345-192.168.204.38@tcp:400:kworker.0 00000100:00080000:0.0:1788797197.207900:0:14306:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788797197.207909:0:14306:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788797197.207915:0:14306:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788797197.209704:0:15017:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb079b90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8d52f9f5-7df3-47f4-a430-77f8dd50f6ec+6:2355:x1875689351528960:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 1984us (4677us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797197.209718:0:15017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 24 00000100:00100000:0.0:1788797197.233185:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1788797197.233229:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1788797197.233270:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1788797197.233364:0:14995:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351529088 00000100:00100000:0.0:1788797197.233368:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1788797197.233376:0:14995:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351529088 00000100:00100000:0.0:1788797197.233395:0:14309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351529344 00000100:00100000:0.0:1788797197.233398:0:14309:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351529344 00000100:00100000:2.0:1788797197.233436:0:14995:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351529600 00000100:00100000:2.0:1788797197.233439:0:14995:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351529600 00000100:00100000:0.0:1788797197.233440:0:14309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 25 00000100:00100000:0.0:1788797197.233448:0:14309:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb079b91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f43fc909-14ed-4850-ae62-0e6c56c6a361+6:2355:x1875689351529344:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:2.0:1788797197.233460:0:14995:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 14 00000100:00100000:2.0:1788797197.233465:0:14995:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb079b91f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8d52f9f5-7df3-47f4-a430-77f8dd50f6ec+5:2355:x1875689351529088:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:2.0:1788797197.233523:0:14995:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb079b91f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8d52f9f5-7df3-47f4-a430-77f8dd50f6ec+5:2355:x1875689351529088:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 58us (294us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797197.233531:0:14995:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 14 00000100:00100000:2.0:1788797197.233547:0:14995:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 15 00000100:00100000:2.0:1788797197.233553:0:14995:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb079b93100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f43fc909-14ed-4850-ae62-0e6c56c6a361+5:2355:x1875689351529600:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:2.0:1788797197.233576:0:14995:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb079b93100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f43fc909-14ed-4850-ae62-0e6c56c6a361+5:2355:x1875689351529600:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 23us (207us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797197.233663:0:14309:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb079b91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f43fc909-14ed-4850-ae62-0e6c56c6a361+6:2355:x1875689351529344:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 214us (392us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797197.233687:0:14309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 25 00000100:00080000:0.0:1788797197.233718:0:14306:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788797197.233723:0:14306:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788797197.233725:0:14306:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788797197.234071:0:14995:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 15 00000100:00100000:1.0:1788797197.234367:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351528832 00000100:00100000:1.0:1788797197.234376:0:14303:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351528832 00000100:00100000:1.0:1788797197.234461:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 122 00000100:00100000:1.0:1788797197.234470:0:14303:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb079f74050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17a8599e-7555-4132-8043-ffdcb544e5c7+13:2355:x1875689351528832:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:1.0:1788797197.234852:0:14303:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb079f74050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17a8599e-7555-4132-8043-ffdcb544e5c7+13:2355:x1875689351528832:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 382us (1677us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797197.234860:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 122 00010000:00010000:2.0:1788797198.131311:0:14299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788797198.583622:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1788797198.583938:0:14311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351529728 00000100:00100000:1.0:1788797198.583963:0:14311:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351529728 00000100:00100000:1.0:1788797198.584062:0:14311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 15 00000100:00100000:1.0:1788797198.584075:0:14311:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8caf42063800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8d52f9f5-7df3-47f4-a430-77f8dd50f6ec+6:14423:x1875689351529728:12345-192.168.204.38@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788797198.584099:0:14311:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788797198.584120:0:14311:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080437000/0xca7fc0c411f9497d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c99e04559ee1487 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797198.584212:0:14311:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080436400/0xca7fc0c411f94984 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797198.584240:0:14311:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080436400/0xca7fc0c411f94984 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797198.584252:0:14311:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080436400/0xca7fc0c411f94984 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797198.584272:0:14311:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080437e00/0xca7fc0c411f9498b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797198.584279:0:14311:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080437e00/0xca7fc0c411f9498b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797198.584286:0:14311:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080437e00/0xca7fc0c411f9498b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797198.584603:0:14311:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080437400/0xca7fc0c411f94992 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797198.584611:0:14311:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080437400/0xca7fc0c411f94992 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797198.584618:0:14311:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080437400/0xca7fc0c411f94992 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788797198.584642:0:14311:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788797198.584645:0:14311:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788797198.584685:0:14311:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080437400/0xca7fc0c411f94992 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797198.584721:0:14311:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080436400/0xca7fc0c411f94984 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797198.584727:0:14311:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080436400/0xca7fc0c411f94984 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797198.584741:0:14311:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080436400/0xca7fc0c411f94984 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797198.584747:0:14311:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb080436400 already unused, calling callback (ffffffffc1f014f0) 00010000:00010000:1.0:1788797198.584752:0:14311:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080436400/0xca7fc0c411f94984 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797198.584759:0:14311:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080436400/0xca7fc0c411f94984 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797198.584772:0:14311:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cb06ce84800) 00010000:00010000:1.0:1788797198.584775:0:14311:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788797198.584780:0:14311:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080436400/0xca7fc0c411f94984 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797198.584787:0:14311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080436400/0xca7fc0c411f94984 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797198.584800:0:14311:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080437e00/0xca7fc0c411f9498b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797198.585527:0:14311:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080437e00/0xca7fc0c411f9498b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797198.585537:0:14311:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080437e00/0xca7fc0c411f9498b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797198.585552:0:14311:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb080437e00 already unused, calling callback (ffffffffc1f014f0) 00010000:00010000:1.0:1788797198.585556:0:14311:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080437e00/0xca7fc0c411f9498b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797198.585563:0:14311:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080437e00/0xca7fc0c411f9498b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797198.585575:0:14311:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff8cb06ce84e00) 00010000:00010000:1.0:1788797198.585577:0:14311:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788797198.585580:0:14311:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080437e00/0xca7fc0c411f9498b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797198.585586:0:14311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080437e00/0xca7fc0c411f9498b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797198.585629:0:14311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080437000/0xca7fc0c411f9497d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1487 expref: 8 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797198.585643:0:14311:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080437400/0xca7fc0c411f94992 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1487 expref: 7 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797198.585650:0:14311:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8cb06ce84300) 00010000:00010000:1.0:1788797198.585652:0:14311:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788797198.585655:0:14311:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb080437400, rc 0) 00000100:00100000:1.0:1788797198.585743:0:14311:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8caf42063800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8d52f9f5-7df3-47f4-a430-77f8dd50f6ec+7:14423:x1875689351529728:12345-192.168.204.38@tcp:101:lhsmtool_posix.0 Request processed in 1661us (2127us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797198.585751:0:14311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 15 00000100:00100000:3.0:1788797198.611760:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1788797198.612092:0:14309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351529984 00000100:00100000:0.0:1788797198.612103:0:14309:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351529984 00000100:00100000:0.0:1788797198.612184:0:14309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 16 00000100:00100000:0.0:1788797198.612197:0:14309:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8caf42063b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8d52f9f5-7df3-47f4-a430-77f8dd50f6ec+7:14423:x1875689351529984:12345-192.168.204.38@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788797198.612234:0:14309:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788797198.612415:0:14309:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb079b80e00/0xca7fc0c411f94999 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c99e04559ee148e expref: -99 pid: 14309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797198.612497:0:14309:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb079b80800/0xca7fc0c411f949a0 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14309 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797198.612511:0:14309:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb079b80800/0xca7fc0c411f949a0 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14309 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797198.612521:0:14309:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb079b80800/0xca7fc0c411f949a0 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14309 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797198.612561:0:14309:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb079b81e00/0xca7fc0c411f949a7 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14309 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797198.612569:0:14309:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb079b81e00/0xca7fc0c411f949a7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14309 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797198.612576:0:14309:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb079b81e00/0xca7fc0c411f949a7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14309 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797198.613151:0:14309:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb079b80200/0xca7fc0c411f949ae lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14309 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797198.613162:0:14309:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb079b80200/0xca7fc0c411f949ae lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14309 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797198.613170:0:14309:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb079b80200/0xca7fc0c411f949ae lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14309 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788797198.613181:0:14309:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:0.0:1788797198.613607:0:14309:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb079b80800/0xca7fc0c411f949a0 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14309 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797198.613616:0:14309:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb079b80800/0xca7fc0c411f949a0 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14309 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797198.613622:0:14309:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb079b80800/0xca7fc0c411f949a0 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14309 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797198.613628:0:14309:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb079b80800 already unused, calling callback (ffffffffc1f014f0) 00010000:00010000:0.0:1788797198.613633:0:14309:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb079b80800/0xca7fc0c411f949a0 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14309 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797198.613639:0:14309:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb079b80800/0xca7fc0c411f949a0 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14309 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797198.613651:0:14309:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8cb06ce84300) 00010000:00010000:0.0:1788797198.613654:0:14309:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788797198.613659:0:14309:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb079b80800/0xca7fc0c411f949a0 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14309 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797198.613675:0:14309:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb079b80800/0xca7fc0c411f949a0 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14309 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797198.613687:0:14309:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb079b81e00/0xca7fc0c411f949a7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14309 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797198.613693:0:14309:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb079b81e00/0xca7fc0c411f949a7 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14309 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797198.613699:0:14309:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb079b81e00/0xca7fc0c411f949a7 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14309 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797198.613704:0:14309:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb079b81e00 already unused, calling callback (ffffffffc1f014f0) 00010000:00010000:0.0:1788797198.613708:0:14309:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb079b81e00/0xca7fc0c411f949a7 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14309 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797198.613714:0:14309:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb079b81e00/0xca7fc0c411f949a7 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14309 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797198.613721:0:14309:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8cb043bd4a00) 00010000:00010000:0.0:1788797198.613723:0:14309:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788797198.613726:0:14309:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb079b81e00/0xca7fc0c411f949a7 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14309 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797198.614912:0:14309:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb079b81e00/0xca7fc0c411f949a7 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14309 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797198.617632:0:14309:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb079b80e00/0xca7fc0c411f94999 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee148e expref: 10 pid: 14309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797198.618513:0:14309:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb079b80200/0xca7fc0c411f949ae lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee148e expref: 9 pid: 14309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797198.618523:0:14309:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8cb043bd4300) 00010000:00010000:0.0:1788797198.618527:0:14309:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788797198.618531:0:14309:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb079b80200, rc 0) 00000100:00100000:0.0:1788797198.618761:0:14309:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8caf42063b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8d52f9f5-7df3-47f4-a430-77f8dd50f6ec+9:14423:x1875689351529984:12345-192.168.204.38@tcp:101:lhsmtool_posix.0 Request processed in 6564us (7014us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1788797198.618770:0:14309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 16 00000100:00100000:0.0:1788797198.632164:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1788797198.632343:0:14311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351530112 00000100:00100000:1.0:1788797198.632382:0:14311:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351530112 00000100:00100000:1.0:1788797198.632459:0:14311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 17 00000100:00100000:1.0:1788797198.632473:0:14311:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb079b90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8d52f9f5-7df3-47f4-a430-77f8dd50f6ec+9:14423:x1875689351530112:12345-192.168.204.38@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1788797198.632681:0:14311:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb079b90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8d52f9f5-7df3-47f4-a430-77f8dd50f6ec+9:14423:x1875689351530112:12345-192.168.204.38@tcp:59:lhsmtool_posix.0 Request processed in 210us (535us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797198.632690:0:14311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 17 00000100:00100000:3.0:1788797198.661294:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1788797198.661424:0:14310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351530240 00000100:00100000:2.0:1788797198.661441:0:14310:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351530240 00000100:00100000:2.0:1788797198.661518:0:14310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 18 00000100:00100000:2.0:1788797198.661529:0:14310:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8caf42060380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8d52f9f5-7df3-47f4-a430-77f8dd50f6ec+9:14429:x1875689351530240:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1788797198.661551:0:14310:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788797198.661572:0:14310:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041485c00/0xca7fc0c411f949bc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c99e04559ee1495 expref: -99 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797198.661672:0:14310:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484400/0xca7fc0c411f949c3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797198.661692:0:14310:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484400/0xca7fc0c411f949c3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797198.661718:0:14310:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484400/0xca7fc0c411f949c3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797198.661923:0:14310:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484000/0xca7fc0c411f949ca lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797198.661933:0:14310:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484000/0xca7fc0c411f949ca lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797198.661940:0:14310:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484000/0xca7fc0c411f949ca lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797198.662200:0:14310:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484400/0xca7fc0c411f949c3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797198.662208:0:14310:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484400/0xca7fc0c411f949c3 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797198.662216:0:14310:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484400/0xca7fc0c411f949c3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797198.662222:0:14310:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb041484400 already unused, calling callback (ffffffffc1f014f0) 00010000:00010000:2.0:1788797198.662227:0:14310:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484400/0xca7fc0c411f949c3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797198.662235:0:14310:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484400/0xca7fc0c411f949c3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797198.662248:0:14310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cb06ce84800) 00010000:00010000:2.0:1788797198.662252:0:14310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788797198.662256:0:14310:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484400/0xca7fc0c411f949c3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797198.662269:0:14310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484400/0xca7fc0c411f949c3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797198.662281:0:14310:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484000/0xca7fc0c411f949ca lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797198.662287:0:14310:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484000/0xca7fc0c411f949ca lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797198.662293:0:14310:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484000/0xca7fc0c411f949ca lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797198.662298:0:14310:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb041484000 already unused, calling callback (ffffffffc1f014f0) 00010000:00010000:2.0:1788797198.662301:0:14310:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484000/0xca7fc0c411f949ca lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797198.662307:0:14310:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484000/0xca7fc0c411f949ca lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797198.662313:0:14310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8cb05088ad00) 00010000:00010000:2.0:1788797198.662316:0:14310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788797198.662319:0:14310:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484000/0xca7fc0c411f949ca lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797198.662324:0:14310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484000/0xca7fc0c411f949ca lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797198.662358:0:14310:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041485c00/0xca7fc0c411f949bc lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1495 expref: 10 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797198.662380:0:14310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cb06ce84800) 00010000:00010000:2.0:1788797198.662383:0:14310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788797198.662387:0:14310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041485c00/0xca7fc0c411f949bc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1495 expref: 10 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797198.662399:0:14310:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb041485c00, rc 0) 00000100:00100000:2.0:1788797198.662473:0:14310:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8caf42060380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8d52f9f5-7df3-47f4-a430-77f8dd50f6ec+9:14429:x1875689351530240:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 945us (1190us total) trans 0 rc 301/301 00000100:00100000:2.0:1788797198.662481:0:14310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 18 00000100:00100000:2.0:1788797198.669231:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1788797198.669396:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351530368 00000100:00100000:3.0:1788797198.669424:0:14318:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351530368 00000100:00100000:3.0:1788797198.669526:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 0 00000100:00100000:3.0:1788797198.669536:0:14318:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0795d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:8d52f9f5-7df3-47f4-a430-77f8dd50f6ec+9:14429:x1875689351530368:12345-192.168.204.38@tcp:700:lfs.0 00000100:00100000:3.0:1788797198.669629:0:14318:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0795d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:8d52f9f5-7df3-47f4-a430-77f8dd50f6ec+9:14429:x1875689351530368:12345-192.168.204.38@tcp:700:lfs.0 Request processed in 94us (418us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797198.669637:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 0 00000100:00100000:1.0:1788797198.671970:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1788797198.672375:0:15017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351530624 00000100:00100000:2.0:1788797198.672387:0:15017:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351530624 00000100:00100000:2.0:1788797198.672455:0:15017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19 00000100:00100000:2.0:1788797198.672468:0:15017:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0795c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8d52f9f5-7df3-47f4-a430-77f8dd50f6ec+9:14429:x1875689351530624:12345-192.168.204.38@tcp:36:lfs.0 00010000:00010000:2.0:1788797198.672538:0:15017:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788797198.672569:0:15017:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080436800/0xca7fc0c411f948ff lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1410 expref: 9 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797198.672589:0:15017:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cb06ce84800) 00010000:00010000:2.0:1788797198.672594:0:15017:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788797198.672919:0:15017:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041485c00/0xca7fc0c411f949d1 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797198.672940:0:15017:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041485600/0xca7fc0c411f94937 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1472 expref: 5 pid: 15017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797198.672973:0:15017:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041485c00/0xca7fc0c411f949d1 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797198.673019:0:15017:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041485600/0xca7fc0c411f94937 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1472 expref: 5 pid: 15017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797198.673086:0:15017:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041485600/0xca7fc0c411f94937 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1472 expref: 5 pid: 15017 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788797198.673104:0:15017:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb0795da680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15017:1875689374588544:192.168.204.38@tcp:104: 00000100:00100000:2.0:1788797198.673222:0:15017:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb04133a180 going to sleep for 11 seconds 00000100:00100000:2.0:1788797198.679271:0:15017:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb0795da680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15017:1875689374588544:192.168.204.38@tcp:104: 00010000:00010000:2.0:1788797198.679311:0:15017:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041485c00/0xca7fc0c411f949d1 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15017 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788797198.681240:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1788797198.683124:0:14295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351530752 00000100:00100000:0.0:1788797198.683147:0:14295:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351530752 00010000:00010000:0.0:1788797198.683907:0:14295:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041485600/0xca7fc0c411f94937 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1472 expref: 6 pid: 15017 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788797198.684085:0:14295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9 00000100:00100000:0.0:1788797198.684103:0:14295:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0795c5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f43fc909-14ed-4850-ae62-0e6c56c6a361+6:2355:x1875689351530752:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788797198.684124:0:14295:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788797198.684132:0:14295:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041485600/0xca7fc0c411f94937 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1472 expref: 6 pid: 15017 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797198.684149:0:14295:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041485600/0xca7fc0c411f94937 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1472 expref: 6 pid: 15017 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797198.684175:0:14295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041485600/0xca7fc0c411f94937 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1472 expref: 6 pid: 15017 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797198.684211:0:14295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cb06ce84800) 00010000:00010000:0.0:1788797198.684217:0:14295:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041485c00/0xca7fc0c411f949d1 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797198.684243:0:14295:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041485c00/0xca7fc0c411f949d1 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 15017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797198.684253:0:14295:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041485c00/0xca7fc0c411f949d1 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 15017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797198.684322:0:14295:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788797198.684407:0:14295:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0795c5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f43fc909-14ed-4850-ae62-0e6c56c6a361+5:2355:x1875689351530752:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 311us (3178us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797198.684415:0:14295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9 00010000:00010000:3.0:1788797198.686679:0:15017:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041485c00/0xca7fc0c411f949d1 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797198.686697:0:15017:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041485c00/0xca7fc0c411f949d1 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797198.686741:0:15017:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69400/0xca7fc0c411f949d8 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797198.686755:0:15017:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69400/0xca7fc0c411f949d8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797198.686767:0:15017:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69400/0xca7fc0c411f949d8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15017 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788797198.688130:0:15017:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:3.0:1788797198.688150:0:15017:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041485c00/0xca7fc0c411f949d1 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797198.688160:0:15017:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041485c00/0xca7fc0c411f949d1 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797198.688168:0:15017:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041485c00/0xca7fc0c411f949d1 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797198.688175:0:15017:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb041485c00 already unused, calling callback (ffffffffc1f014f0) 00010000:00010000:3.0:1788797198.688188:0:15017:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041485c00/0xca7fc0c411f949d1 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797198.688201:0:15017:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041485c00/0xca7fc0c411f949d1 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797198.688216:0:15017:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cb06ce84800) 00010000:00010000:3.0:1788797198.688220:0:15017:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788797198.688224:0:15017:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041485c00/0xca7fc0c411f949d1 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797198.688231:0:15017:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041485c00/0xca7fc0c411f949d1 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15017 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788797198.688252:0:15017:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000eabe396e reply state 00000000c290a462 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69400/0xca7fc0c411f949d8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15017 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788797198.688260:0:15017:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788797198.688380:0:15017:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0795c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8d52f9f5-7df3-47f4-a430-77f8dd50f6ec+10:14429:x1875689351530624:12345-192.168.204.38@tcp:36:lfs.0 Request processed in 15911us (16430us total) trans 8589934594 rc 0/0 00000100:00100000:3.0:1788797198.688389:0:15017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19 00010000:00010000:3.0:1788797198.694282:0:3286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69400/0xca7fc0c411f949d8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797198.694303:0:3286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69400/0xca7fc0c411f949d8 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797198.694310:0:3286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69400/0xca7fc0c411f949d8 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797198.694316:0:3286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb077c69400 already unused, calling callback (ffffffffc1f014f0) 00010000:00010000:3.0:1788797198.694321:0:3286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69400/0xca7fc0c411f949d8 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797198.694344:0:3286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69400/0xca7fc0c411f949d8 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797198.694361:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8cb065cc2300) 00010000:00010000:3.0:1788797198.694363:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788797198.694368:0:3286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69400/0xca7fc0c411f949d8 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797198.694374:0:3286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69400/0xca7fc0c411f949d8 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15017 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788797198.788717:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1788797198.791177:0:14310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351530880 00000100:00100000:2.0:1788797198.791195:0:14310:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351530880 00000100:00100000:2.0:1788797198.791270:0:14310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 20 00000100:00100000:2.0:1788797198.791281:0:14310:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0795c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8d52f9f5-7df3-47f4-a430-77f8dd50f6ec+9:14437:x1875689351530880:12345-192.168.204.38@tcp:101:lctl.0 00010000:00010000:2.0:1788797198.791306:0:14310:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788797198.791330:0:14310:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484000/0xca7fc0c411f949df lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c99e04559ee149c expref: -99 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797198.791394:0:14310:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484400/0xca7fc0c411f949e6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797198.791407:0:14310:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484400/0xca7fc0c411f949e6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797198.791433:0:14310:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484400/0xca7fc0c411f949e6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788797198.791467:0:14310:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788797198.791471:0:14310:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788797198.791505:0:14310:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484400/0xca7fc0c411f949e6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797198.791532:0:14310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484000/0xca7fc0c411f949df lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee149c expref: 11 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797198.791551:0:14310:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484400/0xca7fc0c411f949e6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee149c expref: 10 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797198.791559:0:14310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cb05088ad00) 00010000:00010000:2.0:1788797198.791562:0:14310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788797198.791565:0:14310:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb041484400, rc 0) 00000100:00100000:2.0:1788797198.791653:0:14310:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0795c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8d52f9f5-7df3-47f4-a430-77f8dd50f6ec+10:14437:x1875689351530880:12345-192.168.204.38@tcp:101:lctl.0 Request processed in 373us (2953us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797198.791661:0:14310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 20 00000100:00100000:1.0:1788797198.822996:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1788797198.823164:0:14311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351531008 00000100:00100000:0.0:1788797198.823177:0:14311:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351531008 00000100:00100000:0.0:1788797198.823245:0:14311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 21 00000100:00100000:0.0:1788797198.823266:0:14311:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0795c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f43fc909-14ed-4850-ae62-0e6c56c6a361+5:14438:x1875689351531008:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1788797198.823296:0:14311:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788797198.823317:0:14311:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb079b80800/0xca7fc0c411f949ed lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c99e04559ee14a3 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797198.823389:0:14311:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb079b81000/0xca7fc0c411f949f4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797198.823404:0:14311:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb079b81000/0xca7fc0c411f949f4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797198.823417:0:14311:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb079b81000/0xca7fc0c411f949f4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788797198.823495:0:14311:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788797198.823499:0:14311:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788797198.823522:0:14311:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cb079b81000/0xca7fc0c411f949f4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797198.823550:0:14311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb079b80800/0xca7fc0c411f949ed lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee14a3 expref: 7 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797198.823572:0:14311:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb079b81000/0xca7fc0c411f949f4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee14a3 expref: 6 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797198.823581:0:14311:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cb05088ad00) 00010000:00010000:0.0:1788797198.823584:0:14311:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788797198.823588:0:14311:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb079b81000, rc 0) 00000100:00100000:0.0:1788797198.823656:0:14311:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0795c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f43fc909-14ed-4850-ae62-0e6c56c6a361+6:14438:x1875689351531008:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 402us (675us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797198.823664:0:14311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 21 00000100:00100000:1.0:1788797198.828363:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1788797198.828586:0:14310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351531136 00000100:00100000:2.0:1788797198.828598:0:14310:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351531136 00000100:00100000:2.0:1788797198.828671:0:14310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 22 00000100:00100000:2.0:1788797198.828681:0:14310:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0795c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f43fc909-14ed-4850-ae62-0e6c56c6a361+6:14438:x1875689351531136:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1788797198.828701:0:14310:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788797198.828726:0:14310:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484000/0xca7fc0c411f949fb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c99e04559ee14aa expref: -99 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797198.828825:0:14310:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484c00/0xca7fc0c411f94a02 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797198.828841:0:14310:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484c00/0xca7fc0c411f94a02 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797198.828854:0:14310:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484c00/0xca7fc0c411f94a02 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797198.828869:0:14310:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041485200/0xca7fc0c411f94a09 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797198.828875:0:14310:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041485200/0xca7fc0c411f94a09 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797198.828881:0:14310:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041485200/0xca7fc0c411f94a09 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797198.829079:0:14310:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484800/0xca7fc0c411f94a10 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797198.829089:0:14310:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484800/0xca7fc0c411f94a10 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797198.829097:0:14310:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484800/0xca7fc0c411f94a10 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788797198.829136:0:14310:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788797198.829140:0:14310:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788797198.829159:0:14310:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484800/0xca7fc0c411f94a10 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797198.829181:0:14310:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484c00/0xca7fc0c411f94a02 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797198.829187:0:14310:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484c00/0xca7fc0c411f94a02 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797198.829194:0:14310:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484c00/0xca7fc0c411f94a02 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797198.829200:0:14310:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb041484c00 already unused, calling callback (ffffffffc1f014f0) 00010000:00010000:2.0:1788797198.829204:0:14310:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484c00/0xca7fc0c411f94a02 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797198.829212:0:14310:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484c00/0xca7fc0c411f94a02 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797198.829225:0:14310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cb05088ad00) 00010000:00010000:2.0:1788797198.829228:0:14310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788797198.829233:0:14310:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484c00/0xca7fc0c411f94a02 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797198.829239:0:14310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484c00/0xca7fc0c411f94a02 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797198.829251:0:14310:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041485200/0xca7fc0c411f94a09 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797198.829256:0:14310:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041485200/0xca7fc0c411f94a09 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797198.829261:0:14310:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041485200/0xca7fc0c411f94a09 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797198.829270:0:14310:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb041485200 already unused, calling callback (ffffffffc1f014f0) 00010000:00010000:2.0:1788797198.829273:0:14310:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041485200/0xca7fc0c411f94a09 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797198.829279:0:14310:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041485200/0xca7fc0c411f94a09 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797198.829286:0:14310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8cb05088a000) 00010000:00010000:2.0:1788797198.829289:0:14310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788797198.829291:0:14310:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041485200/0xca7fc0c411f94a09 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797198.829297:0:14310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041485200/0xca7fc0c411f94a09 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797198.829331:0:14310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484000/0xca7fc0c411f949fb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee14aa expref: 8 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797198.829343:0:14310:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484800/0xca7fc0c411f94a10 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee14aa expref: 7 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797198.829350:0:14310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8cb05088a800) 00010000:00010000:2.0:1788797198.829352:0:14310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788797198.829354:0:14310:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb041484800, rc 0) 00000100:00100000:2.0:1788797198.829428:0:14310:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0795c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f43fc909-14ed-4850-ae62-0e6c56c6a361+7:14438:x1875689351531136:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 748us (1078us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797198.829434:0:14310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 22 00000100:00100000:1.0:1788797198.833993:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1788797198.834145:0:14311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351531392 00000100:00100000:0.0:1788797198.834157:0:14311:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351531392 00000100:00100000:0.0:1788797198.834226:0:14311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 23 00000100:00100000:0.0:1788797198.834238:0:14311:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0795c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f43fc909-14ed-4850-ae62-0e6c56c6a361+7:14438:x1875689351531392:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1788797198.834271:0:14311:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788797198.834298:0:14311:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb079b80800/0xca7fc0c411f94a17 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c99e04559ee14b1 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788797198.834401:0:14311:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:0.0:1788797198.834539:0:14311:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb079b80800/0xca7fc0c411f94a17 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee14b1 expref: 9 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797198.834571:0:14311:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cb05088ad00) 00010000:00010000:0.0:1788797198.834574:0:14311:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788797198.834596:0:14311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb079b80800/0xca7fc0c411f94a17 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee14b1 expref: 9 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797198.834613:0:14311:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb079b80800, rc 0) 00000100:00100000:0.0:1788797198.834678:0:14311:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0795c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f43fc909-14ed-4850-ae62-0e6c56c6a361+8:14438:x1875689351531392:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 441us (695us total) trans 8589934595 rc 301/301 00000100:00100000:0.0:1788797198.834685:0:14311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 23 00000100:00100000:1.0:1788797198.838743:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1788797198.846765:0:14310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351531648 00000100:00100000:2.0:1788797198.846822:0:14310:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351531648 00000100:00100000:2.0:1788797198.846906:0:14310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 24 00000100:00100000:2.0:1788797198.846919:0:14310:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0795c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f43fc909-14ed-4850-ae62-0e6c56c6a361+8:14438:x1875689351531648:12345-192.168.204.38@tcp:36:lfs.0 00010000:00010000:2.0:1788797198.847000:0:14310:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788797198.847055:0:14310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484800/0xca7fc0c411f94a10 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee14aa expref: 8 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797198.847077:0:14310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8cb05088a800) 00010000:00010000:2.0:1788797198.847090:0:14310:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788797198.847117:0:14310:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484000/0xca7fc0c411f94a25 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797198.847132:0:14310:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484000/0xca7fc0c411f94a25 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797198.847142:0:14310:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484000/0xca7fc0c411f94a25 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788797198.847427:0:14310:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000cd5781c1 reply state 00000000043c06de transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484000/0xca7fc0c411f94a25 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788797198.847440:0:14310:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1788797198.847450:0:14310:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000100:00100000:2.0:1788797198.847583:0:14310:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0795c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f43fc909-14ed-4850-ae62-0e6c56c6a361+9:14438:x1875689351531648:12345-192.168.204.38@tcp:36:lfs.0 Request processed in 666us (8851us total) trans 8589934596 rc 0/0 00000100:00100000:2.0:1788797198.847591:0:14310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 24 00010000:00010000:3.0:1788797198.857733:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484000/0xca7fc0c411f94a25 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797198.857752:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484000/0xca7fc0c411f94a25 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797198.857760:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484000/0xca7fc0c411f94a25 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797198.857765:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb041484000 already unused, calling callback (ffffffffc1f014f0) 00010000:00010000:3.0:1788797198.857770:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484000/0xca7fc0c411f94a25 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797198.857777:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484000/0xca7fc0c411f94a25 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797198.857795:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8cb05088a000) 00010000:00010000:3.0:1788797198.857798:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:3.0:1788797198.857805:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484000/0xca7fc0c411f94a25 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797198.857833:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484000/0xca7fc0c411f94a25 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788797198.864374:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1788797198.868999:0:14313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351531904 00000100:00100000:0.0:1788797198.869022:0:14313:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351531904 00000100:00100000:0.0:1788797198.869187:0:14313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2 00000100:00100000:0.0:1788797198.869201:0:14313:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb06f57c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f43fc909-14ed-4850-ae62-0e6c56c6a361+8:14438:x1875689351531904:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:0.0:1788797198.869486:0:14313:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb06f57c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f43fc909-14ed-4850-ae62-0e6c56c6a361+9:14438:x1875689351531904:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 287us (5121us total) trans 8589934597 rc 0/0 00000100:00100000:0.0:1788797198.869494:0:14313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2 00000100:00100000:2.0:1788797198.878093:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1788797198.878765:0:14311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351532160 00000100:00100000:0.0:1788797198.878780:0:14311:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351532160 00000100:00100000:0.0:1788797198.878872:0:14311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 25 00000100:00100000:0.0:1788797198.878884:0:14311:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0795da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f43fc909-14ed-4850-ae62-0e6c56c6a361+9:14438:x1875689351532160:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1788797198.878917:0:14311:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788797198.878942:0:14311:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb079b80800/0xca7fc0c411f94a2c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c99e04559ee14b8 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797198.879068:0:14311:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb079b80000/0xca7fc0c411f94a33 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797198.879100:0:14311:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb079b80000/0xca7fc0c411f94a33 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797198.879113:0:14311:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb079b80000/0xca7fc0c411f94a33 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797198.879130:0:14311:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb079b81600/0xca7fc0c411f94a3a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797198.879137:0:14311:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb079b81600/0xca7fc0c411f94a3a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797198.879144:0:14311:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb079b81600/0xca7fc0c411f94a3a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788797198.879292:0:14311:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:0.0:1788797198.879403:0:14311:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb079b80000/0xca7fc0c411f94a33 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797198.879412:0:14311:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb079b80000/0xca7fc0c411f94a33 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797198.879419:0:14311:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb079b80000/0xca7fc0c411f94a33 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797198.879424:0:14311:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb079b80000 already unused, calling callback (ffffffffc1f014f0) 00010000:00010000:0.0:1788797198.879429:0:14311:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb079b80000/0xca7fc0c411f94a33 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797198.879437:0:14311:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb079b80000/0xca7fc0c411f94a33 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797198.879460:0:14311:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cb05088ad00) 00010000:00010000:0.0:1788797198.879463:0:14311:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788797198.879469:0:14311:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb079b80000/0xca7fc0c411f94a33 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797198.879475:0:14311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb079b80000/0xca7fc0c411f94a33 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797198.879489:0:14311:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb079b81600/0xca7fc0c411f94a3a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797198.879494:0:14311:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb079b81600/0xca7fc0c411f94a3a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797198.879499:0:14311:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb079b81600/0xca7fc0c411f94a3a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797198.879504:0:14311:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb079b81600 already unused, calling callback (ffffffffc1f014f0) 00010000:00010000:0.0:1788797198.879506:0:14311:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb079b81600/0xca7fc0c411f94a3a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797198.879512:0:14311:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb079b81600/0xca7fc0c411f94a3a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797198.879518:0:14311:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8cb043bd4a00) 00010000:00010000:0.0:1788797198.879520:0:14311:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788797198.879525:0:14311:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb079b81600/0xca7fc0c411f94a3a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797198.879530:0:14311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb079b81600/0xca7fc0c411f94a3a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797198.879584:0:14311:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb079b80800/0xca7fc0c411f94a2c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee14b8 expref: 11 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797198.879595:0:14311:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cb05088ad00) 00010000:00010000:0.0:1788797198.879598:0:14311:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788797198.879601:0:14311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb079b80800/0xca7fc0c411f94a2c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee14b8 expref: 11 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797198.879624:0:14311:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb079b80800, rc 0) 00000100:00100000:0.0:1788797198.879712:0:14311:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0795da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f43fc909-14ed-4850-ae62-0e6c56c6a361+10:14438:x1875689351532160:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 830us (1637us total) trans 8589934598 rc 301/301 00000100:00100000:0.0:1788797198.879722:0:14311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 25 00000100:00100000:3.0:1788797198.882356:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1788797198.882524:0:14310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351532288 00000100:00100000:2.0:1788797198.882535:0:14310:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351532288 00000100:00100000:2.0:1788797198.882605:0:14310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 26 00000100:00100000:2.0:1788797198.882638:0:14310:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8caf42063100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f43fc909-14ed-4850-ae62-0e6c56c6a361+10:14438:x1875689351532288:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1788797198.882672:0:14310:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788797198.882703:0:14310:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484800/0xca7fc0c411f94a48 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c99e04559ee14bf expref: -99 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797198.882791:0:14310:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041485200/0xca7fc0c411f94a4f lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797198.882805:0:14310:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041485200/0xca7fc0c411f94a4f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797198.882815:0:14310:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041485200/0xca7fc0c411f94a4f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788797198.882839:0:14310:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788797198.882843:0:14310:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788797198.882860:0:14310:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041485200/0xca7fc0c411f94a4f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797198.882885:0:14310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484800/0xca7fc0c411f94a48 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee14bf expref: 12 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797198.882903:0:14310:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041485200/0xca7fc0c411f94a4f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee14bf expref: 11 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797198.882912:0:14310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8cb05088a800) 00010000:00010000:2.0:1788797198.882915:0:14310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788797198.882919:0:14310:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb041485200, rc 0) 00000100:00100000:2.0:1788797198.882994:0:14310:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8caf42063100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f43fc909-14ed-4850-ae62-0e6c56c6a361+11:14438:x1875689351532288:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 361us (652us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797198.883012:0:14310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 26 00000100:00100000:1.0:1788797198.887708:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1788797198.887907:0:14312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351532416 00000100:00100000:0.0:1788797198.887920:0:14312:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351532416 00000100:00100000:0.0:1788797198.887995:0:14312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3 00000100:00100000:0.0:1788797198.888007:0:14312:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb06f57ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f43fc909-14ed-4850-ae62-0e6c56c6a361+11:14438:x1875689351532416:12345-192.168.204.38@tcp:37:lfs.0 00000100:00100000:0.0:1788797198.902603:0:14312:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb06f57ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f43fc909-14ed-4850-ae62-0e6c56c6a361+11:14438:x1875689351532416:12345-192.168.204.38@tcp:37:lfs.0 Request processed in 14581us (14891us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797198.902621:0:14312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3 00000100:00100000:3.0:1788797198.906510:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1788797198.906625:0:14313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351532672 00000100:00100000:2.0:1788797198.906639:0:14313:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351532672 00000100:00100000:2.0:1788797198.906716:0:14313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 4 00000100:00100000:2.0:1788797198.906729:0:14313:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb079bcf450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f43fc909-14ed-4850-ae62-0e6c56c6a361+11:14438:x1875689351532672:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:2.0:1788797198.907106:0:14313:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb079bcf450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f43fc909-14ed-4850-ae62-0e6c56c6a361+12:14438:x1875689351532672:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 378us (608us total) trans 8589934599 rc 0/0 00000100:00100000:2.0:1788797198.907115:0:14313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 4 00000100:00100000:1.0:1788797198.993298:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1788797198.993484:0:14311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351532800 00000100:00100000:0.0:1788797198.993495:0:14311:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351532800 00000100:00100000:0.0:1788797198.993558:0:14311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 27 00000100:00100000:0.0:1788797198.993570:0:14311:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb06f57e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8d52f9f5-7df3-47f4-a430-77f8dd50f6ec+10:14444:x1875689351532800:12345-192.168.204.38@tcp:101:bash.0 00010000:00010000:0.0:1788797198.993607:0:14311:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788797198.993631:0:14311:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb079b80800/0xca7fc0c411f94a56 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c99e04559ee14c6 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797198.993714:0:14311:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb079b81600/0xca7fc0c411f94a5d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797198.993729:0:14311:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb079b81600/0xca7fc0c411f94a5d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797198.994253:0:14311:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb079b81600/0xca7fc0c411f94a5d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797198.994274:0:14311:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb079b80000/0xca7fc0c411f94a64 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797198.994282:0:14311:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb079b80000/0xca7fc0c411f94a64 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797198.994289:0:14311:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb079b80000/0xca7fc0c411f94a64 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797198.994390:0:14311:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb079b81200/0xca7fc0c411f94a6b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797198.994399:0:14311:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb079b81200/0xca7fc0c411f94a6b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797198.994406:0:14311:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb079b81200/0xca7fc0c411f94a6b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788797198.994434:0:14311:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788797198.994438:0:14311:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788797198.995004:0:14311:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cb079b81200/0xca7fc0c411f94a6b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797198.995087:0:14311:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb079b81600/0xca7fc0c411f94a5d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797198.995094:0:14311:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb079b81600/0xca7fc0c411f94a5d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797198.995103:0:14311:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb079b81600/0xca7fc0c411f94a5d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797198.995109:0:14311:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb079b81600 already unused, calling callback (ffffffffc1f014f0) 00010000:00010000:0.0:1788797198.995115:0:14311:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb079b81600/0xca7fc0c411f94a5d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797198.995124:0:14311:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb079b81600/0xca7fc0c411f94a5d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797198.995140:0:14311:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cb05088ad00) 00010000:00010000:0.0:1788797198.995143:0:14311:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788797198.995149:0:14311:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb079b81600/0xca7fc0c411f94a5d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797198.995154:0:14311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb079b81600/0xca7fc0c411f94a5d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797198.995172:0:14311:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb079b80000/0xca7fc0c411f94a64 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797198.995178:0:14311:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb079b80000/0xca7fc0c411f94a64 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797198.995183:0:14311:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb079b80000/0xca7fc0c411f94a64 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797198.995195:0:14311:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb079b80000 already unused, calling callback (ffffffffc1f014f0) 00010000:00010000:0.0:1788797198.995198:0:14311:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb079b80000/0xca7fc0c411f94a64 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797198.995209:0:14311:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb079b80000/0xca7fc0c411f94a64 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797198.995218:0:14311:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8cb043bd4a00) 00010000:00010000:0.0:1788797198.995220:0:14311:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788797198.995223:0:14311:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb079b80000/0xca7fc0c411f94a64 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797198.995229:0:14311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb079b80000/0xca7fc0c411f94a64 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797198.995276:0:14311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb079b80800/0xca7fc0c411f94a56 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee14c6 expref: 12 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797198.995292:0:14311:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb079b81200/0xca7fc0c411f94a6b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee14c6 expref: 11 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797198.995299:0:14311:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8cb05088a800) 00010000:00010000:0.0:1788797198.995302:0:14311:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1788797198.995304:0:14311:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb079b81200, rc 0) 00000100:00100000:0.0:1788797198.995385:0:14311:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb06f57e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8d52f9f5-7df3-47f4-a430-77f8dd50f6ec+11:14444:x1875689351532800:12345-192.168.204.38@tcp:101:bash.0 Request processed in 1817us (2100us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797198.995394:0:14311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 27 00000100:00100000:1.0:1788797199.003151:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1788797199.003246:0:14310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351533056 00000100:00100000:2.0:1788797199.003264:0:14310:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351533056 00000100:00100000:2.0:1788797199.003345:0:14310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 28 00000100:00100000:2.0:1788797199.003357:0:14310:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb06f57fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8d52f9f5-7df3-47f4-a430-77f8dd50f6ec+11:14444:x1875689351533056:12345-192.168.204.38@tcp:101:bash.0 00010000:00010000:2.0:1788797199.003381:0:14310:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788797199.003409:0:14310:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484800/0xca7fc0c411f94a72 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c99e04559ee14cd expref: -99 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797199.003560:0:14310:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484c00/0xca7fc0c411f94a79 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797199.003577:0:14310:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041485200/0xca7fc0c411f94a4f lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee14bf expref: 11 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797199.003588:0:14310:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484c00/0xca7fc0c411f94a79 lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797199.003628:0:14310:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041485200/0xca7fc0c411f94a4f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee14bf expref: 11 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797199.003824:0:14310:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041485200/0xca7fc0c411f94a4f lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee14bf expref: 11 pid: 14310 timeout: 588 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788797199.003843:0:14310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb0795d8700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14310:1875689374588672:192.168.204.38@tcp:104: 00000100:00100000:2.0:1788797199.003959:0:14310:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb042e16480 going to sleep for 11 seconds 00000100:00080000:0.0:1788797199.004538:0:14306:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788797199.020305:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1788797199.020513:0:14310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb0795d8700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14310:1875689374588672:192.168.204.38@tcp:104: 00010000:00010000:2.0:1788797199.020545:0:14310:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484c00/0xca7fc0c411f94a79 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788797199.020700:0:14296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351533184 00000100:00100000:0.0:1788797199.020710:0:14296:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351533184 00010000:00010000:0.0:1788797199.020776:0:14296:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041485200/0xca7fc0c411f94a4f lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee14bf expref: 12 pid: 14310 timeout: 588 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788797199.020823:0:14296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 10 00000100:00100000:0.0:1788797199.020835:0:14296:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb077e30380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f43fc909-14ed-4850-ae62-0e6c56c6a361+12:2355:x1875689351533184:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788797199.020853:0:14296:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788797199.020861:0:14296:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041485200/0xca7fc0c411f94a4f lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee14bf expref: 12 pid: 14310 timeout: 588 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797199.020874:0:14296:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041485200/0xca7fc0c411f94a4f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee14bf expref: 12 pid: 14310 timeout: 588 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797199.020903:0:14296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041485200/0xca7fc0c411f94a4f lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee14bf expref: 12 pid: 14310 timeout: 588 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797199.020926:0:14296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8cb05088a800) 00010000:00010000:0.0:1788797199.020931:0:14296:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484c00/0xca7fc0c411f94a79 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797199.020958:0:14296:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484c00/0xca7fc0c411f94a79 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797199.020970:0:14296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484c00/0xca7fc0c411f94a79 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797199.021011:0:14296:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788797199.021141:0:14296:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb077e30380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f43fc909-14ed-4850-ae62-0e6c56c6a361+11:2355:x1875689351533184:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 308us (850us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797199.021171:0:14296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 10 00010000:00010000:1.0:1788797199.021447:0:14310:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484c00/0xca7fc0c411f94a79 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797199.021465:0:14310:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484c00/0xca7fc0c411f94a79 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797199.021494:0:14310:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080437000/0xca7fc0c411f94a80 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797199.021505:0:14310:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080437000/0xca7fc0c411f94a80 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797199.021525:0:14310:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080437000/0xca7fc0c411f94a80 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1788797199.023064:0:14306:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788797199.025462:0:14310:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080436400/0xca7fc0c411f94a87 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797199.025483:0:14310:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080436400/0xca7fc0c411f94a87 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797199.025496:0:14310:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080436400/0xca7fc0c411f94a87 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788797199.025510:0:14310:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1788797199.025545:0:14310:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484c00/0xca7fc0c411f94a79 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797199.025553:0:14310:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484c00/0xca7fc0c411f94a79 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797199.025560:0:14310:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484c00/0xca7fc0c411f94a79 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797199.025566:0:14310:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb041484c00 already unused, calling callback (ffffffffc1f014f0) 00010000:00010000:1.0:1788797199.025571:0:14310:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484c00/0xca7fc0c411f94a79 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797199.025579:0:14310:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484c00/0xca7fc0c411f94a79 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797199.025592:0:14310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8cb05088a800) 00010000:00010000:1.0:1788797199.025595:0:14310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788797199.025617:0:14310:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484c00/0xca7fc0c411f94a79 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797199.025624:0:14310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484c00/0xca7fc0c411f94a79 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788797199.025641:0:14310:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b3efc852 reply state 0000000037f95099 transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080437000/0xca7fc0c411f94a80 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788797199.025650:0:14310:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788797199.025693:0:14310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484800/0xca7fc0c411f94a72 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee14cd expref: 14 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797199.025707:0:14310:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080436400/0xca7fc0c411f94a87 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee14cd expref: 13 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797199.025714:0:14310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8cb06ce84200) 00010000:00010000:1.0:1788797199.025717:0:14310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:1.0:1788797199.025719:0:14310:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb080436400, rc 0) 00000100:00100000:1.0:1788797199.025810:0:14310:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb06f57fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8d52f9f5-7df3-47f4-a430-77f8dd50f6ec+14:14444:x1875689351533056:12345-192.168.204.38@tcp:101:bash.0 Request processed in 22455us (22668us total) trans 8589934600 rc 0/0 00000100:00100000:1.0:1788797199.025818:0:14310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 28 00010000:00010000:1.0:1788797199.050106:0:3286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080437000/0xca7fc0c411f94a80 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797199.050130:0:3286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080437000/0xca7fc0c411f94a80 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797199.050139:0:3286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080437000/0xca7fc0c411f94a80 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797199.050172:0:3286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb080437000 already unused, calling callback (ffffffffc1f014f0) 00010000:00010000:1.0:1788797199.050178:0:3286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080437000/0xca7fc0c411f94a80 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797199.050187:0:3286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080437000/0xca7fc0c411f94a80 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797199.050205:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff8cb06ce84e00) 00010000:00010000:1.0:1788797199.050208:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788797199.050213:0:3286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080437000/0xca7fc0c411f94a80 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797199.050219:0:3286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080437000/0xca7fc0c411f94a80 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788797199.061728:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1788797199.061854:0:15017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351533312 00000100:00100000:3.0:1788797199.061870:0:15017:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351533312 00000100:00100000:3.0:1788797199.061958:0:15017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 29 00000100:00100000:3.0:1788797199.061971:0:15017:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb06f57e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8d52f9f5-7df3-47f4-a430-77f8dd50f6ec+13:14444:x1875689351533312:12345-192.168.204.38@tcp:101:bash.0 00010000:00010000:3.0:1788797199.062000:0:15017:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788797199.062058:0:15017:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69000/0xca7fc0c411f94a95 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c99e04559ee14d4 expref: -99 pid: 15017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797199.062169:0:15017:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c68000/0xca7fc0c411f94a9c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797199.062186:0:15017:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c68000/0xca7fc0c411f94a9c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797199.062198:0:15017:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c68000/0xca7fc0c411f94a9c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15017 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788797199.062241:0:15017:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:3.0:1788797199.062246:0:15017:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788797199.062304:0:15017:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c68000/0xca7fc0c411f94a9c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797199.062318:0:15017:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c68000/0xca7fc0c411f94a9c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797199.062354:0:15017:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69000/0xca7fc0c411f94a95 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee14d4 expref: 15 pid: 15017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797199.062372:0:15017:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c68000/0xca7fc0c411f94a9c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee14d4 expref: 14 pid: 15017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797199.062380:0:15017:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8cb06ce84200) 00010000:00010000:3.0:1788797199.062383:0:15017:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788797199.062386:0:15017:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb077c68000, rc 0) 00000100:00100000:3.0:1788797199.063317:0:15017:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb06f57e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8d52f9f5-7df3-47f4-a430-77f8dd50f6ec+14:14444:x1875689351533312:12345-192.168.204.38@tcp:101:bash.0 Request processed in 1342us (1596us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797199.063327:0:15017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 29 00000100:00100000:3.0:1788797199.069142:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1788797199.069277:0:14313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351533568 00000100:00100000:2.0:1788797199.069295:0:14313:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351533568 00000100:00100000:2.0:1788797199.069364:0:14313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 5 00000100:00100000:2.0:1788797199.069378:0:14313:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb077e30e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8d52f9f5-7df3-47f4-a430-77f8dd50f6ec+14:14444:x1875689351533568:12345-192.168.204.38@tcp:35:bash.0 00000100:00100000:2.0:1788797199.069924:0:14313:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb077e30e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8d52f9f5-7df3-47f4-a430-77f8dd50f6ec+15:14444:x1875689351533568:12345-192.168.204.38@tcp:35:bash.0 Request processed in 548us (802us total) trans 8589934601 rc 0/0 00000100:00100000:2.0:1788797199.069934:0:14313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 5 00010000:00010000:0.0:1788797199.155279:0:15413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788797199.247712:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1788797199.249815:0:14309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351533824 00000100:00100000:3.0:1788797199.249830:0:14309:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351533824 00000100:00100000:3.0:1788797199.249982:0:14309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30 00000100:00100000:3.0:1788797199.249993:0:14309:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb06f57d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8d52f9f5-7df3-47f4-a430-77f8dd50f6ec+15:14454:x1875689351533824:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1788797199.250022:0:14309:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788797199.250058:0:14309:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69000/0xca7fc0c411f94aa3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c99e04559ee14db expref: -99 pid: 14309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788797199.250155:0:14309:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:3.0:1788797199.250297:0:14309:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69000/0xca7fc0c411f94aa3 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee14db expref: 17 pid: 14309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797199.250312:0:14309:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cb05088ad00) 00010000:00010000:3.0:1788797199.250331:0:14309:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788797199.250338:0:14309:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69000/0xca7fc0c411f94aa3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee14db expref: 17 pid: 14309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797199.250352:0:14309:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb077c69000, rc 0) 00000100:00100000:3.0:1788797199.250443:0:14309:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb06f57d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8d52f9f5-7df3-47f4-a430-77f8dd50f6ec+16:14454:x1875689351533824:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 451us (3007us total) trans 8589934602 rc 301/301 00000100:00100000:3.0:1788797199.250738:0:14309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30 00000100:00100000:2.0:1788797199.259077:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1788797199.259184:0:14313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351534080 00000100:00100000:3.0:1788797199.259194:0:14313:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351534080 00000100:00100000:3.0:1788797199.259262:0:14313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 6 00000100:00100000:3.0:1788797199.259281:0:14313:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0795d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8d52f9f5-7df3-47f4-a430-77f8dd50f6ec+16:14454:x1875689351534080:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:3.0:1788797199.259525:0:14313:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0795d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8d52f9f5-7df3-47f4-a430-77f8dd50f6ec+17:14454:x1875689351534080:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 253us (457us total) trans 8589934603 rc 0/0 00000100:00100000:3.0:1788797199.259534:0:14313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 6 00000100:00100000:0.0:1788797199.310400:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1788797199.310576:0:15017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351534336 00000100:00100000:3.0:1788797199.310762:0:15017:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351534336 00000100:00100000:3.0:1788797199.310865:0:15017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 31 00000100:00100000:3.0:1788797199.310877:0:15017:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb079b92a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8d52f9f5-7df3-47f4-a430-77f8dd50f6ec+17:14457:x1875689351534336:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1788797199.310906:0:15017:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788797199.310926:0:15017:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69000/0xca7fc0c411f94ab1 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c99e04559ee14e2 expref: -99 pid: 15017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797199.311301:0:15017:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69800/0xca7fc0c411f94ab8 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797199.311319:0:15017:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69800/0xca7fc0c411f94ab8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797199.311333:0:15017:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69800/0xca7fc0c411f94ab8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15017 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788797199.311370:0:15017:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788797199.311527:0:15017:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69000/0xca7fc0c411f94ab1 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee14e2 expref: 20 pid: 15017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797199.311552:0:15017:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69800/0xca7fc0c411f94ab8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee14e2 expref: 19 pid: 15017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797199.311561:0:15017:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8cb06ce84200) 00010000:00010000:2.0:1788797199.311564:0:15017:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788797199.311569:0:15017:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb077c69800, rc 0) 00000100:00100000:2.0:1788797199.311858:0:15017:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb079b92a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8d52f9f5-7df3-47f4-a430-77f8dd50f6ec+19:14457:x1875689351534336:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 982us (1471us total) trans 8589934604 rc 0/0 00000100:00100000:2.0:1788797199.311866:0:15017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 31 00000100:00100000:1.0:1788797199.314560:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1788797199.314615:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1788797199.314793:0:14295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351534592 00000100:00100000:0.0:1788797199.314807:0:14295:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351534592 00000100:00100000:0.0:1788797199.314881:0:14295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 0 00000100:00100000:0.0:1788797199.314892:0:14295:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb06f57ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8d52f9f5-7df3-47f4-a430-77f8dd50f6ec+19:2354:x1875689351534592:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788797199.314908:0:14295:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788797199.314955:0:14295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69800/0xca7fc0c411f94ab8 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee14e2 expref: 19 pid: 15017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797199.314976:0:14295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8cb06ce84200) 00010000:00010000:0.0:1788797199.314984:0:14295:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788797199.315015:0:14310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351534464 00000100:00100000:2.0:1788797199.315021:0:14310:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351534464 00000100:00100000:0.0:1788797199.315085:0:14295:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb06f57ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8d52f9f5-7df3-47f4-a430-77f8dd50f6ec+19:2354:x1875689351534592:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 194us (468us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797199.315105:0:14310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 32 00000100:00100000:2.0:1788797199.315116:0:14310:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb06f57c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8d52f9f5-7df3-47f4-a430-77f8dd50f6ec+19:14457:x1875689351534464:12345-192.168.204.38@tcp:54:lfs.0 00010000:00010000:2.0:1788797199.315197:0:14310:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484600/0xca7fc0c411f94ac6 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797199.315925:0:14310:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484600/0xca7fc0c411f94ac6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797199.315952:0:14310:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484600/0xca7fc0c411f94ac6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797199.315990:0:14310:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484600/0xca7fc0c411f94ac6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797199.316014:0:14310:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484600/0xca7fc0c411f94ac6 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797199.316020:0:14310:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484600/0xca7fc0c411f94ac6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797199.316239:0:14310:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb041484600 already unused, calling callback (ffffffffc1f014f0) 00010000:00010000:2.0:1788797199.316247:0:14310:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484600/0xca7fc0c411f94ac6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797199.316257:0:14310:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484600/0xca7fc0c411f94ac6 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797199.316268:0:14310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8cb06ce84200) 00010000:00010000:2.0:1788797199.316271:0:14310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788797199.316276:0:14310:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484600/0xca7fc0c411f94ac6 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797199.316281:0:14310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484600/0xca7fc0c411f94ac6 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788797199.316362:0:14310:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb06f57c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8d52f9f5-7df3-47f4-a430-77f8dd50f6ec+19:14457:x1875689351534464:12345-192.168.204.38@tcp:54:lfs.0 Request processed in 1245us (1810us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797199.316371:0:14310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 32 00000100:00100000:0.0:1788797199.317052:0:14295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 0 00000100:00100000:1.0:1788797199.318992:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1788797199.319947:0:14313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351534848 00000100:00100000:3.0:1788797199.319963:0:14313:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351534848 00000100:00100000:3.0:1788797199.320127:0:14313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 7 00000100:00100000:3.0:1788797199.320139:0:14313:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb06ec6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8d52f9f5-7df3-47f4-a430-77f8dd50f6ec+18:14457:x1875689351534848:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:3.0:1788797199.320458:0:14313:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb06ec6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8d52f9f5-7df3-47f4-a430-77f8dd50f6ec+19:14457:x1875689351534848:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 320us (1481us total) trans 8589934605 rc 0/0 00000100:00100000:3.0:1788797199.320467:0:14313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 7 00000001:00080000:1.0:1788797199.505998:0:5848:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934598 is committed 00000001:00080000:1.0:1788797199.506018:0:5848:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934593 is committed 00000001:00080000:1.0:1788797199.506024:0:5848:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934600 is committed 00000001:00080000:1.0:1788797199.506066:0:5848:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934604 is committed 00000001:00080000:1.0:1788797199.506072:0:5848:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00000001:00080000:1.0:1788797199.506079:0:5848:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934605 is committed 00000040:00080000:2.0:1788797199.541900:0:14343:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788797199.630400:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1788797199.636153:0:14311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351535104 00000100:00100000:0.0:1788797199.636178:0:14311:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351535104 00000100:00100000:0.0:1788797199.636277:0:14311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 33 00000100:00100000:0.0:1788797199.636288:0:14311:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb06ec6f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8d52f9f5-7df3-47f4-a430-77f8dd50f6ec+11:14488:x1875689351535104:12345-192.168.204.38@tcp:101:cat.0 00010000:00010000:0.0:1788797199.636315:0:14311:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788797199.636335:0:14311:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb079b81600/0xca7fc0c411f94acd lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c99e04559ee14e9 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797199.636459:0:14311:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb079b80c00/0xca7fc0c411f94ad4 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797199.636491:0:14311:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb079b80c00/0xca7fc0c411f94ad4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797199.636502:0:14311:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb079b80c00/0xca7fc0c411f94ad4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788797199.636514:0:14311:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1788797199.636986:0:14311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb079b81600/0xca7fc0c411f94acd lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee14e9 expref: 14 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797199.637007:0:14311:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb079b80c00/0xca7fc0c411f94ad4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee14e9 expref: 13 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797199.637015:0:14311:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8cb06ce84200) 00010000:00010000:0.0:1788797199.637018:0:14311:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788797199.637021:0:14311:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb079b80c00, rc 0) 00000100:00100000:0.0:1788797199.637414:0:14311:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb06ec6f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8d52f9f5-7df3-47f4-a430-77f8dd50f6ec+13:14488:x1875689351535104:12345-192.168.204.38@tcp:101:cat.0 Request processed in 1125us (7024us total) trans 8589934606 rc 0/0 00000100:00100000:0.0:1788797199.637425:0:14311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 33 00000100:00100000:1.0:1788797199.645011:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1788797199.645084:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1788797199.645213:0:14312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351535360 00000100:00100000:0.0:1788797199.645225:0:14312:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351535360 00000100:00100000:0.0:1788797199.645324:0:14312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 8 00000100:00100000:0.0:1788797199.645334:0:14312:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb06ec6d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8d52f9f5-7df3-47f4-a430-77f8dd50f6ec+13:14488:x1875689351535360:12345-192.168.204.38@tcp:35:cat.0 00000100:00100000:0.0:1788797199.645750:0:14312:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb06ec6d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8d52f9f5-7df3-47f4-a430-77f8dd50f6ec+14:14488:x1875689351535360:12345-192.168.204.38@tcp:35:cat.0 Request processed in 416us (749us total) trans 8589934607 rc 0/0 00000100:00100000:0.0:1788797199.645761:0:14312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 8 00000100:00100000:3.0:1788797199.652110:0:14297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351535488 00000100:00100000:3.0:1788797199.652129:0:14297:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351535488 00000100:00100000:3.0:1788797199.652209:0:14297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1 00000100:00100000:3.0:1788797199.652221:0:14297:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb06ec6f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8d52f9f5-7df3-47f4-a430-77f8dd50f6ec+14:2355:x1875689351535488:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788797199.652237:0:14297:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788797199.652275:0:14297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb079b80c00/0xca7fc0c411f94ad4 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee14e9 expref: 14 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797199.652310:0:14297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8cb06ce84200) 00010000:00010000:3.0:1788797199.652316:0:14297:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788797199.652392:0:14297:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb06ec6f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8d52f9f5-7df3-47f4-a430-77f8dd50f6ec+13:2355:x1875689351535488:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 174us (7307us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797199.652401:0:14297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1 00000100:00100000:0.0:1788797199.743167:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1788797199.743302:0:14309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351535744 00000100:00100000:1.0:1788797199.743314:0:14309:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351535744 00000100:00100000:1.0:1788797199.743594:0:14309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 34 00000100:00100000:1.0:1788797199.743605:0:14309:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb079b90a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8d52f9f5-7df3-47f4-a430-77f8dd50f6ec+13:14494:x1875689351535744:12345-192.168.204.38@tcp:101:dd.0 00010000:00010000:1.0:1788797199.743635:0:14309:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788797199.743658:0:14309:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080437000/0xca7fc0c411f94ae2 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c99e04559ee14f0 expref: -99 pid: 14309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797199.743772:0:14309:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080437e00/0xca7fc0c411f94ae9 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14309 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797199.743786:0:14309:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080436400/0xca7fc0c411f94a87 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee14cd expref: 14 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797199.743794:0:14309:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c68000/0xca7fc0c411f94a9c lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee14d4 expref: 14 pid: 15017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797199.743803:0:14309:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080437e00/0xca7fc0c411f94ae9 lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14309 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797199.743843:0:14309:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c68000/0xca7fc0c411f94a9c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee14d4 expref: 14 pid: 15017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797199.743857:0:14309:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c68000/0xca7fc0c411f94a9c lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee14d4 expref: 14 pid: 15017 timeout: 588 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788797199.743872:0:14309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb06ec6c000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14309:1875689374588800:192.168.204.38@tcp:104: 00010000:00010000:1.0:1788797199.744703:0:14309:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080436400/0xca7fc0c411f94a87 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee14cd expref: 14 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797199.744725:0:14309:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080436400/0xca7fc0c411f94a87 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee14cd expref: 14 pid: 14310 timeout: 588 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788797199.744737:0:14309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb06ec6d180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14309:1875689374588928:192.168.204.38@tcp:104: 00000100:00100000:1.0:1788797199.744767:0:14309:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb042fe36c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788797199.752590:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1788797199.752632:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1788797199.752801:0:14296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351536000 00000100:00100000:3.0:1788797199.752812:0:14296:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351536000 00010000:00010000:3.0:1788797199.752852:0:14296:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080436400/0xca7fc0c411f94a87 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee14cd expref: 15 pid: 14310 timeout: 588 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788797199.752894:0:14296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351535872 00000100:00100000:3.0:1788797199.752898:0:14296:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351535872 00010000:00010000:3.0:1788797199.752923:0:14296:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c68000/0xca7fc0c411f94a9c lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee14d4 expref: 16 pid: 15017 timeout: 588 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788797199.752952:0:14296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 11 00000100:00100000:3.0:1788797199.752975:0:14296:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb077f5c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8d52f9f5-7df3-47f4-a430-77f8dd50f6ec+16:2354:x1875689351536000:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788797199.752991:0:14296:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788797199.752999:0:14296:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080436400/0xca7fc0c411f94a87 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee14cd expref: 16 pid: 14310 timeout: 588 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797199.753010:0:14296:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080436400/0xca7fc0c411f94a87 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee14cd expref: 16 pid: 14310 timeout: 588 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797199.753084:0:14296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8cb06ce84200) 00010000:00010000:3.0:1788797199.753090:0:14296:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080437e00/0xca7fc0c411f94ae9 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14309 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797199.753099:0:14296:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080437e00/0xca7fc0c411f94ae9 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14309 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797199.753106:0:14296:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788797199.753163:0:14296:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb077f5c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8d52f9f5-7df3-47f4-a430-77f8dd50f6ec+16:2354:x1875689351536000:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 190us (584us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797199.753172:0:14296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 11 00000100:00100000:3.0:1788797199.753223:0:14296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 12 00000100:00100000:3.0:1788797199.753230:0:14296:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0795d8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8d52f9f5-7df3-47f4-a430-77f8dd50f6ec+15:2354:x1875689351535872:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788797199.753238:0:14296:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788797199.753242:0:14296:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c68000/0xca7fc0c411f94a9c lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee14d4 expref: 15 pid: 15017 timeout: 588 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797199.753253:0:14296:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c68000/0xca7fc0c411f94a9c lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee14d4 expref: 15 pid: 15017 timeout: 588 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797199.753290:0:14296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8cb06ce84200) 00010000:00010000:3.0:1788797199.753295:0:14296:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080437e00/0xca7fc0c411f94ae9 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14309 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797199.753304:0:14296:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080437e00/0xca7fc0c411f94ae9 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 14309 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797199.753311:0:14296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080437e00/0xca7fc0c411f94ae9 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 14309 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797199.753331:0:14296:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788797199.753350:0:14296:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0795d8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8d52f9f5-7df3-47f4-a430-77f8dd50f6ec+15:2354:x1875689351535872:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 121us (718us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797199.753357:0:14296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 12 00010000:00010000:1.0:1788797199.753788:0:14309:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c68000/0xca7fc0c411f94a9c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee14d4 expref: 14 pid: 15017 timeout: 588 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788797199.753810:0:14309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb06ec6c000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14309:1875689374588800:192.168.204.38@tcp:104: 00010000:00010000:1.0:1788797199.753824:0:14309:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080436400/0xca7fc0c411f94a87 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee14cd expref: 13 pid: 14310 timeout: 588 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788797199.753834:0:14309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb06ec6d180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14309:1875689374588928:192.168.204.38@tcp:104: 00010000:00010000:1.0:1788797199.753861:0:14309:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080437e00/0xca7fc0c411f94ae9 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14309 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797199.753872:0:14309:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080437e00/0xca7fc0c411f94ae9 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14309 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797199.753878:0:14309:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080437e00/0xca7fc0c411f94ae9 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14309 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788797199.753904:0:14309:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1788797199.754172:0:14309:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080437000/0xca7fc0c411f94ae2 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee14f0 expref: 14 pid: 14309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797199.754205:0:14309:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080437e00/0xca7fc0c411f94ae9 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee14f0 expref: 13 pid: 14309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797199.754213:0:14309:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8cb06ce84200) 00010000:00010000:1.0:1788797199.754216:0:14309:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788797199.754218:0:14309:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb080437e00, rc 0) 00000100:00100000:1.0:1788797199.754261:0:14309:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb079b90a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8d52f9f5-7df3-47f4-a430-77f8dd50f6ec+13:14494:x1875689351535744:12345-192.168.204.38@tcp:101:dd.0 Request processed in 10658us (11105us total) trans 8589934608 rc 0/0 00000100:00100000:1.0:1788797199.754269:0:14309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 34 00000100:00100000:2.0:1788797199.760640:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1788797199.760764:0:15017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351536256 00000100:00100000:0.0:1788797199.760778:0:15017:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351536256 00000100:00100000:0.0:1788797199.760851:0:15017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 35 00000100:00100000:0.0:1788797199.760861:0:15017:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0795d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8d52f9f5-7df3-47f4-a430-77f8dd50f6ec+13:14494:x1875689351536256:12345-192.168.204.38@tcp:36:dd.0 00010000:00010000:0.0:1788797199.761235:0:15017:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb079b81600/0xca7fc0c411f94af7 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797199.761568:0:15017:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb079b81600/0xca7fc0c411f94af7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797199.761581:0:15017:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb079b81600/0xca7fc0c411f94af7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15017 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788797199.761642:0:15017:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:0.0:1788797199.761685:0:15017:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e460555d reply state 00000000c9346f79 transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff8cb079b81600/0xca7fc0c411f94af7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15017 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788797199.761695:0:15017:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788797199.761819:0:15017:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0795d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8d52f9f5-7df3-47f4-a430-77f8dd50f6ec+16:14494:x1875689351536256:12345-192.168.204.38@tcp:36:dd.0 Request processed in 957us (1191us total) trans 8589934610 rc 0/0 00000100:00100000:0.0:1788797199.761828:0:15017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 35 00000020:00080000:0.0:1788797199.761833:0:15017:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788797199.768722:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb079b81600/0xca7fc0c411f94af7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797199.768741:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb079b81600/0xca7fc0c411f94af7 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797199.768750:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb079b81600/0xca7fc0c411f94af7 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797199.768755:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb079b81600 already unused, calling callback (ffffffffc1f014f0) 00010000:00010000:3.0:1788797199.768761:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb079b81600/0xca7fc0c411f94af7 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797199.768767:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb079b81600/0xca7fc0c411f94af7 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797199.768800:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8cb06ce84200) 00010000:00010000:3.0:1788797199.768803:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788797199.768809:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb079b81600/0xca7fc0c411f94af7 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797199.768815:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb079b81600/0xca7fc0c411f94af7 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15017 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788797199.772137:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1788797199.772226:0:14310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351536384 00000100:00100000:1.0:1788797199.772241:0:14310:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351536384 00000100:00100000:1.0:1788797199.772308:0:14310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 36 00000100:00100000:1.0:1788797199.772319:0:14310:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0795d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8d52f9f5-7df3-47f4-a430-77f8dd50f6ec+15:14494:x1875689351536384:12345-192.168.204.38@tcp:101:dd.0 00010000:00010000:1.0:1788797199.772343:0:14310:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788797199.772365:0:14310:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080437000/0xca7fc0c411f94afe lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c99e04559ee14f7 expref: -99 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797199.772438:0:14310:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080437000/0xca7fc0c411f94afe lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee14f7 expref: 16 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797199.772454:0:14310:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080437000/0xca7fc0c411f94afe lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee14f7 expref: 16 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797199.772473:0:14310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8cb06ce84200) 00010000:00010000:1.0:1788797199.772477:0:14310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788797199.772494:0:14310:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb080437000, rc 0) 00000100:00100000:1.0:1788797199.772550:0:14310:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0795d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8d52f9f5-7df3-47f4-a430-77f8dd50f6ec+16:14494:x1875689351536384:12345-192.168.204.38@tcp:101:dd.0 Request processed in 234us (423us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797199.772557:0:14310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 36 00000100:00100000:1.0:1788797199.804828:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1788797199.804998:0:14296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351536640 00000100:00100000:3.0:1788797199.805010:0:14296:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351536640 00000100:00100000:3.0:1788797199.805113:0:14296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2 00000100:00100000:3.0:1788797199.805124:0:14296:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb06ec6d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8d52f9f5-7df3-47f4-a430-77f8dd50f6ec+16:14494:x1875689351536640:12345-192.168.204.38@tcp:103:dd.0 00010000:00010000:3.0:1788797199.805140:0:14296:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788797199.805165:0:14296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080437000/0xca7fc0c411f94afe lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee14f7 expref: 16 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797199.805185:0:14296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8cb06ce84200) 00010000:00010000:3.0:1788797199.805190:0:14296:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788797199.805260:0:14296:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb06ec6d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8d52f9f5-7df3-47f4-a430-77f8dd50f6ec+15:14494:x1875689351536640:12345-192.168.204.38@tcp:103:dd.0 Request processed in 138us (445us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797199.805268:0:14296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2 00000100:00100000:0.0:1788797199.809148:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1788797199.809420:0:15017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351536768 00000100:00100000:2.0:1788797199.809452:0:15017:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351536768 00000100:00100000:2.0:1788797199.809528:0:15017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 37 00000100:00100000:2.0:1788797199.809540:0:15017:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb079b93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8d52f9f5-7df3-47f4-a430-77f8dd50f6ec+15:14494:x1875689351536768:12345-192.168.204.38@tcp:58:dd.0 00010000:00010000:2.0:1788797199.809709:0:15017:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484c00/0xca7fc0c411f94b05 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797199.809732:0:15017:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484c00/0xca7fc0c411f94b05 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797199.809746:0:15017:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484c00/0xca7fc0c411f94b05 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15017 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788797199.815717:0:15017:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788797199.815913:0:15017:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:2.0:1788797199.816020:0:15017:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:2.0:1788797199.816600:0:15017:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb079b93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8d52f9f5-7df3-47f4-a430-77f8dd50f6ec+15:14494:x1875689351536768:12345-192.168.204.38@tcp:58:dd.0 Request processed in 7055us (7467us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797199.816613:0:15017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 37 00000100:00100000:2.0:1788797199.824484:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1788797199.826658:0:14310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351536896 00000100:00100000:1.0:1788797199.826673:0:14310:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351536896 00000100:00100000:1.0:1788797199.826811:0:14310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 38 00000100:00100000:1.0:1788797199.826822:0:14310:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0795d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8d52f9f5-7df3-47f4-a430-77f8dd50f6ec+15:14494:x1875689351536896:12345-192.168.204.38@tcp:101:dd.0 00010000:00010000:1.0:1788797199.826861:0:14310:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788797199.826896:0:14310:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080436400/0xca7fc0c411f94b0c lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c99e04559ee14fe expref: -99 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797199.826984:0:14310:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484c00/0xca7fc0c411f94b05 lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797199.826996:0:14310:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080436400/0xca7fc0c411f94b0c lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee14fe expref: 16 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797199.827021:0:14310:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484c00/0xca7fc0c411f94b05 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 15017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797199.827054:0:14310:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080436400/0xca7fc0c411f94b0c lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee14fe expref: 16 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797199.827068:0:14310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8cb06ce84200) 00010000:00010000:1.0:1788797199.827071:0:14310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788797199.827075:0:14310:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080436400/0xca7fc0c411f94b0c lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee14fe expref: 16 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797199.827106:0:14310:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb080436400, rc 0) 00000100:00100000:1.0:1788797199.827196:0:14310:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0795d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8d52f9f5-7df3-47f4-a430-77f8dd50f6ec+16:14494:x1875689351536896:12345-192.168.204.38@tcp:101:dd.0 Request processed in 376us (2722us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797199.827203:0:14310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 38 00000100:00100000:1.0:1788797199.923752:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb0795dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875689374589056:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788797199.923827:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788797199.923985:0:14997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374589056 00000100:00100000:2.0:1788797199.923996:0:14997:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374589056 00000100:00100000:2.0:1788797199.924089:0:14997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788797199.924101:0:14997:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb06ec6c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1875689374589056:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788797199.924142:0:14997:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788797199.924209:0:14997:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb06ec6c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1875689374589056:12345-0@lo:13:osp-pre-1-0.0 Request processed in 110us (381us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797199.924216:0:14997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788797199.924265:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb0795dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875689374589056:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1788797199.924998:0:14306:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788797199.925192:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb0795dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:73f6407e-c8af-46fc-9cc4-279490305b80:3301:1875689374589184:0@lo:400:kworker.0 00000100:00100000:3.0:1788797199.925267:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788797199.925331:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb0795c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875689374589312:0@lo:400:kworker.0 00000100:00100000:0.0:1788797199.925379:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788797199.925411:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788797199.925416:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb0795c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875689374589440:0@lo:400:kworker.0 00000100:00100000:0.0:1788797199.925442:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788797199.925484:0:14996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374589312 00000100:00100000:0.0:1788797199.925505:0:14996:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374589312 00000100:00100000:0.0:1788797199.925554:0:14996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788797199.925564:0:14996:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb079b91880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1875689374589312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788797199.925611:0:14996:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb079b91880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1875689374589312:12345-0@lo:400:kworker.0 Request processed in 48us (231us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797199.925618:0:14996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:0.0:1788797199.925637:0:14306:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788797199.925657:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb0795c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875689374589312:0@lo:400:kworker.0 00000100:00100000:0.0:1788797199.925678:0:14311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374589440 00000100:00100000:0.0:1788797199.925681:0:14311:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374589440 00000100:00100000:0.0:1788797199.925721:0:14311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788797199.925728:0:14311:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb079b93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875689374589440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788797199.925761:0:14311:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb079b93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875689374589440:12345-0@lo:400:kworker.0 Request processed in 35us (319us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797199.925768:0:14311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788797199.925791:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb0795c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875689374589440:0@lo:400:kworker.0 00000100:00100000:1.0:1788797199.925863:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb0778df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3300:1875689374589568:0@lo:400:kworker.0 00000100:00100000:1.0:1788797199.925905:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788797199.930255:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788797199.930278:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb0778df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3300:1875689374589696:0@lo:400:kworker.0 00000100:00100000:1.0:1788797199.930354:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788797199.930498:0:14309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374589568 00000100:00100000:2.0:1788797199.930532:0:14309:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374589568 00000100:00100000:2.0:1788797199.930617:0:14309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788797199.930628:0:14309:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb06ec6c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1875689374589568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788797199.930721:0:14309:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb06ec6c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1875689374589568:12345-0@lo:400:kworker.0 Request processed in 95us (4815us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797199.930727:0:14309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:2.0:1788797199.930868:0:14306:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788797199.931193:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb0778df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3300:1875689374589568:0@lo:400:kworker.0 00000100:00100000:1.0:1788797199.931225:0:14311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374589696 00000100:00100000:1.0:1788797199.931228:0:14311:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374589696 00000100:00100000:1.0:1788797199.931261:0:14311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788797199.931268:0:14311:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb06ec6ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1875689374589696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788797199.931306:0:14311:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb06ec6ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1875689374589696:12345-0@lo:400:kworker.0 Request processed in 39us (954us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797199.931313:0:14311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:1.0:1788797199.931327:0:14306:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788797199.931342:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb0778df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3300:1875689374589696:0@lo:400:kworker.0 00000100:00100000:0.0:1788797199.934852:0:14305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374589184 00000100:00100000:0.0:1788797199.934876:0:14305:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374589184 00000100:00100000:0.0:1788797199.935196:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1788797199.935211:0:14305:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb079f76c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73f6407e-c8af-46fc-9cc4-279490305b80+19:3301:x1875689374589184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788797199.935336:0:14305:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb079f76c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73f6407e-c8af-46fc-9cc4-279490305b80+19:3301:x1875689374589184:12345-0@lo:400:kworker.0 Request processed in 130us (10068us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797199.935344:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1788797199.935736:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb0795dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:73f6407e-c8af-46fc-9cc4-279490305b80:3301:1875689374589184:0@lo:400:kworker.0 00010000:00010000:3.0:1788797200.178293:0:14298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788797200.563085:0:14343:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1788797200.563095:0:14343:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788797200.563141:0:14343:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:2.0:1788797200.563149:0:14343:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:2.0:1788797200.563676:0:14343:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb0778df100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14343:1875689374589824:192.168.204.38@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788797200.563851:0:14343:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb0467de540 going to sleep for 11 seconds 00000100:00100000:3.0:1788797200.572703:0:14343:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb0778df100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14343:1875689374589824:192.168.204.38@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788797200.574613:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1788797200.575950:0:14320:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351537024 00000100:00100000:3.0:1788797200.575965:0:14320:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351537024 00000100:00100000:3.0:1788797200.576078:0:14320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 0 00000100:00100000:3.0:1788797200.576089:0:14320:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb079b92680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:8d52f9f5-7df3-47f4-a430-77f8dd50f6ec+16:14495:x1875689351537024:12345-192.168.204.38@tcp:900:lhsmtool_posix.0 00000100:00100000:3.0:1788797200.576185:0:14320:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb079b92680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:8d52f9f5-7df3-47f4-a430-77f8dd50f6ec+16:14495:x1875689351537024:12345-192.168.204.38@tcp:900:lhsmtool_posix.0 Request processed in 99us (1582us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797200.576193:0:14320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 0 00000100:00100000:2.0:1788797200.583417:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1788797200.583651:0:14309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351537152 00000100:00100000:3.0:1788797200.583665:0:14309:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351537152 00000100:00100000:3.0:1788797200.583725:0:14309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 39 00000100:00100000:3.0:1788797200.583736:0:14309:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0778df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8d52f9f5-7df3-47f4-a430-77f8dd50f6ec+16:14495:x1875689351537152:12345-192.168.204.38@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788797200.583772:0:14309:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788797200.583895:0:14309:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0778df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8d52f9f5-7df3-47f4-a430-77f8dd50f6ec+16:14495:x1875689351537152:12345-192.168.204.38@tcp:53:lhsmtool_posix.0 Request processed in 160us (490us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797200.583902:0:14309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 39 00000100:00100000:0.0:1788797200.597636:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1788797200.597856:0:14311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351537280 00000100:00100000:1.0:1788797200.597872:0:14311:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351537280 00000100:00100000:2.0:1788797200.598721:0:14311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 40 00000100:00100000:2.0:1788797200.598740:0:14311:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb079b91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8d52f9f5-7df3-47f4-a430-77f8dd50f6ec+16:14495:x1875689351537280:12345-192.168.204.38@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1788797200.598848:0:14311:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041485200/0xca7fc0c411f94b13 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797200.598869:0:14311:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041485200/0xca7fc0c411f94b13 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797200.598885:0:14311:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041485200/0xca7fc0c411f94b13 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797200.599016:0:14311:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484000/0xca7fc0c411f94b1a lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797200.599063:0:14311:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484000/0xca7fc0c411f94b1a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797200.599097:0:14311:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484000/0xca7fc0c411f94b1a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797200.599138:0:14311:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041485c00/0xca7fc0c411f94b21 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797200.599152:0:14311:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041485c00/0xca7fc0c411f94b21 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797200.599160:0:14311:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041485c00/0xca7fc0c411f94b21 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788797200.599208:0:14311:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1788797200.599213:0:14311:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788797200.599751:0:14311:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041485c00/0xca7fc0c411f94b21 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797200.599778:0:14311:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041485200/0xca7fc0c411f94b13 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797200.599789:0:14311:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041485200/0xca7fc0c411f94b13 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797200.599801:0:14311:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041485200/0xca7fc0c411f94b13 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797200.599812:0:14311:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb041485200 already unused, calling callback (ffffffffc1f014f0) 00010000:00010000:2.0:1788797200.599819:0:14311:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041485200/0xca7fc0c411f94b13 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797200.599830:0:14311:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041485200/0xca7fc0c411f94b13 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797200.599870:0:14311:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8cb043bd4300) 00010000:00010000:2.0:1788797200.599874:0:14311:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788797200.599892:0:14311:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041485200/0xca7fc0c411f94b13 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797200.599920:0:14311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041485200/0xca7fc0c411f94b13 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797200.599947:0:14311:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484000/0xca7fc0c411f94b1a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797200.599975:0:14311:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484000/0xca7fc0c411f94b1a lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797200.599993:0:14311:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484000/0xca7fc0c411f94b1a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797200.600012:0:14311:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb041484000 already unused, calling callback (ffffffffc1f014f0) 00010000:00010000:2.0:1788797200.600018:0:14311:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484000/0xca7fc0c411f94b1a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797200.600116:0:14311:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484000/0xca7fc0c411f94b1a lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797200.600130:0:14311:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff8cb05088a400) 00010000:00010000:2.0:1788797200.600135:0:14311:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788797200.600140:0:14311:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484000/0xca7fc0c411f94b1a lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797200.600149:0:14311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484000/0xca7fc0c411f94b1a lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797200.600190:0:14311:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041485c00/0xca7fc0c411f94b21 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797200.600197:0:14311:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041485c00/0xca7fc0c411f94b21 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797200.600203:0:14311:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041485c00/0xca7fc0c411f94b21 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797200.600207:0:14311:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb041485c00 already unused, calling callback (ffffffffc1f014f0) 00010000:00010000:2.0:1788797200.600210:0:14311:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041485c00/0xca7fc0c411f94b21 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797200.600216:0:14311:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041485c00/0xca7fc0c411f94b21 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797200.600232:0:14311:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8cb06ce84200) 00010000:00010000:2.0:1788797200.600235:0:14311:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788797200.600238:0:14311:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041485c00/0xca7fc0c411f94b21 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797200.600244:0:14311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041485c00/0xca7fc0c411f94b21 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788797200.601303:0:14311:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb079b91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8d52f9f5-7df3-47f4-a430-77f8dd50f6ec+16:14495:x1875689351537280:12345-192.168.204.38@tcp:34:lhsmtool_posix.0 Request processed in 2556us (3663us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797200.601453:0:14311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 40 00000100:00100000:0.0:1788797200.603871:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1788797200.604214:0:14309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351537536 00000100:00100000:3.0:1788797200.604228:0:14309:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351537536 00000100:00100000:3.0:1788797200.604443:0:14309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 41 00000100:00100000:3.0:1788797200.604454:0:14309:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb079b93800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8d52f9f5-7df3-47f4-a430-77f8dd50f6ec+16:14495:x1875689351537536:12345-192.168.204.38@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788797200.604474:0:14309:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788797200.604493:0:14309:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69000/0xca7fc0c411f94b28 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c99e04559ee1505 expref: -99 pid: 14309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797200.604613:0:14309:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c68400/0xca7fc0c411f94b2f lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14309 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797200.604643:0:14309:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c68400/0xca7fc0c411f94b2f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14309 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797200.604655:0:14309:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c68400/0xca7fc0c411f94b2f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14309 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788797200.604667:0:14309:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1788797200.604772:0:14309:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c68400/0xca7fc0c411f94b2f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14309 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797200.604779:0:14309:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c68400/0xca7fc0c411f94b2f lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14309 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797200.604785:0:14309:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c68400/0xca7fc0c411f94b2f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14309 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797200.604791:0:14309:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb077c68400 already unused, calling callback (ffffffffc1f014f0) 00010000:00010000:3.0:1788797200.604795:0:14309:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c68400/0xca7fc0c411f94b2f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14309 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797200.604803:0:14309:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c68400/0xca7fc0c411f94b2f lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14309 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797200.604815:0:14309:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8cb06ce84200) 00010000:00010000:3.0:1788797200.604818:0:14309:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788797200.604823:0:14309:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c68400/0xca7fc0c411f94b2f lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14309 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797200.604829:0:14309:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c68400/0xca7fc0c411f94b2f lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14309 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797200.604924:0:14309:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69000/0xca7fc0c411f94b28 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1505 expref: 18 pid: 14309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797200.604957:0:14309:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8cb043bd4300) 00010000:00010000:3.0:1788797200.604963:0:14309:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788797200.604972:0:14309:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69000/0xca7fc0c411f94b28 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1505 expref: 18 pid: 14309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797200.604988:0:14309:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb077c69000, rc 0) 00000100:00100000:3.0:1788797200.605163:0:14309:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb079b93800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8d52f9f5-7df3-47f4-a430-77f8dd50f6ec+17:14495:x1875689351537536:12345-192.168.204.38@tcp:101:lhsmtool_posix.0 Request processed in 708us (1298us total) trans 8589934611 rc 301/301 00000100:00100000:3.0:1788797200.605175:0:14309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 41 00000100:00100000:3.0:1788797200.609610:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1788797200.609809:0:15017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351537664 00000100:00100000:1.0:1788797200.609828:0:15017:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351537664 00000100:00100000:1.0:1788797200.609903:0:15017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 42 00000100:00100000:1.0:1788797200.609928:0:15017:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb077e30380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8d52f9f5-7df3-47f4-a430-77f8dd50f6ec+17:14495:x1875689351537664:12345-192.168.204.38@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788797200.610005:0:15017:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788797200.610190:0:15017:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb077e30380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8d52f9f5-7df3-47f4-a430-77f8dd50f6ec+17:14495:x1875689351537664:12345-192.168.204.38@tcp:53:lhsmtool_posix.0 Request processed in 265us (589us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797200.610206:0:15017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 42 00000100:00100000:1.0:1788797200.615403:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1788797200.619922:0:14310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351537920 00000100:00100000:0.0:1788797200.619939:0:14310:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351537920 00000100:00100000:0.0:1788797200.620131:0:14310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 43 00000100:00100000:0.0:1788797200.620145:0:14310:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb06ec6d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8d52f9f5-7df3-47f4-a430-77f8dd50f6ec+17:14495:x1875689351537920:12345-192.168.204.38@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788797200.620170:0:14310:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788797200.620199:0:14310:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb079b80e00/0xca7fc0c411f94b3d lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c99e04559ee150c expref: -99 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788797200.621372:0:14310:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x280000400:0x6:0x0], count =28 00000004:00080000:0.0:1788797200.621382:0:14310:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000400:0x6:0x0]+28 in llog 00000004:00080000:0.0:1788797200.621430:0:14310:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x22:0x0], index 1: 0 00010000:00010000:0.0:1788797200.630209:0:14310:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb079b81e00/0xca7fc0c411f94b44 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797200.630249:0:14310:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb079b81e00/0xca7fc0c411f94b44 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797200.630261:0:14310:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb079b81e00/0xca7fc0c411f94b44 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797200.630347:0:14310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb079b80e00/0xca7fc0c411f94b3d lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee150c expref: 20 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797200.630374:0:14310:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb079b81e00/0xca7fc0c411f94b44 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee150c expref: 19 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797200.630383:0:14310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8cb043bd4a00) 00010000:00010000:0.0:1788797200.630386:0:14310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788797200.630390:0:14310:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb079b81e00, rc 0) 00000100:00100000:0.0:1788797200.630536:0:14310:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb06ec6d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8d52f9f5-7df3-47f4-a430-77f8dd50f6ec+19:14495:x1875689351537920:12345-192.168.204.38@tcp:101:lhsmtool_posix.0 Request processed in 10394us (15143us total) trans 8589934612 rc 0/0 00000100:00100000:0.0:1788797200.630545:0:14310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 43 00000100:00100000:0.0:1788797200.647335:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1788797200.647590:0:15017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351538176 00000100:00100000:1.0:1788797200.647603:0:15017:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351538176 00000100:00100000:1.0:1788797200.647678:0:15017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 44 00000100:00100000:1.0:1788797200.647689:0:15017:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0795c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8d52f9f5-7df3-47f4-a430-77f8dd50f6ec+19:14495:x1875689351538176:12345-192.168.204.38@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788797200.647756:0:15017:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788797200.647806:0:15017:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb079b81e00/0xca7fc0c411f94b44 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee150c expref: 19 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797200.647842:0:15017:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8cb043bd4a00) 00010000:00010000:1.0:1788797200.647858:0:15017:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788797200.647891:0:15017:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080437800/0xca7fc0c411f94b52 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797200.647907:0:15017:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080437800/0xca7fc0c411f94b52 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797200.647955:0:15017:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080437800/0xca7fc0c411f94b52 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797200.648015:0:15017:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080436000/0xca7fc0c411f94b59 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x666cb870 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797200.648110:0:15017:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080436000/0xca7fc0c411f94b59 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x666cb870 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797200.648118:0:15017:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080436000/0xca7fc0c411f94b59 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x666cb870 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797200.648383:0:15017:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080437800/0xca7fc0c411f94b52 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797200.648392:0:15017:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080437800/0xca7fc0c411f94b52 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797200.648398:0:15017:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080437800/0xca7fc0c411f94b52 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797200.648404:0:15017:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb080437800 already unused, calling callback (ffffffffc1f014f0) 00010000:00010000:1.0:1788797200.648408:0:15017:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080437800/0xca7fc0c411f94b52 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797200.648416:0:15017:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080437800/0xca7fc0c411f94b52 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797200.648425:0:15017:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8cb05088a800) 00010000:00010000:1.0:1788797200.648428:0:15017:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788797200.648431:0:15017:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080437800/0xca7fc0c411f94b52 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797200.648437:0:15017:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080437800/0xca7fc0c411f94b52 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797200.648447:0:15017:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080436000/0xca7fc0c411f94b59 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x666cb870 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797200.648471:0:15017:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080436000/0xca7fc0c411f94b59 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x666cb870 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797200.648478:0:15017:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080436000/0xca7fc0c411f94b59 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x666cb870 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797200.648482:0:15017:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb080436000 already unused, calling callback (ffffffffc1f014f0) 00010000:00010000:1.0:1788797200.648486:0:15017:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080436000/0xca7fc0c411f94b59 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x666cb870 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797200.648492:0:15017:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080436000/0xca7fc0c411f94b59 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x666cb870 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797200.648500:0:15017:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x666cb870 (ffff8cb06ce84e00) 00010000:00010000:1.0:1788797200.648502:0:15017:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788797200.648505:0:15017:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080436000/0xca7fc0c411f94b59 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x666cb870 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797200.648511:0:15017:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080436000/0xca7fc0c411f94b59 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x666cb870 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15017 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788797200.648592:0:15017:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0795c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8d52f9f5-7df3-47f4-a430-77f8dd50f6ec+18:14495:x1875689351538176:12345-192.168.204.38@tcp:36:lhsmtool_posix.0 Request processed in 903us (1269us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788797200.648600:0:15017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 44 00000100:00100000:0.0:1788797200.654603:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1788797200.654966:0:14309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351538304 00000100:00100000:3.0:1788797200.654977:0:14309:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351538304 00000100:00100000:3.0:1788797200.655072:0:14309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 45 00000100:00100000:3.0:1788797200.655083:0:14309:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0795c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8d52f9f5-7df3-47f4-a430-77f8dd50f6ec+18:14495:x1875689351538304:12345-192.168.204.38@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788797200.655116:0:14309:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788797200.655147:0:14309:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69000/0xca7fc0c411f94b60 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c99e04559ee1513 expref: -99 pid: 14309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797200.655184:0:14309:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c68400/0xca7fc0c411f94b67 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14309 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797200.655198:0:14309:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c68400/0xca7fc0c411f94b67 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14309 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797200.655209:0:14309:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c68400/0xca7fc0c411f94b67 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14309 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797200.655322:0:14309:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69000/0xca7fc0c411f94b60 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1513 expref: 20 pid: 14309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797200.655462:0:14309:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c68400/0xca7fc0c411f94b67 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1513 expref: 19 pid: 14309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797200.655471:0:14309:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8cb065cc2600) 00010000:00010000:3.0:1788797200.655473:0:14309:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788797200.655476:0:14309:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb077c68400, rc 0) 00000100:00100000:3.0:1788797200.655540:0:14309:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0795c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8d52f9f5-7df3-47f4-a430-77f8dd50f6ec+19:14495:x1875689351538304:12345-192.168.204.38@tcp:101:lhsmtool_posix.0 Request processed in 459us (961us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797200.655547:0:14309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 45 00000100:00100000:0.0:1788797200.658636:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1788797200.658725:0:15017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351538560 00000100:00100000:1.0:1788797200.658738:0:15017:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351538560 00000100:00100000:1.0:1788797200.658806:0:15017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 46 00000100:00100000:1.0:1788797200.658819:0:15017:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb080685500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8d52f9f5-7df3-47f4-a430-77f8dd50f6ec+19:14495:x1875689351538560:12345-192.168.204.38@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788797200.658933:0:15017:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080436200/0xca7fc0c411f94b6e lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797200.658976:0:15017:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080436200/0xca7fc0c411f94b6e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797200.658993:0:15017:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080436200/0xca7fc0c411f94b6e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15017 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788797200.661609:0:15017:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].2, 88 off8344 00000004:00080000:2.0:1788797200.661687:0:15017:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 489667657825ns, next at 490667591320ns, rc = 0 00000004:00010000:2.0:1788797200.661807:0:15017:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d4a99f6f reply state 00000000208fb595 transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080436200/0xca7fc0c411f94b6e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15017 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788797200.661835:0:15017:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788797200.661962:0:15017:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb080685500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8d52f9f5-7df3-47f4-a430-77f8dd50f6ec+21:14495:x1875689351538560:12345-192.168.204.38@tcp:36:lhsmtool_posix.0 Request processed in 3141us (3332us total) trans 8589934613 rc 0/0 00000100:00100000:2.0:1788797200.661970:0:15017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 46 00010000:00010000:3.0:1788797200.665610:0:3286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080436200/0xca7fc0c411f94b6e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797200.665629:0:3286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080436200/0xca7fc0c411f94b6e lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797200.665638:0:3286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080436200/0xca7fc0c411f94b6e lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797200.665645:0:3286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb080436200 already unused, calling callback (ffffffffc1f014f0) 00010000:00010000:3.0:1788797200.665649:0:3286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080436200/0xca7fc0c411f94b6e lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797200.665657:0:3286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080436200/0xca7fc0c411f94b6e lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797200.665678:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8cb065cc2600) 00010000:00010000:3.0:1788797200.665696:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788797200.665702:0:3286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080436200/0xca7fc0c411f94b6e lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797200.665708:0:3286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080436200/0xca7fc0c411f94b6e lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15017 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788797200.677854:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1788797200.678346:0:14309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351538688 00000100:00100000:3.0:1788797200.678362:0:14309:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351538688 00000100:00100000:2.0:1788797200.678672:0:14309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 47 00000100:00100000:2.0:1788797200.678684:0:14309:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb080685c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8d52f9f5-7df3-47f4-a430-77f8dd50f6ec+20:14495:x1875689351538688:12345-192.168.204.38@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788797200.678711:0:14309:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788797200.678736:0:14309:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041485c00/0xca7fc0c411f94b75 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c99e04559ee151a expref: -99 pid: 14309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797200.678816:0:14309:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041485c00/0xca7fc0c411f94b75 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee151a expref: 21 pid: 14309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797200.678835:0:14309:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041485c00/0xca7fc0c411f94b75 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee151a expref: 21 pid: 14309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797200.678859:0:14309:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8cb065cc2600) 00010000:00010000:2.0:1788797200.678862:0:14309:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788797200.678867:0:14309:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb041485c00, rc 0) 00000100:00100000:2.0:1788797200.678961:0:14309:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb080685c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8d52f9f5-7df3-47f4-a430-77f8dd50f6ec+21:14495:x1875689351538688:12345-192.168.204.38@tcp:101:lhsmtool_posix.0 Request processed in 279us (1119us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797200.678968:0:14309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 47 00000100:00100000:1.0:1788797200.688163:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1788797200.688773:0:14993:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351538816 00000100:00100000:2.0:1788797200.688790:0:14993:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351538816 00000100:00100000:2.0:1788797200.690005:0:14993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 13 00000100:00100000:2.0:1788797200.690045:0:14993:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb06ec6dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8d52f9f5-7df3-47f4-a430-77f8dd50f6ec+5:2354:x1875689351538816:12345-192.168.204.38@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1788797200.690531:0:14993:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb06ec6dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8d52f9f5-7df3-47f4-a430-77f8dd50f6ec+6:2354:x1875689351538816:12345-192.168.204.38@tcp:2:lhsmtool_posix.0 Request processed in 510us (2379us total) trans 8589934594 rc 0/0 00000100:00100000:2.0:1788797200.690539:0:14993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 13 00000100:00080000:3.0:1788797200.693363:0:14306:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788797200.704333:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1788797200.705650:0:14312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351539072 00000100:00100000:0.0:1788797200.705668:0:14312:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351539072 00000100:00100000:0.0:1788797200.705749:0:14312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9 00000100:00100000:0.0:1788797200.705761:0:14312:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb077e30a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8d52f9f5-7df3-47f4-a430-77f8dd50f6ec+21:14495:x1875689351539072:12345-192.168.204.38@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788797200.706365:0:14312:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb077e30a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8d52f9f5-7df3-47f4-a430-77f8dd50f6ec+22:14495:x1875689351539072:12345-192.168.204.38@tcp:35:lhsmtool_posix.0 Request processed in 603us (2042us total) trans 8589934614 rc 0/0 00000100:00100000:0.0:1788797200.706375:0:14312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9 00000100:00100000:0.0:1788797200.731199:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1788797200.731337:0:14311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351539328 00000100:00100000:2.0:1788797200.731351:0:14311:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351539328 00000100:00100000:2.0:1788797200.731422:0:14311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 48 00000100:00100000:2.0:1788797200.731433:0:14311:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb080686680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8d52f9f5-7df3-47f4-a430-77f8dd50f6ec+22:14495:x1875689351539328:12345-192.168.204.38@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788797200.731574:0:14311:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb080686680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8d52f9f5-7df3-47f4-a430-77f8dd50f6ec+22:14495:x1875689351539328:12345-192.168.204.38@tcp:57:lhsmtool_posix.0 Request processed in 142us (387us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797200.731583:0:14311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 48 00000100:00100000:1.0:1788797200.738265:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1788797200.738442:0:14309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351539456 00000100:00100000:2.0:1788797200.738454:0:14309:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351539456 00000100:00100000:2.0:1788797200.738527:0:14309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 49 00000100:00100000:2.0:1788797200.738539:0:14309:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb06ec6e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8d52f9f5-7df3-47f4-a430-77f8dd50f6ec+22:14495:x1875689351539456:12345-192.168.204.38@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788797200.738563:0:14309:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788797200.738587:0:14309:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484000/0xca7fc0c411f94b7c lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c99e04559ee1521 expref: -99 pid: 14309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797200.738672:0:14309:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041485200/0xca7fc0c411f94b83 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14309 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797200.738690:0:14309:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041485200/0xca7fc0c411f94b83 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14309 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797200.738703:0:14309:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041485200/0xca7fc0c411f94b83 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14309 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788797200.738767:0:14309:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788797200.738789:0:14309:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041485200/0xca7fc0c411f94b83 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14309 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797200.738822:0:14309:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484000/0xca7fc0c411f94b7c lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1521 expref: 24 pid: 14309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797200.738841:0:14309:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041485200/0xca7fc0c411f94b83 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1521 expref: 23 pid: 14309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797200.738850:0:14309:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8cb065cc2600) 00010000:00010000:2.0:1788797200.738853:0:14309:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1788797200.738857:0:14309:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb041485200, rc 0) 00000100:00100000:2.0:1788797200.738935:0:14309:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb06ec6e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8d52f9f5-7df3-47f4-a430-77f8dd50f6ec+23:14495:x1875689351539456:12345-192.168.204.38@tcp:101:lhsmtool_posix.0 Request processed in 399us (681us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797200.738942:0:14309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 49 00000100:00100000:3.0:1788797200.747976:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1788797200.748175:0:14996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351539584 00000100:00100000:0.0:1788797200.748189:0:14996:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351539584 00000100:00100000:0.0:1788797200.748408:0:14996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 14 00000100:00100000:0.0:1788797200.748421:0:14996:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb077e30700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8d52f9f5-7df3-47f4-a430-77f8dd50f6ec+6:2354:x1875689351539584:12345-192.168.204.38@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788797200.748443:0:14996:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788797200.748465:0:14996:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001cab9c7c/0xca7fc0c411f94b8a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7c99e04559ee1528 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788797200.748492:0:14996:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9ee111, blocks: 0x1 00010000:00010000:0.0:1788797200.748512:0:14996:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=489s v=(0 0) 00010000:00010000:0.0:1788797200.748516:0:14996:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788797200.748541:0:14996:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001cab9c7c/0xca7fc0c411f94b8a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1528 expref: 7 pid: 14996 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797200.748561:0:14996:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000001cab9c7c/0xca7fc0c411f94b8a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1528 expref: 7 pid: 14996 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797200.748575:0:14996:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb079b81600, rc 0) 00000100:00100000:0.0:1788797200.748636:0:14996:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb077e30700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8d52f9f5-7df3-47f4-a430-77f8dd50f6ec+7:2354:x1875689351539584:12345-192.168.204.38@tcp:101:lhsmtool_posix.0 Request processed in 218us (671us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797200.748643:0:14996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 14 00000100:00100000:1.0:1788797200.751205:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1788797200.751387:0:14311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351539840 00000100:00100000:3.0:1788797200.751400:0:14311:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351539840 00000100:00100000:3.0:1788797200.751482:0:14311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 50 00000100:00100000:3.0:1788797200.751494:0:14311:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb06ec6fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8d52f9f5-7df3-47f4-a430-77f8dd50f6ec+23:14495:x1875689351539840:12345-192.168.204.38@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788797200.751622:0:14311:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb06ec6fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8d52f9f5-7df3-47f4-a430-77f8dd50f6ec+23:14495:x1875689351539840:12345-192.168.204.38@tcp:57:lhsmtool_posix.0 Request processed in 130us (430us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797200.751630:0:14311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 50 00000100:00100000:1.0:1788797200.756312:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1788797200.756456:0:14309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351539968 00000100:00100000:2.0:1788797200.756467:0:14309:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351539968 00000100:00100000:2.0:1788797200.756578:0:14309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 51 00000100:00100000:2.0:1788797200.756588:0:14309:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb06ec6df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8d52f9f5-7df3-47f4-a430-77f8dd50f6ec+23:14495:x1875689351539968:12345-192.168.204.38@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1788797200.799960:0:5848:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934614 is committed 00000004:00080000:1.0:1788797200.800003:0:5848:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000100:00100000:1.0:1788797200.800319:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788797200.800352:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb077e32680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875689374589952:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1788797200.800453:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788797200.800690:0:14993:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374589952 00000100:00100000:3.0:1788797200.800701:0:14993:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374589952 00000100:00100000:3.0:1788797200.800763:0:14993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788797200.800775:0:14993:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb06ec6ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1875689374589952:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1788797200.801005:0:14993:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1788797200.801009:0:14993:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:3.0:1788797200.801012:0:14993:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1788797200.801014:0:14993:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1788797201 -> 1788797201 00002000:00010000:3.0:1788797200.801017:0:14993:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1788797200.801101:0:14993:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb06ec6ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3303:x1875689374589952:12345-0@lo:2:osp-syn-1-0.0 Request processed in 328us (646us total) trans 8589934595 rc 0/0 00000100:00100000:3.0:1788797200.801125:0:14993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000004:00080000:0.0:1788797200.801229:0:3303:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8cb077e32680/2, rc 0, transno 8589934595 00000100:00100000:0.0:1788797200.801246:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb077e32680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875689374589952:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1788797200.801614:0:14309:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb06ec6df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8d52f9f5-7df3-47f4-a430-77f8dd50f6ec+14:14495:x1875689351539968:12345-192.168.204.38@tcp:44:lhsmtool_posix.0 Request processed in 45024us (45310us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797200.801624:0:14309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 51 00000100:00100000:3.0:1788797200.804396:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1788797200.804604:0:14995:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351540096 00000100:00100000:2.0:1788797200.804614:0:14995:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351540096 00000100:00100000:2.0:1788797200.804666:0:14995:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 16 00000100:00100000:2.0:1788797200.804686:0:14995:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb077e33800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8d52f9f5-7df3-47f4-a430-77f8dd50f6ec+7:2355:x1875689351540096:12345-192.168.204.38@tcp:16:lhsmtool_posix.0 00000100:00100000:2.0:1788797200.804791:0:14995:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb077e33800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8d52f9f5-7df3-47f4-a430-77f8dd50f6ec+7:2355:x1875689351540096:12345-192.168.204.38@tcp:16:lhsmtool_posix.0 Request processed in 105us (404us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797200.804798:0:14995:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 16 00000100:00100000:1.0:1788797200.807769:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1788797200.807964:0:14311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351540352 00000100:00100000:3.0:1788797200.807976:0:14311:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351540352 00000100:00100000:3.0:1788797200.808080:0:14311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 52 00000100:00100000:3.0:1788797200.808093:0:14311:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb06ec6ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8d52f9f5-7df3-47f4-a430-77f8dd50f6ec+14:14495:x1875689351540352:12345-192.168.204.38@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788797200.808155:0:14311:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788797200.808185:0:14311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041485200/0xca7fc0c411f94b83 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1521 expref: 14 pid: 14309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797200.808209:0:14311:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8cb065cc2600) 00010000:00010000:3.0:1788797200.808214:0:14311:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788797200.808266:0:14311:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69400/0xca7fc0c411f94b91 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797200.808281:0:14311:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69400/0xca7fc0c411f94b91 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797200.808292:0:14311:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69400/0xca7fc0c411f94b91 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788797200.808486:0:14311:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a72f7a01 reply state 00000000aebd729d transno 8589934615 ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69400/0xca7fc0c411f94b91 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788797200.808496:0:14311:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788797200.808829:0:14311:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb06ec6ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8d52f9f5-7df3-47f4-a430-77f8dd50f6ec+15:14495:x1875689351540352:12345-192.168.204.38@tcp:36:lhsmtool_posix.0 Request processed in 737us (1072us total) trans 8589934615 rc 0/0 00000100:00100000:3.0:1788797200.808836:0:14311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 52 00010000:00010000:3.0:1788797200.810733:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69400/0xca7fc0c411f94b91 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797200.810754:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69400/0xca7fc0c411f94b91 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797200.810762:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69400/0xca7fc0c411f94b91 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797200.810768:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb077c69400 already unused, calling callback (ffffffffc1f014f0) 00010000:00010000:3.0:1788797200.810773:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69400/0xca7fc0c411f94b91 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797200.810780:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69400/0xca7fc0c411f94b91 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797200.810798:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8cb065cc2600) 00010000:00010000:3.0:1788797200.810801:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788797200.810806:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69400/0xca7fc0c411f94b91 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797200.810812:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69400/0xca7fc0c411f94b91 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788797200.812379:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1788797200.812452:0:14993:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351540480 00000100:00100000:3.0:1788797200.812462:0:14993:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351540480 00000100:00100000:3.0:1788797200.812516:0:14993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 17 00000100:00100000:3.0:1788797200.812524:0:14993:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb06ec6e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8d52f9f5-7df3-47f4-a430-77f8dd50f6ec+7:14495:x1875689351540480:12345-192.168.204.38@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788797200.812542:0:14993:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788797200.812564:0:14993:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e02549b2/0xca7fc0c411f94b98 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7c99e04559ee152f expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797200.812625:0:14993:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001cab9c7c/0xca7fc0c411f94b8a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1528 expref: 8 pid: 14996 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797200.812633:0:14993:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788797200.812638:0:14993:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788797200.812643:0:14993:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e02549b2/0xca7fc0c411f94b98 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee152f expref: 8 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797200.812676:0:14993:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001cab9c7c/0xca7fc0c411f94b8a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1528 expref: 8 pid: 14996 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797200.812691:0:14993:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001cab9c7c/0xca7fc0c411f94b8a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1528 expref: 8 pid: 14996 timeout: 589 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788797200.812707:0:14993:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb077e33480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:14993:1875689374590080:192.168.204.38@tcp:104: 00000100:00100000:3.0:1788797200.812805:0:14993:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb043604600 going to sleep for 11 seconds 00000100:00100000:1.0:1788797200.819071:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1788797200.819192:0:14993:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb077e33480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:14993:1875689374590080:192.168.204.38@tcp:104: 00010000:00010000:3.0:1788797200.819241:0:14993:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e02549b2/0xca7fc0c411f94b98 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee152f expref: 8 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797200.819274:0:14993:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb077c68200, rc 0) 00000100:00100000:3.0:1788797200.819341:0:14993:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb06ec6e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8d52f9f5-7df3-47f4-a430-77f8dd50f6ec+8:14495:x1875689351540480:12345-192.168.204.38@tcp:101:lhsmtool_posix.0 Request processed in 6817us (6970us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797200.819369:0:14993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 17 00000100:00100000:2.0:1788797200.819456:0:14295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351540608 00000100:00100000:2.0:1788797200.819463:0:14295:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351540608 00010000:00010000:2.0:1788797200.819495:0:14295:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001cab9c7c/0xca7fc0c411f94b8a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1528 expref: 8 pid: 14996 timeout: 589 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788797200.819526:0:14295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 13 00000100:00100000:2.0:1788797200.819534:0:14295:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb06ec6c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8d52f9f5-7df3-47f4-a430-77f8dd50f6ec+8:2355:x1875689351540608:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788797200.819548:0:14295:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788797200.819568:0:14295:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001cab9c7c/0xca7fc0c411f94b8a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1528 expref: 8 pid: 14996 timeout: 589 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797200.819579:0:14295:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001cab9c7c/0xca7fc0c411f94b8a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1528 expref: 8 pid: 14996 timeout: 589 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797200.819614:0:14295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001cab9c7c/0xca7fc0c411f94b8a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee1528 expref: 8 pid: 14996 timeout: 589 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797200.819626:0:14295:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788797200.819630:0:14295:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788797200.819636:0:14295:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e02549b2/0xca7fc0c411f94b98 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee152f expref: 7 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797200.819658:0:14295:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e02549b2/0xca7fc0c411f94b98 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee152f expref: 7 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797200.819692:0:14295:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000e02549b2/0xca7fc0c411f94b98 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee152f expref: 7 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788797200.819705:0:14295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb0778df100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:14295:1875689374590208:192.168.204.38@tcp:105: 00000100:00100000:2.0:1788797200.819759:0:14295:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb0467de9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788797200.823690:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1788797200.823789:0:14995:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351540736 00000100:00100000:3.0:1788797200.823800:0:14995:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351540736 00000100:00100000:3.0:1788797200.823860:0:14995:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 18 00000100:00100000:3.0:1788797200.823871:0:14995:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb080686a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8d52f9f5-7df3-47f4-a430-77f8dd50f6ec+8:2354:x1875689351540736:12345-192.168.204.38@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1788797200.824121:0:14995:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1788797200.824125:0:14995:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 0 -> 1788797200 00002000:00010000:3.0:1788797200.824128:0:14995:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb atime from disk: 0 -> 1788797199 00002000:00010000:3.0:1788797200.824130:0:14995:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1788797201 -> 1788797200 00002000:00010000:3.0:1788797200.824132:0:14995:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1788797200.824191:0:14995:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb080686a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8d52f9f5-7df3-47f4-a430-77f8dd50f6ec+9:2354:x1875689351540736:12345-192.168.204.38@tcp:2:lhsmtool_posix.0 Request processed in 322us (511us total) trans 8589934596 rc 0/0 00000100:00100000:3.0:1788797200.824198:0:14995:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 18 00000100:00100000:2.0:1788797200.824368:0:14295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb0778df100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:14295:1875689374590208:192.168.204.38@tcp:105: 00010000:00010000:2.0:1788797200.824391:0:14295:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788797200.824419:0:14295:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb06ec6c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8d52f9f5-7df3-47f4-a430-77f8dd50f6ec+8:2355:x1875689351540608:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 4886us (5397us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797200.824428:0:14295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 13 00000100:00100000:1.0:1788797200.827508:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1788797200.827610:0:15405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351540864 00000100:00100000:2.0:1788797200.827620:0:15405:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351540864 00000100:00100000:2.0:1788797200.827677:0:15405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19 00000100:00100000:2.0:1788797200.827688:0:15405:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb06ec6ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8d52f9f5-7df3-47f4-a430-77f8dd50f6ec+8:2353:x1875689351540864:12345-192.168.204.38@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1788797200.827767:0:15405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000c081d453/0xca7fc0c411f94b9f lrc: 3/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797200.827793:0:15405:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e02549b2/0xca7fc0c411f94b98 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee152f expref: 8 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797200.827803:0:15405:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788797200.827816:0:15405:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788797200.827821:0:15405:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c081d453/0xca7fc0c411f94b9f lrc: 4/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797200.827863:0:15405:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e02549b2/0xca7fc0c411f94b98 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee152f expref: 8 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797200.827880:0:15405:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e02549b2/0xca7fc0c411f94b98 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee152f expref: 8 pid: 14993 timeout: 589 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788797200.827898:0:15405:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb0778df100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:15405:1875689374590336:192.168.204.38@tcp:104: 00000100:00100000:2.0:1788797200.827993:0:15405:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb0467de9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788797200.830731:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1788797200.830901:0:14297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351540992 00000100:00100000:0.0:1788797200.830922:0:14297:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351540992 00010000:00010000:0.0:1788797200.830969:0:14297:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e02549b2/0xca7fc0c411f94b98 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee152f expref: 9 pid: 14993 timeout: 589 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788797200.831013:0:14297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 14 00000100:00100000:0.0:1788797200.831023:0:14297:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb06ec6f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8d52f9f5-7df3-47f4-a430-77f8dd50f6ec+9:2354:x1875689351540992:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788797200.831078:0:14297:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788797200.831106:0:14297:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e02549b2/0xca7fc0c411f94b98 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee152f expref: 9 pid: 14993 timeout: 589 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797200.831121:0:14297:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e02549b2/0xca7fc0c411f94b98 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee152f expref: 9 pid: 14993 timeout: 589 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797200.831166:0:14297:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788797200.831171:0:14297:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788797200.831176:0:14297:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c081d453/0xca7fc0c411f94b9f lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 15405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797200.831186:0:14297:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c081d453/0xca7fc0c411f94b9f lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 15405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797200.831208:0:14297:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788797200.831278:0:14297:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb06ec6f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8d52f9f5-7df3-47f4-a430-77f8dd50f6ec+9:2354:x1875689351540992:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 257us (558us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797200.831286:0:14297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 14 00010000:00010000:2.0:1788797200.831493:0:15405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e02549b2/0xca7fc0c411f94b98 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee152f expref: 8 pid: 14993 timeout: 589 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788797200.831509:0:15405:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb0778df100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:15405:1875689374590336:192.168.204.38@tcp:104: 00010000:00010000:2.0:1788797200.831528:0:15405:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000c081d453/0xca7fc0c411f94b9f lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797200.831538:0:15405:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000c081d453/0xca7fc0c411f94b9f lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797200.831545:0:15405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c081d453/0xca7fc0c411f94b9f lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797200.831567:0:15405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000c081d453/0xca7fc0c411f94b9f lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797200.831595:0:15405:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c081d453/0xca7fc0c411f94b9f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797200.831605:0:15405:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c081d453/0xca7fc0c411f94b9f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797200.831613:0:15405:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb041484000 already unused, calling callback (ffffffffc14d98b0) 00010000:00010000:2.0:1788797200.831617:0:15405:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c081d453/0xca7fc0c411f94b9f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797200.831627:0:15405:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c081d453/0xca7fc0c411f94b9f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797200.831639:0:15405:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c081d453/0xca7fc0c411f94b9f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797200.831646:0:15405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c081d453/0xca7fc0c411f94b9f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788797200.831693:0:15405:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb06ec6ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8d52f9f5-7df3-47f4-a430-77f8dd50f6ec+7:2353:x1875689351540864:12345-192.168.204.38@tcp:1:lhsmtool_posix.0 Request processed in 4007us (4196us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797200.831701:0:15405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19 00000100:00100000:0.0:1788797200.835016:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1788797200.835170:0:14310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351541248 00000100:00100000:2.0:1788797200.835182:0:14310:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351541248 00000100:00100000:2.0:1788797200.835335:0:14310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 53 00000100:00100000:2.0:1788797200.835358:0:14310:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb080684000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8d52f9f5-7df3-47f4-a430-77f8dd50f6ec+14:14495:x1875689351541248:12345-192.168.204.38@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1788797200.835431:0:14310:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041485600/0xca7fc0c411f94ba6 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797200.835448:0:14310:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041485600/0xca7fc0c411f94ba6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797200.835459:0:14310:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041485600/0xca7fc0c411f94ba6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797200.835726:0:14310:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041485200/0xca7fc0c411f94bad lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797200.835738:0:14310:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041485c00/0xca7fc0c411f94b75 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee151a expref: 15 pid: 14309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797200.835746:0:14310:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041485200/0xca7fc0c411f94bad lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797200.835780:0:14310:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041485c00/0xca7fc0c411f94b75 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee151a expref: 15 pid: 14309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797200.835794:0:14310:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041485c00/0xca7fc0c411f94b75 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee151a expref: 15 pid: 14309 timeout: 589 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788797200.835808:0:14310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb0778df100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14310:1875689374590464:192.168.204.38@tcp:104: 00000100:00100000:2.0:1788797200.835974:0:14310:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb0467de9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788797200.839178:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1788797200.839293:0:14310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb0778df100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14310:1875689374590464:192.168.204.38@tcp:104: 00010000:00010000:2.0:1788797200.839321:0:14310:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041485200/0xca7fc0c411f94bad lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788797200.839466:0:14295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351541376 00000100:00100000:3.0:1788797200.839477:0:14295:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351541376 00010000:00010000:3.0:1788797200.839512:0:14295:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041485c00/0xca7fc0c411f94b75 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee151a expref: 16 pid: 14309 timeout: 589 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788797200.839553:0:14295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 15 00000100:00100000:3.0:1788797200.839564:0:14295:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb050385f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8d52f9f5-7df3-47f4-a430-77f8dd50f6ec+16:2355:x1875689351541376:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788797200.839580:0:14295:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788797200.839598:0:14295:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041485c00/0xca7fc0c411f94b75 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee151a expref: 16 pid: 14309 timeout: 589 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797200.839610:0:14295:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041485c00/0xca7fc0c411f94b75 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee151a expref: 16 pid: 14309 timeout: 589 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797200.839644:0:14295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041485c00/0xca7fc0c411f94b75 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee151a expref: 16 pid: 14309 timeout: 589 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797200.839662:0:14295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8cb065cc2600) 00010000:00010000:3.0:1788797200.839667:0:14295:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041485200/0xca7fc0c411f94bad lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797200.839679:0:14295:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041485200/0xca7fc0c411f94bad lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797200.839687:0:14295:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041485200/0xca7fc0c411f94bad lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797200.839708:0:14295:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788797200.839778:0:14310:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041485200/0xca7fc0c411f94bad lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797200.839786:0:14310:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041485200/0xca7fc0c411f94bad lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788797200.840005:0:14310:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934616 00000001:00080000:2.0:1788797200.840185:0:14310:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000001:00080000:2.0:1788797200.840230:0:14310:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934618 00000100:00100000:2.0:1788797200.840326:0:14310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb0778df100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:14310:1875689374590592:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1788797200.840424:0:14310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788797200.840454:0:14310:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb0484c0300 going to sleep for 11 seconds 00000100:00100000:2.0:1788797200.840488:0:14314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374590592 00000100:00100000:2.0:1788797200.840492:0:14314:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374590592 00000100:00100000:2.0:1788797200.840522:0:14314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788797200.840529:0:14314:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb048e28700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14310:x1875689374590592:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1788797200.840592:0:14314:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb048e28700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14310:x1875689374590592:12345-0@lo:1000:mdt00_001.0 Request processed in 63us (168us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797200.840598:0:14314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788797200.840634:0:14310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb0778df100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:14310:1875689374590592:0@lo:1000:mdt00_001.0 00000001:00080000:2.0:1788797200.841279:0:14310:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934619 00000100:00100000:2.0:1788797200.841342:0:14310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb048e29500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:14310:1875689374590720:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1788797200.841390:0:14310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788797200.841412:0:14310:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb0502f5840 going to sleep for 11 seconds 00000100:00100000:2.0:1788797200.841429:0:14314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374590720 00000100:00100000:2.0:1788797200.841434:0:14314:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374590720 00000100:00100000:2.0:1788797200.841461:0:14314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788797200.841476:0:14314:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb048e2a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14310:x1875689374590720:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1788797200.841615:0:14314:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb048e2a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:14310:x1875689374590720:12345-0@lo:1000:mdt00_001.0 Request processed in 140us (224us total) trans 8589934597 rc 0/0 00000100:00100000:2.0:1788797200.841622:0:14314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788797200.841659:0:14310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb048e29500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:14310:1875689374590720:0@lo:1000:mdt00_001.0 00010000:00010000:2.0:1788797200.841690:0:14310:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041485200/0xca7fc0c411f94bad lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797200.841700:0:14310:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041485200/0xca7fc0c411f94bad lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797200.841706:0:14310:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041485200/0xca7fc0c411f94bad lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797200.841712:0:14310:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb041485200 already unused, calling callback (ffffffffc1f014f0) 00010000:00010000:2.0:1788797200.841717:0:14310:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041485200/0xca7fc0c411f94bad lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797200.841725:0:14310:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041485200/0xca7fc0c411f94bad lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797200.841739:0:14310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8cb065cc2600) 00010000:00010000:2.0:1788797200.841742:0:14310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788797200.841746:0:14310:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041485200/0xca7fc0c411f94bad lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797200.841753:0:14310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041485200/0xca7fc0c411f94bad lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797200.841788:0:14310:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484c00/0xca7fc0c411f94b05 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 15017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797200.841801:0:14310:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484c00/0xca7fc0c411f94b05 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 15017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797200.841808:0:14310:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484c00/0xca7fc0c411f94b05 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 15017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797200.841812:0:14310:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb041484c00 already unused, calling callback (ffffffffc1f014f0) 00010000:00010000:2.0:1788797200.841816:0:14310:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484c00/0xca7fc0c411f94b05 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 15017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797200.841821:0:14310:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484c00/0xca7fc0c411f94b05 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 15017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797200.841830:0:14310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8cb06ce84200) 00010000:00010000:2.0:1788797200.841832:0:14310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788797200.841839:0:14310:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080436400/0xca7fc0c411f94b0c lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee14fe expref: 19 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797200.841851:0:14310:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080436400/0xca7fc0c411f94b0c lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee14fe expref: 19 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797200.841861:0:14310:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080436400/0xca7fc0c411f94b0c lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee14fe expref: 19 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797200.841889:0:14310:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cb080436400/0xca7fc0c411f94b0c lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0x7c99e04559ee14fe expref: 19 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788797200.841901:0:14310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb048e2aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14310:1875689374590848:192.168.204.38@tcp:105: 00000100:00100000:3.0:1788797200.842935:0:14295:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb050385f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8d52f9f5-7df3-47f4-a430-77f8dd50f6ec+19:2355:x1875689351541376:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 3366us (3761us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797200.842947:0:14295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 15 00000100:00100000:2.0:1788797200.843067:0:14310:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb0484c0300 going to sleep for 11 seconds 00000100:00100000:2.0:1788797200.845515:0:14310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb048e2aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14310:1875689374590848:192.168.204.38@tcp:105: 00010000:00010000:2.0:1788797200.845547:0:14310:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484c00/0xca7fc0c411f94b05 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 15017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797200.845557:0:14310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484c00/0xca7fc0c411f94b05 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 15017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797200.845587:0:14310:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484800/0xca7fc0c411f94bb4 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797200.845601:0:14310:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484800/0xca7fc0c411f94bb4 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797200.845613:0:14310:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484800/0xca7fc0c411f94bb4 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797200.845623:0:14310:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484800/0xca7fc0c411f94bb4 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797200.845629:0:14310:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484800/0xca7fc0c411f94bb4 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797200.845635:0:14310:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484800/0xca7fc0c411f94bb4 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797200.845640:0:14310:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb041484800 already unused, calling callback (ffffffffc1f014f0) 00010000:00010000:2.0:1788797200.845644:0:14310:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484800/0xca7fc0c411f94bb4 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797200.845651:0:14310:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484800/0xca7fc0c411f94bb4 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797200.845681:0:14310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8cb06ce84200) 00010000:00010000:2.0:1788797200.845684:0:14310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788797200.845687:0:14310:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484800/0xca7fc0c411f94bb4 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797200.845692:0:14310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041484800/0xca7fc0c411f94bb4 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797200.845701:0:14310:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041485600/0xca7fc0c411f94ba6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797200.845707:0:14310:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041485600/0xca7fc0c411f94ba6 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797200.845712:0:14310:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041485600/0xca7fc0c411f94ba6 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797200.845717:0:14310:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb041485600 already unused, calling callback (ffffffffc1f014f0) 00010000:00010000:2.0:1788797200.845719:0:14310:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041485600/0xca7fc0c411f94ba6 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797200.845725:0:14310:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041485600/0xca7fc0c411f94ba6 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797200.845732:0:14310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8cb06ce84200) 00010000:00010000:2.0:1788797200.845735:0:14310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788797200.845738:0:14310:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041485600/0xca7fc0c411f94ba6 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797200.845743:0:14310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb041485600/0xca7fc0c411f94ba6 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788797200.845991:0:14310:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb080684000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8d52f9f5-7df3-47f4-a430-77f8dd50f6ec+18:14495:x1875689351541248:12345-192.168.204.38@tcp:57:lhsmtool_posix.0 Request processed in 10634us (10983us total) trans 8589934620 rc 0/0 00000100:00100000:2.0:1788797200.846002:0:14310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 53 00000020:00080000:2.0:1788797200.846010:0:14310:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1788797200.846491:0:14343:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1788797200.846496:0:14343:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788797200.846524:0:14343:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1788797200.846530:0:14343:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:0.0:1788797200.850655:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1788797200.850740:0:14312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351541504 00000100:00100000:3.0:1788797200.850753:0:14312:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351541504 00000100:00100000:3.0:1788797200.850820:0:14312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 10 00000100:00100000:3.0:1788797200.850832:0:14312:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb079bccc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8d52f9f5-7df3-47f4-a430-77f8dd50f6ec+18:14494:x1875689351541504:12345-192.168.204.38@tcp:49:dd.0 00000100:00100000:3.0:1788797200.851007:0:14312:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb079bccc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8d52f9f5-7df3-47f4-a430-77f8dd50f6ec+18:14494:x1875689351541504:12345-192.168.204.38@tcp:49:dd.0 Request processed in 177us (362us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797200.851015:0:14312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 10 00000100:00100000:3.0:1788797200.860278:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1788797200.860419:0:14312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351541760 00000100:00100000:1.0:1788797200.860429:0:14312:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351541760 00000100:00100000:1.0:1788797200.860486:0:14312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 11 00000100:00100000:1.0:1788797200.860496:0:14312:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb077e30e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8d52f9f5-7df3-47f4-a430-77f8dd50f6ec+18:14495:x1875689351541760:12345-192.168.204.38@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1788797200.861653:0:14312:0:(mdd_object.c:4014:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1788797200.861763:0:14312:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934621 00010000:00010000:3.0:1788797200.861820:0:14312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69000/0xca7fc0c411f94bbb lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797200.861840:0:14312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69000/0xca7fc0c411f94bbb lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797200.861854:0:14312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69000/0xca7fc0c411f94bbb lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797200.861864:0:14312:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69000/0xca7fc0c411f94bbb lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797200.861871:0:14312:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69000/0xca7fc0c411f94bbb lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797200.861877:0:14312:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69000/0xca7fc0c411f94bbb lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797200.861953:0:14312:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788797200.862122:0:14312:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb077e30e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8d52f9f5-7df3-47f4-a430-77f8dd50f6ec+20:14495:x1875689351541760:12345-192.168.204.38@tcp:35:lhsmtool_posix.0 Request processed in 1623us (1854us total) trans 8589934622 rc 0/0 00000100:00100000:3.0:1788797200.862134:0:14312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 11 00000020:00080000:3.0:1788797200.862140:0:14312:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788797200.864457:0:14299:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788797200.864476:0:14299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69000/0xca7fc0c411f94bbb lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797200.864489:0:14299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb077c69000 already unused, calling callback (ffffffffc14d98b0) 00010000:00010000:2.0:1788797200.864494:0:14299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69000/0xca7fc0c411f94bbb lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797200.864505:0:14299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69000/0xca7fc0c411f94bbb lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797200.864524:0:14299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8cb065cc2600) 00010000:00010000:2.0:1788797200.864527:0:14299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788797200.864532:0:14299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69000/0xca7fc0c411f94bbb lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797200.864538:0:14299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb077c69000/0xca7fc0c411f94bbb lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797200.864553:0:14299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788797200.864554:0:14299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788797200.864556:0:14299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788797201.047776:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1788797201.052295:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1788797201.053789:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1788797201.054659:0:14999:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351542016 00000100:00100000:2.0:1788797201.054675:0:14999:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351542016 00000100:00100000:2.0:1788797201.054748:0:14999:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351541888 00000100:00100000:2.0:1788797201.054751:0:14999:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351541888 00000100:00100000:2.0:1788797201.054795:0:14999:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351542144 00000100:00100000:2.0:1788797201.054799:0:14999:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351542144 00000100:00100000:0.0:1788797201.054807:0:15001:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 0 00000100:00100000:0.0:1788797201.054829:0:15001:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb050386d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8d52f9f5-7df3-47f4-a430-77f8dd50f6ec+9:2355:x1875689351542016:12345-192.168.204.38@tcp:4:dd.0 00002000:00010000:0.0:1788797201.054884:0:15001:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 0, mtime: 0x6a9ee110, atime: 0x6a9ee10f, ctime: 0x6a9ee110, blocks: 0x1 00010000:00010000:0.0:1788797201.054894:0:15001:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003f7d6fa5/0xca7fc0c411f94bc2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797201.054922:0:15001:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=490s v=(0 0) 00010000:00010000:0.0:1788797201.054935:0:15001:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788797201.054942:0:15001:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003f7d6fa5/0xca7fc0c411f94bc2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797201.054961:0:15001:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003f7d6fa5/0xca7fc0c411f94bc2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788797201.165810:0:7640:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934598 is committed 00000001:00080000:0.0:1788797201.165834:0:7640:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934597 is committed 00002000:00010000:3.0:1788797201.165947:0:15001:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 2097152 00002000:00010000:3.0:1788797201.165952:0:15001:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 1788797200 -> 1788797201 00002000:00010000:3.0:1788797201.165956:0:15001:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 2055 00010000:00010000:3.0:1788797201.165972:0:15001:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003f7d6fa5/0xca7fc0c411f94bc2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797201.166005:0:15001:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003f7d6fa5/0xca7fc0c411f94bc2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797201.166015:0:15001:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003f7d6fa5/0xca7fc0c411f94bc2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797201.166023:0:15001:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb079b80e00 already unused, calling callback (ffffffffc14d98b0) 00010000:00010000:3.0:1788797201.166067:0:15001:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003f7d6fa5/0xca7fc0c411f94bc2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797201.166079:0:15001:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003f7d6fa5/0xca7fc0c411f94bc2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797201.166109:0:15001:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003f7d6fa5/0xca7fc0c411f94bc2 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797201.166117:0:15001:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003f7d6fa5/0xca7fc0c411f94bc2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788797201.166434:0:15001:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb050386d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8d52f9f5-7df3-47f4-a430-77f8dd50f6ec+7:2355:x1875689351542016:12345-192.168.204.38@tcp:4:dd.0 Request processed in 111608us (118668us total) trans 8589934598 rc 0/0 00000100:00100000:3.0:1788797201.166452:0:15001:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 0 00000100:00100000:3.0:1788797201.166863:0:15001:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1 00000100:00100000:3.0:1788797201.166879:0:15001:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb077e30a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8d52f9f5-7df3-47f4-a430-77f8dd50f6ec+6:2352:x1875689351541888:12345-192.168.204.38@tcp:4:dd.0 00002000:00010000:3.0:1788797201.166944:0:15001:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 2097152, mtime: 0x6a9ee111, atime: 0x6a9ee10f, ctime: 0x0, blocks: 0x807 00010000:00010000:3.0:1788797201.166960:0:15001:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000043da56de/0xca7fc0c411f94bc9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797201.166974:0:15001:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=490s v=(0 0) 00010000:00010000:3.0:1788797201.166978:0:15001:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788797201.166985:0:15001:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000043da56de/0xca7fc0c411f94bc9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797201.166999:0:15001:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000043da56de/0xca7fc0c411f94bc9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797201.204087:0:15413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1788797201.238944:0:7640:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934599 is committed 00002000:00010000:3.0:1788797201.239136:0:15001:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 2055 -> 4103 00010000:00010000:3.0:1788797201.239155:0:15001:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000043da56de/0xca7fc0c411f94bc9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797201.239168:0:15001:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000043da56de/0xca7fc0c411f94bc9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797201.239177:0:15001:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000043da56de/0xca7fc0c411f94bc9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797201.239184:0:15001:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb077c69800 already unused, calling callback (ffffffffc14d98b0) 00010000:00010000:3.0:1788797201.239189:0:15001:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000043da56de/0xca7fc0c411f94bc9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797201.239198:0:15001:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000043da56de/0xca7fc0c411f94bc9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797201.239480:0:15001:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000043da56de/0xca7fc0c411f94bc9 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797201.239561:0:15001:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000043da56de/0xca7fc0c411f94bc9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788797201.239716:0:15001:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb077e30a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8d52f9f5-7df3-47f4-a430-77f8dd50f6ec+6:2352:x1875689351541888:12345-192.168.204.38@tcp:4:dd.0 Request processed in 72837us (187430us total) trans 8589934599 rc 0/0 00000100:00100000:3.0:1788797201.239729:0:15001:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1 00000100:00100000:3.0:1788797201.239771:0:15001:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2 00000100:00100000:3.0:1788797201.239786:0:15001:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb077e33480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8d52f9f5-7df3-47f4-a430-77f8dd50f6ec+5:2352:x1875689351542144:12345-192.168.204.38@tcp:4:dd.0 00002000:00010000:3.0:1788797201.239838:0:15001:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 2097152, mtime: 0x6a9ee111, atime: 0x6a9ee10f, ctime: 0x0, blocks: 0x1007 00010000:00010000:3.0:1788797201.239845:0:15001:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000de00d1ce/0xca7fc0c411f94bd0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797201.239857:0:15001:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=490s v=(0 0) 00010000:00010000:3.0:1788797201.239861:0:15001:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788797201.239866:0:15001:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000de00d1ce/0xca7fc0c411f94bd0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797201.239878:0:15001:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000de00d1ce/0xca7fc0c411f94bd0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788797201.333915:0:15001:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 2097152 -> 3145728 00002000:00010000:3.0:1788797201.333926:0:15001:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 4103 -> 6151 00010000:00010000:3.0:1788797201.333961:0:15001:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000de00d1ce/0xca7fc0c411f94bd0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797201.333974:0:15001:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000de00d1ce/0xca7fc0c411f94bd0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797201.333983:0:15001:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000de00d1ce/0xca7fc0c411f94bd0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797201.333989:0:15001:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb077c69600 already unused, calling callback (ffffffffc14d98b0) 00010000:00010000:3.0:1788797201.333995:0:15001:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000de00d1ce/0xca7fc0c411f94bd0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797201.334003:0:15001:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000de00d1ce/0xca7fc0c411f94bd0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797201.334025:0:15001:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000de00d1ce/0xca7fc0c411f94bd0 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788797201.334066:0:7640:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934600 is committed 00010000:00010000:3.0:1788797201.334070:0:15001:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000de00d1ce/0xca7fc0c411f94bd0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788797201.334175:0:15001:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb077e33480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8d52f9f5-7df3-47f4-a430-77f8dd50f6ec+5:2352:x1875689351542144:12345-192.168.204.38@tcp:4:dd.0 Request processed in 94389us (280389us total) trans 8589934600 rc 0/0 00000100:00100000:3.0:1788797201.334185:0:15001:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2 00000100:00100000:2.0:1788797201.340276:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1788797201.340324:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1788797201.340360:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1788797201.340778:0:15000:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351542400 00000100:00100000:3.0:1788797201.340791:0:15000:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351542400 00000100:00100000:3.0:1788797201.340908:0:15000:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351542272 00000100:00100000:3.0:1788797201.340912:0:15000:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351542272 00000100:00100000:3.0:1788797201.340927:0:15000:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351542656 00000100:00100000:3.0:1788797201.340930:0:15000:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351542656 00000100:00100000:0.0:1788797201.340945:0:15001:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3 00000100:00100000:0.0:1788797201.340960:0:15001:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb048e2aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8d52f9f5-7df3-47f4-a430-77f8dd50f6ec+7:2354:x1875689351542400:12345-192.168.204.38@tcp:4:dd.0 00002000:00010000:0.0:1788797201.341015:0:15001:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 3145728, mtime: 0x6a9ee111, atime: 0x6a9ee10f, ctime: 0x0, blocks: 0x1807 00010000:00010000:0.0:1788797201.341025:0:15001:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000319e1815/0xca7fc0c411f94bd7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797201.341062:0:15001:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=490s v=(0 0) 00010000:00010000:0.0:1788797201.341067:0:15001:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788797201.341074:0:15001:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000319e1815/0xca7fc0c411f94bd7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797201.341090:0:15001:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000319e1815/0xca7fc0c411f94bd7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788797201.341454:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1788797201.341928:0:14999:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:0.0:1788797201.341939:0:14999:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000100:00100000:3.0:1788797201.342296:0:15000:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:0.0:1788797201.342463:0:14999:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351542528 00000100:00100000:0.0:1788797201.342482:0:14999:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351542528 00000100:00100000:1.0:1788797201.343014:0:16552:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 4 00000100:00100000:1.0:1788797201.343075:0:16552:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb048e2b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8d52f9f5-7df3-47f4-a430-77f8dd50f6ec+9:2354:x1875689351542272:12345-192.168.204.38@tcp:4:dd.0 00010000:00010000:1.0:1788797201.343110:0:16552:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006b55ee14/0xca7fc0c411f94bde lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16552 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797201.343129:0:16552:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788797201.343134:0:16552:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788797201.343140:0:16552:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006b55ee14/0xca7fc0c411f94bde lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16552 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797201.343163:0:16552:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006b55ee14/0xca7fc0c411f94bde lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16552 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788797201.343385:0:15000:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_004' 00000100:00100000:3.0:1788797201.349113:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1788797201.349456:0:15000:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351542784 00000100:00100000:2.0:1788797201.349466:0:15000:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351542784 00000100:00100000:2.0:1788797201.349983:0:16553:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 5 00000100:00100000:2.0:1788797201.349996:0:16553:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb0778df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8d52f9f5-7df3-47f4-a430-77f8dd50f6ec+11:2354:x1875689351542656:12345-192.168.204.38@tcp:4:dd.0 00010000:00010000:2.0:1788797201.350081:0:16553:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000076e75d25/0xca7fc0c411f94be5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797201.350103:0:16553:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788797201.350108:0:16553:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788797201.350115:0:16553:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000076e75d25/0xca7fc0c411f94be5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797201.350131:0:16553:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000076e75d25/0xca7fc0c411f94be5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788797201.449879:0:7640:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934601 is committed 00002000:00010000:0.0:1788797201.449998:0:15001:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 3145728 -> 7340032 00002000:00010000:0.0:1788797201.450004:0:15001:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 6151 -> 8199 00010000:00010000:0.0:1788797201.450020:0:15001:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000319e1815/0xca7fc0c411f94bd7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797201.450056:0:15001:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000319e1815/0xca7fc0c411f94bd7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797201.450065:0:15001:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000319e1815/0xca7fc0c411f94bd7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797201.450073:0:15001:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb079b80000 already unused, calling callback (ffffffffc14d98b0) 00010000:00010000:0.0:1788797201.450078:0:15001:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000319e1815/0xca7fc0c411f94bd7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797201.450086:0:15001:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000319e1815/0xca7fc0c411f94bd7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797201.450109:0:15001:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000319e1815/0xca7fc0c411f94bd7 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797201.450117:0:15001:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000319e1815/0xca7fc0c411f94bd7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788797201.450225:0:15001:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb048e2aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8d52f9f5-7df3-47f4-a430-77f8dd50f6ec+15:2354:x1875689351542400:12345-192.168.204.38@tcp:4:dd.0 Request processed in 109264us (109958us total) trans 8589934601 rc 0/0 00000100:00100000:0.0:1788797201.450236:0:15001:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3 00000100:00100000:0.0:1788797201.450297:0:15001:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 6 00000100:00100000:0.0:1788797201.450308:0:15001:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb077921500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8d52f9f5-7df3-47f4-a430-77f8dd50f6ec+14:2355:x1875689351542528:12345-192.168.204.38@tcp:4:dd.0 00010000:00010000:0.0:1788797201.450338:0:15001:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001cab9c7c/0xca7fc0c411f94bec lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797201.450352:0:15001:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788797201.450356:0:15001:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788797201.450363:0:15001:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001cab9c7c/0xca7fc0c411f94bec lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797201.450375:0:15001:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001cab9c7c/0xca7fc0c411f94bec lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788797201.525347:0:7640:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934602 is committed 00000001:00080000:1.0:1788797201.525383:0:7640:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934603 is committed 00002000:00010000:1.0:1788797201.525513:0:16553:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 8199 -> 12295 00010000:00010000:1.0:1788797201.525530:0:16553:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000076e75d25/0xca7fc0c411f94be5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797201.525543:0:16553:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000076e75d25/0xca7fc0c411f94be5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797201.525552:0:16553:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000076e75d25/0xca7fc0c411f94be5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797201.525560:0:16553:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb041485200 already unused, calling callback (ffffffffc14d98b0) 00010000:00010000:1.0:1788797201.525583:0:16553:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000076e75d25/0xca7fc0c411f94be5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797201.525594:0:16553:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000076e75d25/0xca7fc0c411f94be5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797201.525639:0:16553:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000076e75d25/0xca7fc0c411f94be5 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797201.525648:0:16553:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000076e75d25/0xca7fc0c411f94be5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788797201.526117:0:16553:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb0778df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8d52f9f5-7df3-47f4-a430-77f8dd50f6ec+12:2354:x1875689351542656:12345-192.168.204.38@tcp:4:dd.0 Request processed in 175772us (185403us total) trans 8589934603 rc 0/0 00000100:00100000:1.0:1788797201.526130:0:16553:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 5 00000100:00100000:1.0:1788797201.526172:0:16553:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 7 00000100:00100000:1.0:1788797201.526186:0:16553:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb077e33100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8d52f9f5-7df3-47f4-a430-77f8dd50f6ec+11:2355:x1875689351542784:12345-192.168.204.38@tcp:4:dd.0 00010000:00010000:1.0:1788797201.526233:0:16553:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000086692819/0xca7fc0c411f94bf3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797201.526246:0:16553:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788797201.526250:0:16553:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788797201.526255:0:16553:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000086692819/0xca7fc0c411f94bf3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797201.526268:0:16553:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000086692819/0xca7fc0c411f94bf3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788797201.534506:0:16552:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 7340032 -> 7654321 00002000:00010000:0.0:1788797201.534516:0:16552:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 0 -> 1788797201 00010000:00010000:0.0:1788797201.534529:0:16552:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006b55ee14/0xca7fc0c411f94bde lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16552 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797201.534543:0:16552:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006b55ee14/0xca7fc0c411f94bde lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16552 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797201.534552:0:16552:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006b55ee14/0xca7fc0c411f94bde lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16552 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797201.534559:0:16552:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb080436000 already unused, calling callback (ffffffffc14d98b0) 00010000:00010000:0.0:1788797201.534565:0:16552:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006b55ee14/0xca7fc0c411f94bde lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16552 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797201.534595:0:16552:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006b55ee14/0xca7fc0c411f94bde lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16552 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797201.534628:0:16552:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006b55ee14/0xca7fc0c411f94bde lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16552 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797201.534637:0:16552:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006b55ee14/0xca7fc0c411f94bde lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16552 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788797201.535116:0:16552:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb048e2b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8d52f9f5-7df3-47f4-a430-77f8dd50f6ec+13:2354:x1875689351542272:12345-192.168.204.38@tcp:4:dd.0 Request processed in 192087us (194785us total) trans 8589934602 rc 0/0 00000100:00100000:0.0:1788797201.535128:0:16552:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 4 00002000:00010000:3.0:1788797201.572739:0:15001:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 12295 -> 14343 00010000:00010000:3.0:1788797201.572764:0:15001:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001cab9c7c/0xca7fc0c411f94bec lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797201.572789:0:15001:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001cab9c7c/0xca7fc0c411f94bec lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797201.572800:0:15001:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001cab9c7c/0xca7fc0c411f94bec lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797201.572808:0:15001:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb079b81600 already unused, calling callback (ffffffffc14d98b0) 00010000:00010000:3.0:1788797201.572815:0:15001:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001cab9c7c/0xca7fc0c411f94bec lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797201.572825:0:15001:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001cab9c7c/0xca7fc0c411f94bec lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797201.572855:0:15001:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001cab9c7c/0xca7fc0c411f94bec lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797201.572863:0:15001:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001cab9c7c/0xca7fc0c411f94bec lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788797201.573002:0:15001:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb077921500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8d52f9f5-7df3-47f4-a430-77f8dd50f6ec+11:2355:x1875689351542528:12345-192.168.204.38@tcp:4:dd.0 Request processed in 122691us (231542us total) trans 8589934604 rc 0/0 00000100:00100000:3.0:1788797201.573015:0:15001:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 6 00000001:00080000:0.0:1788797201.574415:0:7640:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934604 is committed 00002000:00010000:1.0:1788797201.618552:0:16553:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 14343 -> 16391 00010000:00010000:1.0:1788797201.618574:0:16553:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000086692819/0xca7fc0c411f94bf3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797201.618588:0:16553:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000086692819/0xca7fc0c411f94bf3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797201.618598:0:16553:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000086692819/0xca7fc0c411f94bf3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797201.618616:0:16553:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb080437800 already unused, calling callback (ffffffffc14d98b0) 00010000:00010000:1.0:1788797201.618622:0:16553:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000086692819/0xca7fc0c411f94bf3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797201.618633:0:16553:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000086692819/0xca7fc0c411f94bf3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797201.618656:0:16553:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000086692819/0xca7fc0c411f94bf3 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797201.618664:0:16553:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000086692819/0xca7fc0c411f94bf3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788797201.618999:0:7640:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934605 is committed 00000100:00100000:1.0:1788797201.619107:0:16553:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb077e33100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8d52f9f5-7df3-47f4-a430-77f8dd50f6ec+5:2355:x1875689351542784:12345-192.168.204.38@tcp:4:dd.0 Request processed in 92921us (270001us total) trans 8589934605 rc 0/0 00000100:00100000:1.0:1788797201.619132:0:16553:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 7 00000100:00100000:0.0:1788797201.970613:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788797201.970643:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb077e32d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875689374590976:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788797201.970735:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788797201.970833:0:14997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689374590976 00000100:00100000:0.0:1788797201.970842:0:14997:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689374590976 00000100:00100000:0.0:1788797201.970918:0:14997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788797201.970929:0:14997:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb080685180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875689374590976:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788797201.970978:0:14997:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788797201.971055:0:14997:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb080685180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875689374590976:12345-0@lo:13:osp-pre-0-0.0 Request processed in 103us (294us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797201.971062:0:14997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:0.0:1788797201.971102:0:14306:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788797201.971142:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb077e32d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875689374590976:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788797202.226315:0:14298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788797202.326535:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1788797202.326661:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1788797202.326704:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1788797202.326737:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1788797202.326755:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1788797202.326775:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1788797202.326803:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1788797202.326872:0:15405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351543168 00000100:00100000:2.0:1788797202.326893:0:15405:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351543168 00000100:00100000:2.0:1788797202.326963:0:15405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351543680 00000100:00100000:2.0:1788797202.326966:0:15405:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351543680 00000100:00100000:1.0:1788797202.326975:0:14311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351543424 00000100:00100000:1.0:1788797202.326983:0:14311:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351543424 00000100:00100000:2.0:1788797202.326989:0:15405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351543296 00000100:00100000:2.0:1788797202.326994:0:15405:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351543296 00000100:00100000:2.0:1788797202.327018:0:15405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351543552 00000100:00100000:2.0:1788797202.327021:0:15405:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351543552 00000100:00100000:1.0:1788797202.327024:0:14311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351543040 00000100:00100000:1.0:1788797202.327060:0:14311:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351543040 00000100:00100000:2.0:1788797202.327078:0:15405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 17 00000100:00100000:2.0:1788797202.327092:0:15405:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb077921880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8d52f9f5-7df3-47f4-a430-77f8dd50f6ec+5:2352:x1875689351543168:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:1.0:1788797202.327096:0:14311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 29 00000100:00100000:1.0:1788797202.327107:0:14311:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb077921c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f43fc909-14ed-4850-ae62-0e6c56c6a361+6:2352:x1875689351543424:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:0.0:1788797202.327200:0:14995:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 18 00000100:00100000:0.0:1788797202.327211:0:14995:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb077923b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f43fc909-14ed-4850-ae62-0e6c56c6a361+5:2352:x1875689351543680:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:2.0:1788797202.327300:0:15405:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb077921880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8d52f9f5-7df3-47f4-a430-77f8dd50f6ec+5:2352:x1875689351543168:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 211us (637us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797202.327309:0:15405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 17 00000100:00100000:2.0:1788797202.327329:0:15405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19 00000100:00100000:2.0:1788797202.327337:0:15405:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb077921f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8d52f9f5-7df3-47f4-a430-77f8dd50f6ec+5:2352:x1875689351543296:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:1.0:1788797202.329929:0:14311:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb077921c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f43fc909-14ed-4850-ae62-0e6c56c6a361+6:2352:x1875689351543424:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 2805us (3205us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797202.329947:0:14311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 29 00000100:00100000:1.0:1788797202.329990:0:14311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30 00000100:00100000:1.0:1788797202.330006:0:14311:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb077920e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8d52f9f5-7df3-47f4-a430-77f8dd50f6ec+20:2352:x1875689351543040:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:1.0:1788797202.330084:0:14311:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb077920e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8d52f9f5-7df3-47f4-a430-77f8dd50f6ec+20:2352:x1875689351543040:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 86us (3328us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797202.330091:0:14311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30 00000100:00100000:1.0:1788797202.330152:0:14996:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:1.0:1788797202.330161:0:14996:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00000100:00080000:1.0:1788797202.330203:0:14306:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788797202.330327:0:14306:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788797202.330331:0:14306:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788797202.330781:0:14996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 20 00000100:00100000:1.0:1788797202.330793:0:14996:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb077923100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f43fc909-14ed-4850-ae62-0e6c56c6a361+5:2352:x1875689351543552:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:1.0:1788797202.330839:0:14996:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb077923100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f43fc909-14ed-4850-ae62-0e6c56c6a361+5:2352:x1875689351543552:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 50us (4035us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797202.330845:0:14996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 20 00000100:00100000:3.0:1788797202.340104:0:14304:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689351542912 00000100:00100000:3.0:1788797202.340122:0:14304:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689351542912 00000100:00100000:3.0:1788797202.340211:0:14304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 124 00000100:00100000:3.0:1788797202.340222:0:14304:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb079f77050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17a8599e-7555-4132-8043-ffdcb544e5c7+13:2352:x1875689351542912:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:3.0:1788797202.343136:0:14304:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb079f77050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17a8599e-7555-4132-8043-ffdcb544e5c7+13:2352:x1875689351542912:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 2903us (16599us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797202.343151:0:14304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 124 00000100:00100000:0.0:1788797202.345610:0:14995:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb077923b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f43fc909-14ed-4850-ae62-0e6c56c6a361+5:2352:x1875689351543680:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 18389us (18859us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797202.345627:0:14995:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 18 00000100:00100000:2.0:1788797202.354578:0:15405:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb077921f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8d52f9f5-7df3-47f4-a430-77f8dd50f6ec+5:2352:x1875689351543296:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 27226us (27785us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797202.354597:0:15405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19 00010000:00010000:2.0:1788797203.251432:0:14299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788797203.439787:0:16592:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: expected /mnt/pcc.d1c.sanity-pcc/d1c.sanity-pcc/0bd3/0x200000bd1:0x2:0x0 size: 7654321 got: 0 00000040:00080000:2.0:1788797203.956208:0:14343:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1788797203.956226:0:14343:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788797203.956269:0:14343:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:2.0:1788797203.956278:0:14343:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:0.0:1788797204.277062:0:15413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 29450 lines, 29450 kept, 0 dropped, 0 bad.